-----============= acceptance-small: sanityn ============----- Wed May 29 16:00:41 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 27 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 16:00:50 (1717012850) === Starting client oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Started clients oleg124-client.virtnet: 192.168.201.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg124-client.virtnet: executing check_config_client /mnt/lustre oleg124-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg124-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6229800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b6cdd800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6229800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cdd800.idle_timeout=debug disable quota as required oleg124-server: oleg124-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 16:01:03 (1717012863) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142924 s, 73.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6949] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 16:01:03 (1717012863) PASS 0 (5s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 16:01:08 (1717012868) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (3s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 16:01:11 (1717012871) -rw-r--r-- 1 root root 0 May 29 16:01 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (3s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 16:01:14 (1717012874) -rw-r--r-- 1 root root 0 May 29 16:01 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (3s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 16:01:17 (1717012877) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (3s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 16:01:20 (1717012880) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (3s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 16:01:23 (1717012883) total 1 -rwxrwxrwx 1 root root 0 May 29 16:01 f2a -rwxrwxrwx 1 root root 0 May 29 16:01 f2b total 1 -rwxrwxrwx 1 root root 0 May 29 16:01 f2a -rwxrwxrwx 1 root root 0 May 29 16:01 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00677375 s, 75.6 kB/s PASS 2e (3s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 16:01:26 (1717012886) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (2s) == sanityn test 2g: check blocks update on sync write ==== 16:01:28 (1717012888) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.317723 s, 6.6 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (3s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 16:01:32 (1717012892) PASS 3 (3s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 16:01:35 (1717012895) PASS 4 (4s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 16:01:39 (1717012899) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (3s) == sanityn test 6: remove of open file on other node ============================================================================ 16:01:42 (1717012902) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (3s) == sanityn test 7: remove of open directory on other node ======================================================================= 16:01:45 (1717012905) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 16:01:47 (1717012907) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (3s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 16:01:50 (1717012910) PASS 9a (3s) == sanityn test 9b: append to striped sparse file ======== 16:01:53 (1717012913) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180818 s, 58.0 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0183702 s, 0.2 kB/s Data read (expecting 'foo'): foo PASS 9b (3s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 16:01:56 (1717012916) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00612579 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00668139 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00905596 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00759891 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00958022 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00582193 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00647409 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00723208 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00508238 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0103109 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00692169 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00722303 s, 0.1 kB/s PASS 10a (3s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 16:02:00 (1717012920) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.0141583 s, 217 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.027733 s, 148 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00023349 s, 13.2 MB/s PASS 10b (3s) == sanityn test 11: execution of file opened for write should return error ============================================================== 16:02:03 (1717012923) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (4s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 16:02:07 (1717012927) warning: '-runtime' deprecated, use '-t runtime' instead - link 678 (time 1717012938.28 total 10.01 last 67.76) - link 1307 (time 1717012948.28 total 20.01 last 62.89) - link 1919 (time 1717012958.28 total 30.01 last 61.16) - link 2635 (time 1717012968.29 total 40.02 last 71.56) - link 3292 (time 1717012978.30 total 50.02 last 65.67) - link 4184 (time 1717012988.30 total 60.03 last 89.11) - link 5181 (time 1717012998.31 total 70.04 last 99.66) - link 6122 (time 1717013008.33 total 80.06 last 93.93) - link 6834 (time 1717013018.34 total 90.07 last 71.12) total: 7533 link in 100.01 seconds: 75.32 ops/second using seed 2929603211 running for 100 seconds - stat 10000 (time 1717012936 ; total 7 ; last 7) - stat 20000 (time 1717012942 ; total 13 ; last 6) - stat 30000 (time 1717012949 ; total 20 ; last 7) - stat 40000 (time 1717012956 ; total 27 ; last 7) - stat 50000 (time 1717012963 ; total 34 ; last 7) - stat 60000 (time 1717012970 ; total 41 ; last 7) - stat 70000 (time 1717012976 ; total 47 ; last 6) - stat 76953 (time 1717012987 ; total 58 ; last 11) - stat 80000 (time 1717012995 ; total 66 ; last 8) - stat 84104 (time 1717013006 ; total 77 ; last 11) - stat 87608 (time 1717013017 ; total 88 ; last 11) - stat 90000 (time 1717013024 ; total 95 ; last 7) total: 91254 stats in 100 seconds: 912.539978 stats/second - unlinked 0 (time 1717012979 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile7533) error: No such file or directory total: 7532 unlinks in 93 seconds: 80.989250 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (21280) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (21283) - No such process PASS 12 (148s) == sanityn test 13: test directory page revocation ======= 16:04:35 (1717013075) f13 f13 PASS 13 (4s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 16:04:39 (1717013079) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4719: 22670 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (3s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 16:04:42 (1717013082) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4719: 23302 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 16:04:44 (1717013084) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 23931 Terminated $DIR1/$tdir/sleep 60 PASS 14b (3s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 16:04:47 (1717013087) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 24563 Terminated $DIR1/$tdir/sleep 60 PASS 14c (3s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 16:04:50 (1717013090) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 25195 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 16:04:54 (1717013094) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7519232 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7519232kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS zfs Waiting for MDT destroys to complete SKIP 15 (15s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 16:05:09 (1717013109) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.328639 s, 25.5 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.318893 s, 26.3 MB/s Chance of close/open is 1 in 50 Seed set to 3111 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[0] 1717013112.057182 mapwrite 0x87cfd6 thru 0x888da1 (0xbdcc bytes) 000002[0] 1717013112.200906 write 0x1f7e5e thru 0x1fb47b (0x361e bytes) 000004[0] 1717013112.234632 read 0x36e675 thru 0x37327d (0x4c09 bytes) 000005[0] 1717013112.245648 mapread 0x60d235 thru 0x613ab1 (0x687d bytes) 000006[1] 1717013112.275690 mapwrite 0x668950 thru 0x675b7c (0xd22d bytes) 000007[1] 1717013112.374648 write 0x50f0b4 thru 0x513a30 (0x497d bytes) 000012[1] 1717013112.433526 mapread 0x7152c4 thru 0x721e12 (0xcb4f bytes) truncating to largest ever: 0x506741 000013[1] 1717013112.472544 trunc from 0x888da2 to 0x506740 (0x382661 bytes) 000015[1] 1717013112.525475 read 0x13ba05 thru 0x1447c7 (0x8dc3 bytes) truncating to largest ever: 0x9a40f9 000018[1] 1717013112.548905 trunc from 0x506741 to 0x9a40f8 (0x49d9b8 bytes) 000021[0] 1717013112.581569 write 0x9957a2 thru 0x9a0707 (0xaf66 bytes) 000022[0] 1717013112.602095 write 0x19e373 thru 0x1a54ce (0x715c bytes) 000023[0] 1717013112.621423 mapread 0x3fba4b thru 0x3fd5c8 (0x1b7e bytes) 000026[1] 1717013112.667750 write 0x1be30e thru 0x1c1303 (0x2ff6 bytes) 000027[0] 1717013112.691605 read 0x384a13 thru 0x390ae8 (0xc0d6 bytes) 000028[0] 1717013112.747636 mapread 0x921109 thru 0x930a70 (0xf968 bytes) 000033[1] 1717013112.801388 write 0x795feb thru 0x799729 (0x373f bytes) 000037[1] 1717013112.830483 trunc from 0x9a40f9 to 0x26665b (0x73da9d bytes) 000038[0] 1717013112.852599 mapwrite 0x25826d thru 0x26759e (0xf332 bytes) 000039[1] 1717013112.996432 mapread 0x021a27 thru 0x028d94 (0x736e bytes) 000043[0] 1717013113.062789 mapwrite 0x53ea7e thru 0x54b50f (0xca92 bytes) 000044[1] 1717013113.150466 write 0x1eb8ed thru 0x1fb052 (0xf766 bytes) 000045[1] 1717013113.174151 mapwrite 0x1f09b8 thru 0x1ff979 (0xefc2 bytes) 000051[0] 1717013113.298014 write 0x98bb7d thru 0x991e6a (0x62ee bytes) 000054[0] 1717013113.318203 mapwrite 0x4c0422 thru 0x4c72e9 (0x6ec8 bytes) 000060[0] 1717013113.397747 write 0x063abf thru 0x0690d9 (0x561b bytes) 000061[0] 1717013113.417319 read 0x4b78bb thru 0x4bd04f (0x5795 bytes) 000062[1] 1717013113.417734 trunc from 0x991e6b to 0x54979a (0x4486d0 bytes) 000063[1] 1717013113.451979 read 0x061d22 thru 0x067d3c (0x601b bytes) 000068[1] 1717013113.516680 mapwrite 0x37029c thru 0x37f7d7 (0xf53c bytes) 000070[1] 1717013113.574831 mapwrite 0x1eeb8e thru 0x1f0737 (0x1baa bytes) 000071[1] 1717013113.606809 mapwrite 0x12794a thru 0x12ba13 (0x40ca bytes) 000072[1] 1717013113.657517 trunc from 0x54979b to 0x5d1260 (0x87ac6 bytes) 000073[1] 1717013113.679981 mapread 0x38b121 thru 0x38f420 (0x4300 bytes) 000080[0] 1717013113.717617 read 0x534a10 thru 0x5424ea (0xdadb bytes) 000083[0] 1717013113.788253 mapread 0x2fbd70 thru 0x301ecb (0x615c bytes) 000089[1] 1717013113.856890 write 0x400df6 thru 0x4077ee (0x69f9 bytes) 000091[0] 1717013113.913557 mapread 0x1811f1 thru 0x18ca98 (0xb8a8 bytes) 000092[0] 1717013113.922043 write 0x4de27d thru 0x4e4bd1 (0x6955 bytes) 000093[1] 1717013113.970680 trunc from 0x5d1261 to 0x70443e (0x1331de bytes) 000095[0] 1717013114.049646 write 0x888c2b thru 0x88e535 (0x590b bytes) 000096[1] 1717013114.071810 mapwrite 0x47dd64 thru 0x482045 (0x42e2 bytes) 000097[0] 1717013114.205839 mapwrite 0x0868ea thru 0x094125 (0xd83c bytes) 000098[0] 1717013114.329944 mapwrite 0x3153ae thru 0x31a98e (0x55e1 bytes) 000100[1] 1717013114.420789 read 0x04a8ee thru 0x05445c (0x9b6f bytes) 000101[0] 1717013114.481005 mapwrite 0x436cbe thru 0x43868a (0x19cd bytes) 000102[0] 1717013114.592486 trunc from 0x88e536 to 0x436e21 (0x457714 bytes) 000107[0] 1717013114.653922 write 0x341caf thru 0x3441db (0x252d bytes) 000108[1] 1717013114.666506 mapwrite 0x6f0120 thru 0x6fb987 (0xb868 bytes) 000109[1] 1717013114.776316 read 0x6fa96d thru 0x6fb987 (0x101b bytes) 000110[1] 1717013114.778471 read 0x43cd9b thru 0x44b240 (0xe4a6 bytes) 000111[0] 1717013114.842319 mapwrite 0x0eafca thru 0x0f493f (0x9976 bytes) 000113[0] 1717013114.978537 write 0x6737b7 thru 0x673e4e (0x698 bytes) 000114[1] 1717013115.019311 trunc from 0x6fb988 to 0x31da6c (0x3ddf1b bytes) 000115[1] 1717013115.049664 mapread 0x2a1653 thru 0x2a76e2 (0x6090 bytes) 000117[0] 1717013115.084105 trunc from 0x31da6d to 0x8c41ee (0x5a6782 bytes) 000118[1] 1717013115.125145 trunc from 0x8c41ef to 0x387459 (0x53cd95 bytes) 000119[1] 1717013115.143162 read 0x20f54b thru 0x218cb6 (0x976c bytes) 000120[1] 1717013115.177315 mapwrite 0x38a426 thru 0x3939df (0x95ba bytes) 000121[0] 1717013115.242439 trunc from 0x3939e0 to 0x5b0c04 (0x21d225 bytes) 000122[0] 1717013115.276361 read 0x038fd5 thru 0x0436fc (0xa728 bytes) 000123[1] 1717013115.313591 read 0x4bc3fc thru 0x4bd2a6 (0xeab bytes) 000124[0] 1717013115.351287 trunc from 0x5b0c05 to 0x44d51d (0x1636e7 bytes) 000125[1] 1717013115.368673 write 0x5c27f8 thru 0x5c5a5d (0x3266 bytes) 000130[0] 1717013115.435086 mapwrite 0x429f20 thru 0x42ce34 (0x2f15 bytes) 000131[0] 1717013115.514012 write 0x7db896 thru 0x7e9bb1 (0xe31c bytes) 000132[1] 1717013115.525378 mapread 0x198039 thru 0x19be47 (0x3e0f bytes) 000140[0] 1717013115.589676 write 0x87a079 thru 0x87de68 (0x3df0 bytes) 000141[0] 1717013115.599287 read 0x18907c thru 0x18c465 (0x33ea bytes) 000142[1] 1717013115.628697 trunc from 0x87de69 to 0x623562 (0x25a906 bytes) 000145[0] 1717013115.697939 trunc from 0x623563 to 0x5be828 (0x64d3a bytes) 000148[0] 1717013115.732820 write 0x550ece thru 0x554524 (0x3657 bytes) 000150[0] 1717013115.742435 trunc from 0x5be829 to 0x4dd76c (0xe10bc bytes) 000151[1] 1717013115.755003 write 0x5e38e2 thru 0x5e831b (0x4a3a bytes) 000154[0] 1717013115.787498 write 0x813ed7 thru 0x81efad (0xb0d7 bytes) 000157[0] 1717013115.814996 trunc from 0x81efae to 0x85b336 (0x3c389 bytes) 000160[0] 1717013115.850573 mapwrite 0x97b807 thru 0x98b353 (0xfb4d bytes) 000162[1] 1717013115.942502 trunc from 0x98b354 to 0x8bcdd5 (0xce57e bytes) 000163[0] 1717013115.960375 write 0x8748b1 thru 0x883079 (0xe7c9 bytes) 000164[1] 1717013115.983848 write 0x276733 thru 0x28279d (0xc06b bytes) 000165[0] 1717013116.026465 trunc from 0x8bcdd6 to 0x522af5 (0x39a2e0 bytes) 000168[0] 1717013116.076318 mapwrite 0x5b0a7b thru 0x5bf496 (0xea1c bytes) 000169[0] 1717013116.187277 mapwrite 0x3ba7fc thru 0x3c8b5a (0xe35f bytes) 000170[1] 1717013116.265893 read 0x166976 thru 0x16dbf7 (0x7282 bytes) 000172[1] 1717013116.311477 write 0x20b751 thru 0x213508 (0x7db8 bytes) 000174[1] 1717013116.350488 mapwrite 0x2e64ea thru 0x2f161d (0xb134 bytes) 000175[1] 1717013116.431158 trunc from 0x5bf497 to 0x5f95db (0x3a145 bytes) 000179[0] 1717013116.479991 write 0x617fbc thru 0x6184b4 (0x4f9 bytes) 000180[0] 1717013116.502049 mapread 0x5840c8 thru 0x58fd77 (0xbcb0 bytes) 000181[0] 1717013116.554947 read 0x287259 thru 0x292cbd (0xba65 bytes) 000182[1] 1717013116.583486 trunc from 0x6184b5 to 0x31a267 (0x2fe24d bytes) 000185[1] 1717013116.631241 write 0x27cd2a thru 0x282a03 (0x5cda bytes) 000186[0] 1717013116.647783 mapread 0x1cf2f7 thru 0x1d3a7e (0x4788 bytes) 000187[1] 1717013116.679962 mapwrite 0x5a1692 thru 0x5a4725 (0x3094 bytes) 000189[1] 1717013116.779317 write 0x133ea6 thru 0x13b93d (0x7a98 bytes) 000190[1] 1717013116.786586 trunc from 0x5a4726 to 0x0bbfa5 (0x4e8780 bytes) 000191[0] 1717013116.806164 trunc from 0x0bbfa6 to 0x72f749 (0x6737a4 bytes) 000192[1] 1717013116.835666 trunc from 0x72f74a to 0x8a54d1 (0x175d88 bytes) 000194[0] 1717013116.863648 mapwrite 0x6ac83f thru 0x6b3714 (0x6ed6 bytes) 000195[1] 1717013116.962218 read 0x0975ec thru 0x09b4a5 (0x3eba bytes) 000197[1] 1717013117.005804 trunc from 0x8a54d2 to 0x95226c (0xacd9b bytes) 000199[1] 1717013117.019628 read 0x83ad75 thru 0x83c678 (0x1904 bytes) 000201[1] 1717013117.055726 read 0x345c1c thru 0x34ecb4 (0x9099 bytes) 000202[1] 1717013117.056171 trunc from 0x95226d to 0x9364f2 (0x1bd7a bytes) 000205[0] 1717013117.078437 mapread 0x89c166 thru 0x89e474 (0x230f bytes) 000206[0] 1717013117.112750 trunc from 0x9364f3 to 0x87dce1 (0xb8811 bytes) 000207[1] 1717013117.148476 trunc from 0x87dce2 to 0x0ef98b (0x78e356 bytes) 000208[1] 1717013117.174652 trunc from 0x0ef98c to 0x28f2f5 (0x19f96a bytes) 000209[0] 1717013117.183846 trunc from 0x28f2f6 to 0x702006 (0x472d11 bytes) 000213[0] 1717013117.224567 write 0x6d7e87 thru 0x6e2ee3 (0xb05d bytes) 000214[0] 1717013117.232986 mapread 0x491b22 thru 0x49e383 (0xc862 bytes) 000215[1] 1717013117.274669 mapwrite 0x66d1c2 thru 0x6728c3 (0x5702 bytes) 000216[1] 1717013117.344627 mapwrite 0x746412 thru 0x750331 (0x9f20 bytes) 000217[0] 1717013117.429428 trunc from 0x750332 to 0x7748a3 (0x24572 bytes) 000223[0] 1717013117.487368 mapread 0x494a32 thru 0x496551 (0x1b20 bytes) 000224[0] 1717013117.501686 trunc from 0x7748a4 to 0x47b1f2 (0x2f96b1 bytes) 000226[1] 1717013117.513200 mapwrite 0x5262ab thru 0x53297e (0xc6d4 bytes) 000228[1] 1717013117.601834 write 0x4585c4 thru 0x463080 (0xaabd bytes) 000230[1] 1717013117.618363 trunc from 0x53297f to 0x6baafa (0x18817c bytes) 000234[1] 1717013117.648787 read 0x13c3c8 thru 0x14b225 (0xee5e bytes) 000235[1] 1717013117.680149 write 0x9d43ef thru 0x9d571b (0x132d bytes) 000237[0] 1717013117.686314 read 0x0249ae thru 0x02bb32 (0x7185 bytes) 000238[1] 1717013117.734594 write 0x5e4f18 thru 0x5f4a62 (0xfb4b bytes) 000239[1] 1717013117.743146 mapread 0x99a94c thru 0x9a8dcb (0xe480 bytes) 000240[0] 1717013117.789862 mapread 0x1117b9 thru 0x11231b (0xb63 bytes) 000241[0] 1717013117.802797 mapread 0x1e8b37 thru 0x1e96f9 (0xbc3 bytes) 000243[1] 1717013117.811103 mapread 0x8f9894 thru 0x903e05 (0xa572 bytes) 000244[0] 1717013117.840252 trunc from 0x9d571c to 0x1adbda (0x827b41 bytes) 000246[0] 1717013117.890853 mapwrite 0x621886 thru 0x624ddc (0x3557 bytes) 000247[1] 1717013117.962487 mapread 0x10ab92 thru 0x10c4c3 (0x1932 bytes) 000248[0] 1717013117.988287 mapread 0x3caaf1 thru 0x3cac44 (0x154 bytes) 000249[1] 1717013117.991556 mapwrite 0x38807a thru 0x395312 (0xd299 bytes) 000254[0] 1717013118.137370 mapwrite 0x1eaf7d thru 0x1f29f6 (0x7a7a bytes) 000256[0] 1717013118.237422 write 0x478b19 thru 0x47c8cd (0x3db5 bytes) 000257[0] 1717013118.255427 read 0x181e99 thru 0x18ce8e (0xaff6 bytes) 000260[0] 1717013118.316366 mapread 0x065f8c thru 0x0724d0 (0xc545 bytes) 000261[0] 1717013118.316905 trunc from 0x624ddd to 0x6d86a0 (0xb38c4 bytes) 000262[1] 1717013118.334108 trunc from 0x6d86a1 to 0x4a9fa9 (0x22e6f7 bytes) 000267[0] 1717013118.402589 write 0x003e30 thru 0x00deb8 (0xa089 bytes) 000268[0] 1717013118.434204 write 0x8b90d1 thru 0x8c2a14 (0x9944 bytes) 000273[0] 1717013118.479532 mapread 0x55a8be thru 0x563b7a (0x92bd bytes) 000276[1] 1717013118.545435 trunc from 0x8c2a15 to 0x35ddca (0x564c4a bytes) 000277[1] 1717013118.575377 mapread 0x0baa35 thru 0x0bfda5 (0x5371 bytes) 000279[0] 1717013118.605409 write 0x35ec4a thru 0x369f9b (0xb352 bytes) 000281[0] 1717013118.625067 mapwrite 0x740e9b thru 0x74bb6a (0xacd0 bytes) 000282[1] 1717013118.718271 trunc from 0x74bb6b to 0x480ceb (0x2cae7f bytes) 000283[1] 1717013118.761378 read 0x064ae5 thru 0x06bebd (0x73d9 bytes) 000285[1] 1717013118.768550 mapwrite 0x70d8ed thru 0x7164c8 (0x8bdc bytes) 000288[1] 1717013118.848933 read 0x4a6311 thru 0x4a8217 (0x1f07 bytes) 000289[0] 1717013118.883202 write 0x511d5f thru 0x515706 (0x39a8 bytes) 000293[1] 1717013118.958013 mapread 0x3892e1 thru 0x38a9ca (0x16ea bytes) 000296[0] 1717013118.989978 mapwrite 0x001209 thru 0x006017 (0x4e0f bytes) 000298[0] 1717013119.070215 read 0x37343e thru 0x380abe (0xd681 bytes) 000299[0] 1717013119.130735 mapread 0x4d2d91 thru 0x4e092f (0xdb9f bytes) 000301[1] 1717013119.152620 read 0x57dd0a thru 0x586ecc (0x91c3 bytes) 000302[0] 1717013119.205321 mapwrite 0x77942c thru 0x784e48 (0xba1d bytes) 000304[0] 1717013119.309418 mapwrite 0x0143f6 thru 0x021b84 (0xd78f bytes) 000305[0] 1717013119.370754 read 0x3fae90 thru 0x402088 (0x71f9 bytes) 000308[0] 1717013119.414759 mapread 0x00cdee thru 0x012825 (0x5a38 bytes) 000312[0] 1717013119.439757 mapwrite 0x96ff05 thru 0x97e0f4 (0xe1f0 bytes) 000314[0] 1717013119.553101 trunc from 0x97e0f5 to 0x619b37 (0x3645bd bytes) 000318[1] 1717013119.619051 read 0x0916fd thru 0x0993f2 (0x7cf6 bytes) 000319[1] 1717013119.681285 read 0x419e4c thru 0x421ceb (0x7ea0 bytes) 000320[1] 1717013119.716759 read 0x4d8726 thru 0x4e070c (0x7fe7 bytes) 000321[0] 1717013119.717437 write 0x55b927 thru 0x55e560 (0x2c3a bytes) 000322[1] 1717013119.737583 mapread 0x2e965b thru 0x2f170c (0x80b2 bytes) 000324[0] 1717013119.760418 mapwrite 0x8d1983 thru 0x8dd1b9 (0xb837 bytes) 000326[1] 1717013119.905519 mapwrite 0x6d765f thru 0x6db45d (0x3dff bytes) 000329[1] 1717013120.008682 trunc from 0x8dd1ba to 0x11ef34 (0x7be285 bytes) 000334[0] 1717013120.061096 read 0x0a96a3 thru 0x0ad34c (0x3caa bytes) 000337[0] 1717013120.109084 mapwrite 0x3cbc58 thru 0x3cc13f (0x4e8 bytes) 000340[0] 1717013120.204204 write 0x358c88 thru 0x35f00a (0x6383 bytes) 000343[1] 1717013120.214893 mapread 0x153ead thru 0x15cef4 (0x9048 bytes) 000344[1] 1717013120.277024 mapread 0x031013 thru 0x03db6b (0xcb59 bytes) 000345[0] 1717013120.286831 mapwrite 0x714513 thru 0x722ec9 (0xe9b7 bytes) 000347[1] 1717013120.421817 read 0x3139c3 thru 0x31a03f (0x667d bytes) 000350[0] 1717013120.482622 mapwrite 0x6a6051 thru 0x6aa921 (0x48d1 bytes) 000351[1] 1717013120.529824 write 0x9c2d04 thru 0x9c30b3 (0x3b0 bytes) 000354[1] 1717013120.584878 trunc from 0x9c30b4 to 0x2be336 (0x704d7d bytes) 000355[0] 1717013120.607406 read 0x1f0700 thru 0x1ff8a1 (0xf1a2 bytes) 000356[0] 1717013120.667166 read 0x1cdc8a thru 0x1d7437 (0x97ae bytes) 000359[1] 1717013120.699617 write 0x187182 thru 0x18a07b (0x2efa bytes) 000360[1] 1717013120.731404 read 0x0d328c thru 0x0d5a06 (0x277b bytes) 000363[0] 1717013120.787747 mapwrite 0x8b5435 thru 0x8c0407 (0xafd3 bytes) 000365[0] 1717013120.967569 write 0x18d3b8 thru 0x190b61 (0x37aa bytes) 000366[1] 1717013120.980244 write 0x9e9355 thru 0x9f0592 (0x723e bytes) 000368[0] 1717013121.021372 read 0x902cbd thru 0x903bdc (0xf20 bytes) truncating to largest ever: 0x9d2d9e 000369[1] 1717013121.096397 trunc from 0x9f0593 to 0x9d2d9d (0x1d7f5 bytes) 000377[0] 1717013121.188086 mapread 0x3f669c thru 0x3ffee4 (0x9849 bytes) 000379[1] 1717013121.253608 mapwrite 0x363ee4 thru 0x36e271 (0xa38e bytes) 000386[0] 1717013121.376175 mapread 0x75397d thru 0x759105 (0x5789 bytes) 000389[1] 1717013121.423269 trunc from 0x9d2d9e to 0x1d5549 (0x7fd854 bytes) 000390[0] 1717013121.461308 trunc from 0x1d554a to 0x206bec (0x316a3 bytes) 000391[1] 1717013121.482451 write 0x6ba2a3 thru 0x6bde42 (0x3ba0 bytes) 000394[1] 1717013121.520613 read 0x0ec1cb thru 0x0f12a2 (0x50d8 bytes) 000395[1] 1717013121.560958 read 0x0b1d7c thru 0x0b7a85 (0x5d0a bytes) 000400[1] 1717013121.571965 read 0x1a63fd thru 0x1b4608 (0xe20c bytes) 000401[1] 1717013121.584813 read 0x5efe11 thru 0x5f8a76 (0x8c66 bytes) 000408[0] 1717013121.676250 mapwrite 0x5e40fb thru 0x5f3ae7 (0xf9ed bytes) 000409[1] 1717013121.788655 mapwrite 0x608280 thru 0x60f4b2 (0x7233 bytes) 000410[1] 1717013121.903181 trunc from 0x6bde43 to 0x32a5dc (0x393866 bytes) 000415[1] 1717013121.963319 mapread 0x329586 thru 0x32a5dc (0x1057 bytes) 000416[1] 1717013121.977873 mapread 0x0a4183 thru 0x0a8d27 (0x4ba5 bytes) 000420[1] 1717013122.025973 read 0x2faf7f thru 0x303ab3 (0x8b35 bytes) 000423[0] 1717013122.036609 read 0x2fba7f thru 0x308cf8 (0xd27a bytes) 000424[0] 1717013122.074481 trunc from 0x32a5dd to 0x0d2601 (0x257fdb bytes) 000425[0] 1717013122.119831 write 0x7166c6 thru 0x716b9c (0x4d7 bytes) 000426[1] 1717013122.127742 mapread 0x37c722 thru 0x38b89e (0xf17d bytes) 000428[1] 1717013122.310247 read 0x35f480 thru 0x368378 (0x8ef9 bytes) 000430[0] 1717013122.382065 write 0x3e4201 thru 0x3f1cb6 (0xdab6 bytes) 000432[1] 1717013122.419570 mapwrite 0x3f4718 thru 0x3faf98 (0x6881 bytes) 000433[1] 1717013122.648657 trunc from 0x716b9d to 0x854a01 (0x13de65 bytes) 000435[1] 1717013122.697095 trunc from 0x854a02 to 0x14d13c (0x7078c5 bytes) 000438[0] 1717013122.744795 trunc from 0x14d13d to 0x388646 (0x23b50a bytes) 000443[0] 1717013122.837406 trunc from 0x388647 to 0x9d2067 (0x649a21 bytes) 000448[0] 1717013122.904083 mapread 0x15f9da thru 0x161e7c (0x24a3 bytes) 000450[0] 1717013122.978555 write 0x894c1a thru 0x8a25ea (0xd9d1 bytes) 000452[0] 1717013122.993419 mapwrite 0x5df199 thru 0x5e5651 (0x64b9 bytes) 000453[0] 1717013123.076176 write 0x3cc45b thru 0x3d0f3c (0x4ae2 bytes) 000455[1] 1717013123.098012 trunc from 0x9d2068 to 0x2fb986 (0x6d66e1 bytes) 000456[0] 1717013123.162296 mapread 0x084ed7 thru 0x092c83 (0xddad bytes) 000458[1] 1717013123.253540 read 0x090de0 thru 0x09f8c7 (0xeae8 bytes) 000459[1] 1717013123.314406 write 0x2dc6f8 thru 0x2e775f (0xb068 bytes) 000461[0] 1717013123.370586 write 0x99529c thru 0x99d0ea (0x7e4f bytes) 000462[0] 1717013123.398341 mapwrite 0x50f892 thru 0x51d50b (0xdc7a bytes) 000463[0] 1717013123.540279 mapwrite 0x536f66 thru 0x53be8a (0x4f25 bytes) 000464[1] 1717013123.642442 write 0x55d048 thru 0x562f25 (0x5ede bytes) 000465[1] 1717013123.656884 write 0x31d4ea thru 0x3252fa (0x7e11 bytes) 000466[0] 1717013123.697646 mapread 0x59c7cc thru 0x5a3c33 (0x7468 bytes) 000473[1] 1717013123.795631 mapwrite 0x8a1893 thru 0x8b0203 (0xe971 bytes) 000475[1] 1717013123.925176 write 0x3251c0 thru 0x33325c (0xe09d bytes) 000477[0] 1717013123.927012 write 0x2b1f3e thru 0x2b80e4 (0x61a7 bytes) 000479[1] 1717013123.955994 trunc from 0x99d0eb to 0x328269 (0x674e81 bytes) 000480[1] 1717013123.990982 mapread 0x0d260a thru 0x0dc7a5 (0xa19c bytes) 000482[1] 1717013124.026999 mapwrite 0x13e162 thru 0x14cbd2 (0xea71 bytes) 000483[1] 1717013124.139108 read 0x0428fa thru 0x04739f (0x4aa6 bytes) 000485[0] 1717013124.176093 read 0x0ab0e8 thru 0x0b49c7 (0x98e0 bytes) 000487[1] 1717013124.220834 write 0x059757 thru 0x05ff75 (0x681f bytes) 000489[0] 1717013124.239581 write 0x5be142 thru 0x5c841e (0xa2dd bytes) 000491[0] 1717013124.278505 read 0x115dff thru 0x121917 (0xbb19 bytes) 000492[0] 1717013124.337848 write 0x0e98af thru 0x0eed3d (0x548f bytes) 000493[0] 1717013124.378738 read 0x4a56f4 thru 0x4a8caf (0x35bc bytes) 000495[1] 1717013124.422310 trunc from 0x5c841f to 0x51962d (0xaedf1 bytes) 000496[1] 1717013124.479731 write 0x772991 thru 0x781255 (0xe8c5 bytes) 000497[1] 1717013124.500991 write 0x8394f2 thru 0x846c01 (0xd710 bytes) 000499[0] 1717013124.516595 read 0x11cd94 thru 0x1275a0 (0xa80d bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 3124 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002[1] 1717013125.034224 write_OD 0x527000 thru 0x531fff (0xb000 bytes) 000004[0] 1717013125.085522 mapwrite 0x719000 thru 0x72261f (0x9620 bytes) 000012[0] 1717013125.210743 read_OD 0x6c5000 thru 0x6cafff (0x6000 bytes) 000016[0] 1717013125.223915 mapread 0x372000 thru 0x3784d6 (0x64d7 bytes) 000018[0] 1717013125.236165 mapwrite 0x3f7000 thru 0x3ff931 (0x8932 bytes) 000019[0] 1717013125.325209 mapwrite 0x0f0000 thru 0x0fe340 (0xe341 bytes) 000020[0] 1717013125.407380 mapread 0x2ae000 thru 0x2bbd40 (0xdd41 bytes) 000021[1] 1717013125.450744 write_OD 0x3de000 thru 0x3e1fff (0x4000 bytes) 000022[1] 1717013125.499912 mapwrite 0x6c1000 thru 0x6ca688 (0x9689 bytes) 000023[1] 1717013125.574272 mapread 0x126000 thru 0x132490 (0xc491 bytes) 000024[1] 1717013125.606925 read_OD 0x606000 thru 0x613fff (0xe000 bytes) truncating to largest ever: 0xbaadd 000028[0] 1717013125.623374 trunc from 0x722620 to 0x0baadc (0x667b43 bytes) 000029[0] 1717013125.662320 read_OD 0x075000 thru 0x07afff (0x6000 bytes) 000030[1] 1717013125.671459 mapwrite 0x869000 thru 0x872dcf (0x9dd0 bytes) truncating to largest ever: 0x93b277 000031[1] 1717013125.792260 trunc from 0x872dd0 to 0x93b276 (0xc84a7 bytes) 000032[1] 1717013125.817801 trunc from 0x93b277 to 0x56e098 (0x3cd1de bytes) 000034[0] 1717013125.846742 read_OD 0x2e2000 thru 0x2e9fff (0x8000 bytes) 000036[0] 1717013125.873193 trunc from 0x56e099 to 0x410288 (0x15de10 bytes) 000038[0] 1717013125.900862 trunc from 0x410289 to 0x61a0a7 (0x209e1f bytes) 000039[1] 1717013125.917280 mapwrite 0x6a1000 thru 0x6a5895 (0x4896 bytes) 000043[1] 1717013126.042648 mapread 0x259000 thru 0x267bf7 (0xebf8 bytes) 000047[1] 1717013126.087268 mapwrite 0x020000 thru 0x02c7e4 (0xc7e5 bytes) 000048[0] 1717013126.173762 trunc from 0x6a5896 to 0x613af6 (0x91d9f bytes) 000051[0] 1717013126.207295 write_OD 0x4fc000 thru 0x509fff (0xe000 bytes) 000052[0] 1717013126.261102 read_OD 0x3a6000 thru 0x3adfff (0x8000 bytes) 000054[0] 1717013126.269083 trunc from 0x613af7 to 0x76fee5 (0x15c3ef bytes) 000055[1] 1717013126.290797 mapread 0x207000 thru 0x211669 (0xa66a bytes) 000058[0] 1717013126.331990 write_OD 0x934000 thru 0x936fff (0x3000 bytes) 000062[0] 1717013126.400975 mapread 0x848000 thru 0x84c9a7 (0x49a8 bytes) 000066[1] 1717013126.466870 trunc from 0x937000 to 0x30aa05 (0x62c5fa bytes) 000067[0] 1717013126.492648 mapread 0x0da000 thru 0x0e97a3 (0xf7a4 bytes) 000068[0] 1717013126.561066 mapwrite 0x76e000 thru 0x77b41a (0xd41b bytes) 000070[1] 1717013126.720643 write_OD 0x199000 thru 0x199fff (0x1000 bytes) 000072[0] 1717013126.777664 mapread 0x69a000 thru 0x6a86d5 (0xe6d6 bytes) 000073[0] 1717013126.835098 write_OD 0x084000 thru 0x08dfff (0xa000 bytes) 000075[0] 1717013126.883456 read_OD 0x312000 thru 0x319fff (0x8000 bytes) 000076[0] 1717013126.888800 trunc from 0x77b41b to 0x09634b (0x6e50cf bytes) 000079[1] 1717013126.928329 mapread 0x062000 thru 0x06ee47 (0xce48 bytes) 000082[0] 1717013126.972501 mapwrite 0x1f0000 thru 0x1fad4d (0xad4e bytes) 000083[0] 1717013127.060312 mapread 0x0ca000 thru 0x0ca2d2 (0x2d3 bytes) 000084[0] 1717013127.061421 read_OD 0x05d000 thru 0x065fff (0x9000 bytes) 000085[0] 1717013127.082050 trunc from 0x1fad4e to 0x438e54 (0x23e107 bytes) 000086[0] 1717013127.105024 write_OD 0x677000 thru 0x67bfff (0x5000 bytes) 000087[1] 1717013127.156647 write_OD 0x6e7000 thru 0x6f1fff (0xb000 bytes) 000088[1] 1717013127.216230 trunc from 0x6f2000 to 0x81c042 (0x12a043 bytes) 000089[1] 1717013127.254638 trunc from 0x81c043 to 0x90f9e2 (0xf39a0 bytes) 000090[1] 1717013127.282185 trunc from 0x90f9e3 to 0x5b05fa (0x35f3e8 bytes) 000092[1] 1717013127.312309 mapread 0x009000 thru 0x00e04d (0x504e bytes) 000093[0] 1717013127.342916 trunc from 0x5b05fb to 0x3cde93 (0x1e2767 bytes) 000095[0] 1717013127.383502 trunc from 0x3cde94 to 0x2d5719 (0xf877a bytes) 000097[1] 1717013127.399466 mapread 0x25e000 thru 0x2608c6 (0x28c7 bytes) 000098[1] 1717013127.433036 mapread 0x2c1000 thru 0x2cb3ff (0xa400 bytes) truncating to largest ever: 0x9b5179 000101[1] 1717013127.446037 trunc from 0x2d571a to 0x9b5178 (0x6dfa5f bytes) 000102[1] 1717013127.487036 write_OD 0x8ad000 thru 0x8b1fff (0x5000 bytes) 000103[1] 1717013127.545215 trunc from 0x9b5179 to 0x459e48 (0x55b330 bytes) 000104[1] 1717013127.589377 mapread 0x041000 thru 0x046337 (0x5338 bytes) 000105[1] 1717013127.612287 mapwrite 0x3d7000 thru 0x3e54cd (0xe4ce bytes) 000108[1] 1717013127.690603 write_OD 0x9b9000 thru 0x9bafff (0x2000 bytes) 000109[1] 1717013127.743587 trunc from 0x9bb000 to 0x0ae2e2 (0x90cd1d bytes) 000110[0] 1717013127.768442 mapwrite 0x6fe000 thru 0x700163 (0x2164 bytes) 000113[0] 1717013127.914493 mapwrite 0x71f000 thru 0x72dd55 (0xed56 bytes) 000118[0] 1717013128.046646 read_OD 0x5e8000 thru 0x5f6fff (0xf000 bytes) 000119[1] 1717013128.074498 trunc from 0x72dd56 to 0x81fc2a (0xf1ed5 bytes) 000120[0] 1717013128.115605 read_OD 0x7a8000 thru 0x7aefff (0x7000 bytes) 000121[0] 1717013128.142542 read_OD 0x31a000 thru 0x322fff (0x9000 bytes) 000122[1] 1717013128.151005 read_OD 0x4eb000 thru 0x4ecfff (0x2000 bytes) 000123[1] 1717013128.155204 mapwrite 0x999000 thru 0x99d3d3 (0x43d4 bytes) 000124[1] 1717013128.319291 read_OD 0x4c2000 thru 0x4c7fff (0x6000 bytes) 000125[1] 1717013128.343385 trunc from 0x99d3d4 to 0x75f23d (0x23e196 bytes) 000126[1] 1717013128.376504 mapwrite 0x5e9000 thru 0x5f1486 (0x8487 bytes) truncating to largest ever: 0x9fc416 000130[0] 1717013128.551920 trunc from 0x75f23e to 0x9fc415 (0x29d1d8 bytes) 000135[0] 1717013128.650234 mapread 0x6ea000 thru 0x6f4cbd (0xacbe bytes) 000136[1] 1717013128.779775 trunc from 0x9fc416 to 0x2ccc6c (0x72f7a9 bytes) 000139[1] 1717013128.878694 write_OD 0x288000 thru 0x28afff (0x3000 bytes) 000143[1] 1717013128.968480 trunc from 0x2ccc6d to 0x48af69 (0x1be2fd bytes) 000145[0] 1717013129.002858 trunc from 0x48af6a to 0x288b05 (0x202464 bytes) 000146[1] 1717013129.020381 trunc from 0x288b06 to 0x158ac4 (0x130041 bytes) 000148[0] 1717013129.052844 trunc from 0x158ac5 to 0x918677 (0x7bfbb3 bytes) 000150[0] 1717013129.094076 mapwrite 0x93f000 thru 0x94b351 (0xc352 bytes) 000153[1] 1717013129.268102 write_OD 0x659000 thru 0x65efff (0x6000 bytes) 000155[0] 1717013129.325538 read_OD 0x18f000 thru 0x197fff (0x9000 bytes) 000156[1] 1717013129.333586 read_OD 0x4f7000 thru 0x501fff (0xb000 bytes) 000157[1] 1717013129.340483 mapread 0x008000 thru 0x011899 (0x989a bytes) 000163[0] 1717013129.381490 read_OD 0x166000 thru 0x16cfff (0x7000 bytes) 000172[0] 1717013129.422029 mapread 0x71f000 thru 0x71ff4a (0xf4b bytes) 000175[0] 1717013129.462461 trunc from 0x94b352 to 0x3c2654 (0x588cfd bytes) 000176[0] 1717013129.525514 write_OD 0x616000 thru 0x623fff (0xe000 bytes) 000178[0] 1717013129.587707 write_OD 0x7d2000 thru 0x7d5fff (0x4000 bytes) 000180[1] 1717013129.656639 write_OD 0x472000 thru 0x479fff (0x8000 bytes) 000182[1] 1717013129.697860 trunc from 0x7d6000 to 0x1e7e87 (0x5ee178 bytes) 000186[0] 1717013129.752584 write_OD 0x52f000 thru 0x53afff (0xc000 bytes) 000187[1] 1717013129.842333 trunc from 0x53b000 to 0x31699f (0x224660 bytes) 000188[0] 1717013129.871768 mapwrite 0x448000 thru 0x451160 (0x9161 bytes) 000190[0] 1717013130.010459 read_OD 0x1c4000 thru 0x1c9fff (0x6000 bytes) 000191[0] 1717013130.026525 mapread 0x2c1000 thru 0x2d0bf5 (0xfbf6 bytes) 000195[1] 1717013130.070952 write_OD 0x026000 thru 0x034fff (0xf000 bytes) 000196[1] 1717013130.132872 write_OD 0x278000 thru 0x286fff (0xf000 bytes) 000199[0] 1717013130.171835 write_OD 0x502000 thru 0x505fff (0x4000 bytes) 000201[1] 1717013130.209004 mapread 0x0d6000 thru 0x0e5bcc (0xfbcd bytes) 000203[1] 1717013130.268517 mapread 0x2ec000 thru 0x2f9940 (0xd941 bytes) 000205[0] 1717013130.314847 write_OD 0x38f000 thru 0x390fff (0x2000 bytes) 000206[0] 1717013130.360626 mapwrite 0x69d000 thru 0x6a60fb (0x90fc bytes) 000207[1] 1717013130.478026 write_OD 0x8f4000 thru 0x900fff (0xd000 bytes) 000208[0] 1717013130.532386 read_OD 0x3ca000 thru 0x3d3fff (0xa000 bytes) 000209[0] 1717013130.541263 mapread 0x82a000 thru 0x8358ef (0xb8f0 bytes) 000210[0] 1717013130.593422 trunc from 0x901000 to 0x0a82b3 (0x858d4c bytes) 000211[1] 1717013130.636419 mapwrite 0x876000 thru 0x88301a (0xd01b bytes) 000214[0] 1717013130.774996 mapread 0x3f3000 thru 0x3f8f64 (0x5f65 bytes) 000221[0] 1717013130.810299 read_OD 0x46f000 thru 0x478fff (0xa000 bytes) 000222[0] 1717013130.815330 mapread 0x23d000 thru 0x2450a9 (0x80aa bytes) 000224[1] 1717013130.855786 write_OD 0x41d000 thru 0x429fff (0xd000 bytes) 000229[1] 1717013130.912983 mapread 0x571000 thru 0x571333 (0x334 bytes) 000230[0] 1717013130.916035 trunc from 0x88301b to 0x9f8ddd (0x175dc3 bytes) 000231[1] 1717013130.946944 trunc from 0x9f8dde to 0x86aa6c (0x18e371 bytes) 000233[0] 1717013130.980540 read_OD 0x061000 thru 0x061fff (0x1000 bytes) 000234[1] 1717013130.997639 trunc from 0x86aa6d to 0x5f2e42 (0x277c2a bytes) 000238[1] 1717013131.035675 mapwrite 0x83d000 thru 0x846b50 (0x9b51 bytes) 000239[1] 1717013131.122064 write_OD 0x9fb000 thru 0x9fdfff (0x3000 bytes) 000243[1] 1717013131.162387 read_OD 0x7c7000 thru 0x7cbfff (0x5000 bytes) 000245[1] 1717013131.167930 mapread 0x682000 thru 0x69013d (0xe13e bytes) 000246[0] 1717013131.215445 mapwrite 0x167000 thru 0x170ea7 (0x9ea8 bytes) 000252[0] 1717013131.370993 trunc from 0x9fe000 to 0x69b15f (0x362ea0 bytes) 000253[0] 1717013131.384107 mapwrite 0x5de000 thru 0x5e3130 (0x5131 bytes) 000256[0] 1717013131.438980 trunc from 0x69b160 to 0x703f7d (0x68e1e bytes) 000259[0] 1717013131.456402 write_OD 0x56f000 thru 0x570fff (0x2000 bytes) 000260[1] 1717013131.502470 mapwrite 0x70e000 thru 0x7141ab (0x61ac bytes) 000265[1] 1717013131.604567 read_OD 0x1bc000 thru 0x1c8fff (0xd000 bytes) 000268[1] 1717013131.618402 read_OD 0x12d000 thru 0x13afff (0xe000 bytes) 000269[0] 1717013131.625605 mapwrite 0x615000 thru 0x61c674 (0x7675 bytes) 000270[1] 1717013131.703754 trunc from 0x7141ac to 0x000c54 (0x713557 bytes) 000271[1] 1717013131.727564 write_OD 0x8dc000 thru 0x8e1fff (0x6000 bytes) 000272[1] 1717013131.798029 mapread 0x776000 thru 0x78591b (0xf91c bytes) 000273[0] 1717013131.856618 mapwrite 0x717000 thru 0x7236f4 (0xc6f5 bytes) 000274[0] 1717013131.988594 mapwrite 0x5b8000 thru 0x5bace9 (0x2cea bytes) 000275[0] 1717013132.047819 write_OD 0x2d7000 thru 0x2dcfff (0x6000 bytes) 000278[0] 1717013132.085487 read_OD 0x599000 thru 0x59ffff (0x7000 bytes) 000279[0] 1717013132.090260 mapread 0x63a000 thru 0x6471a9 (0xd1aa bytes) 000280[0] 1717013132.136193 mapwrite 0x16b000 thru 0x16efbf (0x3fc0 bytes) 000281[0] 1717013132.218413 trunc from 0x8e2000 to 0x5ebc62 (0x2f639d bytes) 000287[1] 1717013132.254514 read_OD 0x45a000 thru 0x466fff (0xd000 bytes) 000288[0] 1717013132.267429 read_OD 0x04d000 thru 0x04ffff (0x3000 bytes) 000292[1] 1717013132.274230 write_OD 0x622000 thru 0x62efff (0xd000 bytes) 000294[0] 1717013132.329855 mapread 0x1fd000 thru 0x20128e (0x428f bytes) 000299[0] 1717013132.374247 mapwrite 0x8ba000 thru 0x8c5ef4 (0xbef5 bytes) 000300[1] 1717013132.470558 read_OD 0x6af000 thru 0x6b7fff (0x9000 bytes) 000302[1] 1717013132.499613 read_OD 0x664000 thru 0x66cfff (0x9000 bytes) 000305[0] 1717013132.507391 read_OD 0x6ec000 thru 0x6f9fff (0xe000 bytes) 000307[0] 1717013132.514056 mapwrite 0x11f000 thru 0x124a1f (0x5a20 bytes) 000308[1] 1717013132.618790 trunc from 0x8c5ef5 to 0x1672b4 (0x75ec40 bytes) 000309[0] 1717013132.647100 read_OD 0x0b3000 thru 0x0b4fff (0x2000 bytes) 000311[1] 1717013132.665863 mapread 0x164000 thru 0x16720b (0x320c bytes) 000314[1] 1717013132.680726 write_OD 0x5f1000 thru 0x5f6fff (0x6000 bytes) 000318[1] 1717013132.727410 write_OD 0x102000 thru 0x102fff (0x1000 bytes) 000319[1] 1717013132.761143 mapwrite 0x527000 thru 0x52996d (0x296e bytes) 000322[1] 1717013132.864136 mapread 0x49c000 thru 0x4a675b (0xa75c bytes) 000323[1] 1717013132.873306 trunc from 0x5f7000 to 0x62883a (0x3183b bytes) 000328[0] 1717013132.907245 write_OD 0x593000 thru 0x5a0fff (0xe000 bytes) 000329[1] 1717013132.957480 mapread 0x3eb000 thru 0x3ec075 (0x1076 bytes) 000335[0] 1717013132.971462 read_OD 0x3b3000 thru 0x3bafff (0x8000 bytes) 000336[1] 1717013132.977996 mapread 0x2e5000 thru 0x2eaff6 (0x5ff7 bytes) 000338[0] 1717013132.997650 write_OD 0x536000 thru 0x538fff (0x3000 bytes) 000339[1] 1717013133.058435 mapwrite 0x696000 thru 0x6978ba (0x18bb bytes) 000342[1] 1717013133.160092 mapwrite 0x899000 thru 0x89eb66 (0x5b67 bytes) 000343[0] 1717013133.240277 mapwrite 0x6b4000 thru 0x6b861e (0x461f bytes) 000345[0] 1717013133.367802 mapread 0x7f6000 thru 0x801345 (0xb346 bytes) 000346[0] 1717013133.369484 mapread 0x4e8000 thru 0x4f64c3 (0xe4c4 bytes) 000347[1] 1717013133.383468 mapread 0x2d6000 thru 0x2e39c5 (0xd9c6 bytes) 000349[0] 1717013133.466224 trunc from 0x89eb67 to 0x554bef (0x349f77 bytes) 000354[0] 1717013133.498089 mapread 0x0bd000 thru 0x0c678e (0x978f bytes) 000357[0] 1717013133.536909 mapwrite 0x673000 thru 0x67fa49 (0xca4a bytes) 000358[1] 1717013133.660386 read_OD 0x52f000 thru 0x53dfff (0xf000 bytes) 000359[0] 1717013133.680723 trunc from 0x67fa4a to 0x50ae66 (0x174be3 bytes) 000361[0] 1717013133.696339 mapread 0x3dd000 thru 0x3ea131 (0xd132 bytes) 000362[0] 1717013133.760846 write_OD 0x348000 thru 0x349fff (0x2000 bytes) 000367[1] 1717013133.821200 trunc from 0x50ae67 to 0x13a643 (0x3d0823 bytes) 000372[1] 1717013133.856982 trunc from 0x13a644 to 0x51deb1 (0x3e386e bytes) 000373[0] 1717013133.871743 read_OD 0x45e000 thru 0x468fff (0xb000 bytes) 000378[0] 1717013133.898500 read_OD 0x25d000 thru 0x267fff (0xb000 bytes) 000379[1] 1717013133.904617 mapwrite 0x770000 thru 0x778c7a (0x8c7b bytes) 000381[1] 1717013134.026219 read_OD 0x312000 thru 0x31efff (0xd000 bytes) 000382[1] 1717013134.047258 read_OD 0x3fa000 thru 0x401fff (0x8000 bytes) 000386[0] 1717013134.056975 mapwrite 0x6c7000 thru 0x6ce2f1 (0x72f2 bytes) 000391[0] 1717013134.220504 mapwrite 0x970000 thru 0x97630e (0x630f bytes) 000394[0] 1717013134.333217 mapread 0x7f5000 thru 0x7f7fc3 (0x2fc4 bytes) 000396[1] 1717013134.356011 mapread 0x51d000 thru 0x524e6d (0x7e6e bytes) 000397[0] 1717013134.430872 write_OD 0x3b0000 thru 0x3b8fff (0x9000 bytes) 000398[1] 1717013134.481046 write_OD 0x799000 thru 0x7a6fff (0xe000 bytes) 000399[0] 1717013134.530445 read_OD 0x285000 thru 0x28bfff (0x7000 bytes) 000403[0] 1717013134.540214 trunc from 0x97630f to 0x13c155 (0x83a1b9 bytes) 000410[1] 1717013134.621103 write_OD 0x8c9000 thru 0x8d3fff (0xb000 bytes) 000412[0] 1717013134.664516 mapwrite 0x2de000 thru 0x2e256d (0x456e bytes) 000413[0] 1717013134.774174 read_OD 0x3fa000 thru 0x3fafff (0x1000 bytes) 000414[0] 1717013134.793619 mapread 0x5dd000 thru 0x5e9491 (0xc492 bytes) 000417[0] 1717013134.846960 trunc from 0x8d4000 to 0x333d99 (0x5a0266 bytes) 000418[0] 1717013134.888945 write_OD 0x4b3000 thru 0x4b5fff (0x3000 bytes) 000420[1] 1717013134.940801 write_OD 0x678000 thru 0x67bfff (0x4000 bytes) 000421[0] 1717013134.981873 trunc from 0x67c000 to 0x6e33ce (0x673cf bytes) 000422[0] 1717013134.997512 mapwrite 0x982000 thru 0x98974b (0x774c bytes) 000423[0] 1717013135.086282 write_OD 0x43a000 thru 0x43efff (0x5000 bytes) 000427[1] 1717013135.138845 mapread 0x204000 thru 0x206105 (0x2106 bytes) 000428[0] 1717013135.155421 mapwrite 0x96a000 thru 0x96b451 (0x1452 bytes) 000430[1] 1717013135.208799 trunc from 0x98974c to 0x200f28 (0x788823 bytes) 000431[1] 1717013135.223334 write_OD 0x56d000 thru 0x56dfff (0x1000 bytes) 000434[0] 1717013135.270700 write_OD 0x8ee000 thru 0x8eefff (0x1000 bytes) 000438[1] 1717013135.317074 mapwrite 0x122000 thru 0x124b39 (0x2b3a bytes) 000440[1] 1717013135.384290 write_OD 0x39e000 thru 0x3a8fff (0xb000 bytes) 000441[0] 1717013135.424068 mapread 0x2d5000 thru 0x2d78cb (0x28cc bytes) 000442[1] 1717013135.434377 trunc from 0x8ef000 to 0x4ee785 (0x40087a bytes) 000443[0] 1717013135.460775 mapread 0x08b000 thru 0x09a896 (0xf897 bytes) 000448[0] 1717013135.521022 mapread 0x015000 thru 0x015294 (0x295 bytes) 000449[1] 1717013135.528352 mapread 0x184000 thru 0x190fe9 (0xcfea bytes) 000450[0] 1717013135.564219 mapread 0x379000 thru 0x386545 (0xd546 bytes) 000451[1] 1717013135.603837 trunc from 0x4ee786 to 0x4f60de (0x7959 bytes) 000453[0] 1717013135.635469 mapread 0x08d000 thru 0x0921f8 (0x51f9 bytes) 000457[1] 1717013135.682234 mapwrite 0x66f000 thru 0x67a37c (0xb37d bytes) 000458[1] 1717013135.806591 read_OD 0x17c000 thru 0x184fff (0x9000 bytes) 000459[0] 1717013135.814985 trunc from 0x67a37d to 0x3d1669 (0x2a8d13 bytes) 000462[1] 1717013135.852932 write_OD 0x835000 thru 0x842fff (0xe000 bytes) 000463[1] 1717013135.903216 mapwrite 0x600000 thru 0x602b5d (0x2b5e bytes) 000464[1] 1717013136.014264 trunc from 0x843000 to 0x607b28 (0x23b4d7 bytes) 000465[1] 1717013136.028979 trunc from 0x607b29 to 0x0bb03a (0x54caee bytes) 000467[1] 1717013136.056155 write_OD 0x83b000 thru 0x842fff (0x8000 bytes) 000470[0] 1717013136.106453 write_OD 0x258000 thru 0x25afff (0x3000 bytes) 000471[0] 1717013136.145096 trunc from 0x843000 to 0x429c1a (0x4193e5 bytes) 000473[0] 1717013136.162720 write_OD 0x7e8000 thru 0x7f3fff (0xc000 bytes) 000476[0] 1717013136.214989 mapread 0x36d000 thru 0x37a6ee (0xd6ef bytes) 000480[1] 1717013136.256637 read_OD 0x666000 thru 0x672fff (0xd000 bytes) 000481[0] 1717013136.261419 mapwrite 0x667000 thru 0x66b3f1 (0x43f2 bytes) 000482[0] 1717013136.321168 trunc from 0x7f4000 to 0x430a37 (0x3c35c8 bytes) 000483[0] 1717013136.334472 trunc from 0x430a38 to 0x606b2a (0x1d60f3 bytes) 000485[1] 1717013136.361066 mapread 0x0af000 thru 0x0bee79 (0xfe7a bytes) 000486[1] 1717013136.405948 write_OD 0x0a8000 thru 0x0b5fff (0xe000 bytes) 000488[1] 1717013136.471637 read_OD 0x0a4000 thru 0x0adfff (0xa000 bytes) 000490[0] 1717013136.485695 trunc from 0x606b2b to 0x4a9f40 (0x15cbea bytes) 000491[0] 1717013136.517451 write_OD 0x4e0000 thru 0x4ebfff (0xc000 bytes) 000493[1] 1717013136.567364 read_OD 0x110000 thru 0x110fff (0x1000 bytes) 000495[1] 1717013136.569973 mapwrite 0x962000 thru 0x9652b8 (0x32b9 bytes) 000497[1] 1717013136.694905 mapwrite 0x009000 thru 0x015f77 (0xcf78 bytes) 000498[0] 1717013136.745922 read_OD 0x758000 thru 0x759fff (0x2000 bytes) 000499[1] 1717013136.779568 read_OD 0x5cb000 thru 0x5d0fff (0x6000 bytes) All operations completed A-OK! PASS 16a (29s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 16:05:38 (1717013138) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.224035 s, 37.4 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.206728 s, 40.6 MB/s Chance of close/open is 1 in 50 Seed set to 3139 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000006[0] 1717013139.907818 mapwrite 0x102bcd thru 0x103183 (0x5b7 bytes) 000009[1] 1717013140.003391 write 0x33c3d3 thru 0x33d448 (0x1076 bytes) 000010[1] 1717013140.020260 mapwrite 0x89283a thru 0x8936f3 (0xeba bytes) 000015[1] 1717013140.099898 read 0x52d9fa thru 0x52e0d3 (0x6da bytes) 000017[1] 1717013140.102850 mapread 0x2f5292 thru 0x2f5410 (0x17f bytes) 000018[1] 1717013140.105761 read 0x003eab thru 0x004657 (0x7ad bytes) truncating to largest ever: 0x69d608 000019[1] 1717013140.171485 trunc from 0x8936f4 to 0x69d607 (0x1f60ec bytes) truncating to largest ever: 0x7a5150 000023[1] 1717013140.210625 trunc from 0x69d608 to 0x7a514f (0x107b48 bytes) 000024[0] 1717013140.226105 trunc from 0x7a5150 to 0x0191aa (0x78bfa5 bytes) 000026[0] 1717013140.264045 read 0x00ab7b thru 0x00c65c (0x1ae2 bytes) 000028[0] 1717013140.282675 mapread 0x014dc0 thru 0x015328 (0x569 bytes) 000029[0] 1717013140.300685 mapread 0x00e700 thru 0x00f489 (0xd8a bytes) 000033[0] 1717013140.313929 mapwrite 0x7a93fb thru 0x7aa7eb (0x13f1 bytes) 000034[0] 1717013140.396286 read 0x21780d thru 0x2196ee (0x1ee2 bytes) 000035[0] 1717013140.471565 read 0x47271d thru 0x473fa8 (0x188c bytes) 000038[0] 1717013140.497283 read 0x018802 thru 0x018fef (0x7ee bytes) 000040[0] 1717013140.505962 read 0x2f14f4 thru 0x2f185b (0x368 bytes) 000042[0] 1717013140.507089 mapread 0x5481e5 thru 0x54826c (0x88 bytes) 000043[0] 1717013140.513666 write 0x322367 thru 0x3235b5 (0x124f bytes) 000044[1] 1717013140.521864 mapwrite 0x1262af thru 0x126af4 (0x846 bytes) 000046[1] 1717013140.618508 write 0x42777d thru 0x4280c4 (0x948 bytes) 000051[1] 1717013140.657467 mapread 0x6b0382 thru 0x6b0924 (0x5a3 bytes) 000058[0] 1717013140.680362 write 0x8f1b3b thru 0x8f26f3 (0xbb9 bytes) 000059[1] 1717013140.693221 write 0x644726 thru 0x645078 (0x953 bytes) 000061[1] 1717013140.715722 read 0x6e1556 thru 0x6e257d (0x1028 bytes) 000063[1] 1717013140.736443 write 0x185f16 thru 0x1869e0 (0xacb bytes) 000064[0] 1717013140.781267 mapread 0x62126f thru 0x6230b7 (0x1e49 bytes) 000066[0] 1717013140.828617 write 0x63bcee thru 0x63dbb7 (0x1eca bytes) 000067[0] 1717013140.845515 mapwrite 0x7fedeb thru 0x800344 (0x155a bytes) 000068[1] 1717013140.994581 mapread 0x5937b2 thru 0x594a79 (0x12c8 bytes) 000071[0] 1717013141.054634 read 0x2a921c thru 0x2a99b6 (0x79b bytes) 000074[1] 1717013141.065479 mapwrite 0x2f5f29 thru 0x2f775b (0x1833 bytes) 000077[1] 1717013141.145848 mapread 0x1a9e87 thru 0x1aa80a (0x984 bytes) truncating to largest ever: 0x92d596 000078[0] 1717013141.161753 trunc from 0x8f26f4 to 0x92d595 (0x3aea2 bytes) 000080[1] 1717013141.199930 mapwrite 0x22a38f thru 0x22af05 (0xb77 bytes) 000082[1] 1717013141.264204 write 0x82ae31 thru 0x82b518 (0x6e8 bytes) 000085[1] 1717013141.305704 write 0x88ad71 thru 0x88ca56 (0x1ce6 bytes) truncating to largest ever: 0x982af4 000087[1] 1717013141.330114 trunc from 0x92d596 to 0x982af3 (0x5555e bytes) 000089[1] 1717013141.359539 read 0x5402d0 thru 0x5409fb (0x72c bytes) 000090[1] 1717013141.419346 read 0x62a776 thru 0x62c6a4 (0x1f2f bytes) 000091[0] 1717013141.419837 mapwrite 0x50815b thru 0x509702 (0x15a8 bytes) 000092[1] 1717013141.506831 write 0x6e2949 thru 0x6e3a68 (0x1120 bytes) 000095[1] 1717013141.574998 trunc from 0x982af4 to 0x614a2e (0x36e0c5 bytes) 000097[0] 1717013141.587731 mapwrite 0x453e9d thru 0x454d9f (0xf03 bytes) 000100[1] 1717013141.673108 write 0x49f513 thru 0x4a03cf (0xebd bytes) 000103[0] 1717013141.707417 read 0x28992c thru 0x28aa0f (0x10e4 bytes) 000104[0] 1717013141.775380 mapread 0x49ddc3 thru 0x49ee99 (0x10d7 bytes) 000105[1] 1717013141.819635 mapread 0x521857 thru 0x5219d3 (0x17d bytes) 000106[0] 1717013141.824436 mapwrite 0x07e9a1 thru 0x0801e4 (0x1844 bytes) 000108[0] 1717013141.912709 trunc from 0x614a2f to 0x3c170a (0x253324 bytes) 000109[0] 1717013141.944185 read 0x343ba4 thru 0x344f68 (0x13c5 bytes) 000113[0] 1717013141.999751 read 0x20015d thru 0x200bad (0xa51 bytes) 000115[1] 1717013142.011054 trunc from 0x3c170b to 0x5112fe (0x14fbf4 bytes) 000116[1] 1717013142.058529 mapread 0x23d896 thru 0x23f5ed (0x1d58 bytes) 000118[0] 1717013142.076069 trunc from 0x5112ff to 0x137ac5 (0x3d9839 bytes) 000121[0] 1717013142.114002 read 0x04f1ce thru 0x04f6a6 (0x4d9 bytes) 000122[0] 1717013142.144060 mapread 0x075f96 thru 0x077190 (0x11fb bytes) 000123[0] 1717013142.160152 trunc from 0x137ac6 to 0x8bb8a3 (0x783dde bytes) 000124[0] 1717013142.187437 write 0x5a9f12 thru 0x5ab870 (0x195f bytes) 000126[1] 1717013142.254657 write 0x6f9255 thru 0x6fa56a (0x1316 bytes) 000127[0] 1717013142.281356 write 0x240627 thru 0x2413c6 (0xda0 bytes) 000129[0] 1717013142.299457 trunc from 0x8bb8a4 to 0x068a7d (0x852e26 bytes) 000133[0] 1717013142.362467 read 0x0053f6 thru 0x0067e7 (0x13f2 bytes) 000138[1] 1717013142.397548 write 0x97e8e2 thru 0x97f445 (0xb64 bytes) 000139[1] 1717013142.431334 read 0x8c14ca thru 0x8c22b4 (0xdeb bytes) 000140[0] 1717013142.483851 write 0x1525ab thru 0x1536d5 (0x112b bytes) 000145[0] 1717013142.572844 mapread 0x5a5bcf thru 0x5a6bd8 (0x100a bytes) 000148[1] 1717013142.627564 write 0x9d7aad thru 0x9d85b2 (0xb06 bytes) 000149[0] 1717013142.653053 read 0x5b2e06 thru 0x5b4bc4 (0x1dbf bytes) 000152[0] 1717013142.677324 write 0x8619f8 thru 0x862001 (0x60a bytes) 000153[1] 1717013142.736536 mapread 0x5e183d thru 0x5e259c (0xd60 bytes) 000155[0] 1717013142.791966 trunc from 0x9d85b3 to 0x0d0eec (0x9076c6 bytes) 000156[1] 1717013142.830735 trunc from 0x0d0eed to 0x94e78b (0x87d89f bytes) 000159[0] 1717013142.872066 trunc from 0x94e78c to 0x0da706 (0x874085 bytes) 000160[1] 1717013142.899752 mapwrite 0x069a1e thru 0x06a315 (0x8f8 bytes) 000163[1] 1717013143.003689 trunc from 0x0da707 to 0x67afd7 (0x5a08d1 bytes) 000164[0] 1717013143.030836 write 0x3c6709 thru 0x3c738a (0xc82 bytes) 000165[0] 1717013143.061568 mapread 0x6564a9 thru 0x656c75 (0x7cd bytes) 000167[0] 1717013143.082107 mapwrite 0x87afae thru 0x87b7d7 (0x82a bytes) 000172[1] 1717013143.221513 mapwrite 0x6b94f7 thru 0x6ba9f4 (0x14fe bytes) 000174[1] 1717013143.344770 read 0x7ee146 thru 0x7ee5b8 (0x473 bytes) 000175[1] 1717013143.354072 trunc from 0x87b7d8 to 0x59597b (0x2e5e5c bytes) 000176[0] 1717013143.377616 write 0x21df39 thru 0x21f581 (0x1649 bytes) 000177[1] 1717013143.410490 write 0x8cfb55 thru 0x8d0644 (0xaf0 bytes) 000179[1] 1717013143.423157 read 0x75bbfc thru 0x75ca3c (0xe41 bytes) 000181[0] 1717013143.481400 trunc from 0x8d0645 to 0x8b7750 (0x18ef4 bytes) 000182[1] 1717013143.525375 trunc from 0x8b7751 to 0x8c58ec (0xe19c bytes) 000184[0] 1717013143.570688 write 0x256969 thru 0x25855c (0x1bf4 bytes) 000186[1] 1717013143.620179 mapwrite 0x33717a thru 0x337c4e (0xad5 bytes) 000190[0] 1717013143.720435 write 0x294e6a thru 0x296adb (0x1c72 bytes) 000192[0] 1717013143.765011 read 0x7869ac thru 0x788222 (0x1877 bytes) 000196[1] 1717013143.873371 mapread 0x469cd5 thru 0x46aa8d (0xdb9 bytes) 000197[0] 1717013143.888030 mapwrite 0x398df6 thru 0x399ebd (0x10c8 bytes) 000206[1] 1717013143.970293 mapread 0x2cfcc7 thru 0x2d01c2 (0x4fc bytes) 000211[1] 1717013144.010550 read 0x79e80d thru 0x79fe53 (0x1647 bytes) 000213[1] 1717013144.055818 read 0x4310df thru 0x431e2b (0xd4d bytes) 000214[0] 1717013144.056170 mapwrite 0x46909e thru 0x46aef0 (0x1e53 bytes) 000215[1] 1717013144.150287 read 0x789f47 thru 0x78a4ff (0x5b9 bytes) 000217[1] 1717013144.219520 mapread 0x57402a thru 0x5759d4 (0x19ab bytes) 000220[1] 1717013144.221039 read 0x38c19b thru 0x38e0c7 (0x1f2d bytes) 000222[1] 1717013144.221582 read 0x28485c thru 0x284db6 (0x55b bytes) 000223[1] 1717013144.221871 mapread 0x542e9c thru 0x5433c5 (0x52a bytes) 000224[0] 1717013144.222915 write 0x4caad7 thru 0x4cab31 (0x5b bytes) 000226[1] 1717013144.251324 mapwrite 0x585830 thru 0x586377 (0xb48 bytes) 000229[0] 1717013144.363260 read 0x87113c thru 0x87121b (0xe0 bytes) 000230[0] 1717013144.414197 mapwrite 0x5d7596 thru 0x5d77cb (0x236 bytes) 000233[1] 1717013144.512396 read 0x7091c1 thru 0x70997a (0x7ba bytes) truncating to largest ever: 0x9aad4c 000234[1] 1717013144.569689 trunc from 0x8c58ed to 0x9aad4b (0xe545f bytes) 000235[1] 1717013144.632156 trunc from 0x9aad4c to 0x84f9f0 (0x15b35b bytes) 000237[0] 1717013144.654242 mapwrite 0x98113f thru 0x981a9f (0x961 bytes) 000238[0] 1717013144.791641 mapwrite 0x2cb006 thru 0x2cb05b (0x56 bytes) 000240[1] 1717013144.889523 trunc from 0x981aa0 to 0x4fa4c8 (0x4875d7 bytes) 000241[0] 1717013144.937370 mapwrite 0x7044ce thru 0x7060a5 (0x1bd8 bytes) 000243[1] 1717013145.028095 mapread 0x6bdc66 thru 0x6bebbc (0xf57 bytes) 000244[0] 1717013145.056062 mapwrite 0x4c1c35 thru 0x4c204f (0x41b bytes) 000253[1] 1717013145.177733 write 0x8c8264 thru 0x8ca199 (0x1f36 bytes) 000256[1] 1717013145.225613 mapwrite 0x13efe2 thru 0x13f8d3 (0x8f2 bytes) 000259[1] 1717013145.328342 read 0x1d624b thru 0x1d7062 (0xe18 bytes) 000261[0] 1717013145.385828 read 0x19d6a8 thru 0x19f044 (0x199d bytes) 000262[0] 1717013145.449662 write 0x267848 thru 0x269079 (0x1832 bytes) 000263[0] 1717013145.476150 read 0x5c25d2 thru 0x5c2cb2 (0x6e1 bytes) 000264[1] 1717013145.476557 write 0x85567f thru 0x856d05 (0x1687 bytes) 000266[0] 1717013145.514224 mapwrite 0x8eb3bb thru 0x8eba2d (0x673 bytes) 000268[0] 1717013145.629669 mapwrite 0x43cff0 thru 0x43e23f (0x1250 bytes) 000269[1] 1717013145.672667 write 0x0a0aa5 thru 0x0a1d2b (0x1287 bytes) 000270[1] 1717013145.696439 mapread 0x4031d5 thru 0x404e5f (0x1c8b bytes) 000273[1] 1717013145.749828 read 0x6b74b2 thru 0x6b935e (0x1ead bytes) 000275[0] 1717013145.750238 write 0x4787e1 thru 0x478ac4 (0x2e4 bytes) 000276[1] 1717013145.799477 write 0x1f13b0 thru 0x1f13d9 (0x2a bytes) 000279[1] 1717013145.855559 mapwrite 0x87f334 thru 0x87f64c (0x319 bytes) 000280[1] 1717013145.921597 write 0x9a7b99 thru 0x9a984a (0x1cb2 bytes) 000283[0] 1717013145.957794 trunc from 0x9a984b to 0x04ba47 (0x95de03 bytes) 000285[1] 1717013145.996618 mapwrite 0x190c2f thru 0x191b5d (0xf2f bytes) 000286[1] 1717013146.087321 read 0x098157 thru 0x098930 (0x7da bytes) 000287[1] 1717013146.107912 mapread 0x184a17 thru 0x1869a2 (0x1f8c bytes) 000288[0] 1717013146.108687 read 0x0cef2d thru 0x0cf9b8 (0xa8c bytes) 000291[0] 1717013146.163253 trunc from 0x191b5e to 0x483156 (0x2f15f9 bytes) 000292[0] 1717013146.191452 write 0x0fd2ba thru 0x0fd907 (0x64e bytes) 000293[0] 1717013146.235825 read 0x0d419d thru 0x0d5d5d (0x1bc1 bytes) 000294[0] 1717013146.263217 mapwrite 0x8af726 thru 0x8aff26 (0x801 bytes) 000302[0] 1717013146.369037 mapread 0x004303 thru 0x005c29 (0x1927 bytes) 000303[1] 1717013146.370431 write 0x54eba4 thru 0x550360 (0x17bd bytes) 000305[0] 1717013146.398577 trunc from 0x8aff27 to 0x181daf (0x72e177 bytes) 000306[1] 1717013146.423738 mapread 0x0dcde0 thru 0x0ded81 (0x1fa2 bytes) 000307[1] 1717013146.446784 trunc from 0x181db0 to 0x3b53a3 (0x2335f4 bytes) 000312[0] 1717013146.503098 mapwrite 0x262e8a thru 0x263ab0 (0xc27 bytes) 000314[0] 1717013146.573801 mapwrite 0x2ac3b9 thru 0x2acdac (0x9f4 bytes) 000317[0] 1717013146.633799 read 0x1bf2d5 thru 0x1bfbf5 (0x921 bytes) 000318[1] 1717013146.667645 mapread 0x31ccbd thru 0x31d4f5 (0x839 bytes) 000319[1] 1717013146.710261 write 0x482af4 thru 0x484981 (0x1e8e bytes) 000323[1] 1717013146.731421 trunc from 0x484982 to 0x5eb549 (0x166bc8 bytes) 000324[0] 1717013146.754540 read 0x425e03 thru 0x4273cd (0x15cb bytes) 000325[0] 1717013146.770283 mapwrite 0x8cd5a7 thru 0x8cf4bd (0x1f17 bytes) 000326[1] 1717013146.884744 mapread 0x3f86e1 thru 0x3f998d (0x12ad bytes) 000327[0] 1717013146.906618 mapwrite 0x8e2644 thru 0x8e3025 (0x9e2 bytes) 000329[0] 1717013146.973400 mapread 0x3714a6 thru 0x372e76 (0x19d1 bytes) 000331[0] 1717013146.985419 write 0x7ce557 thru 0x7cebae (0x658 bytes) 000332[0] 1717013146.996013 mapread 0x513adc thru 0x514047 (0x56c bytes) 000333[0] 1717013146.996906 mapwrite 0x4c7518 thru 0x4c7c66 (0x74f bytes) 000336[1] 1717013147.030375 mapread 0x3f25f6 thru 0x3f3ee1 (0x18ec bytes) 000338[0] 1717013147.052856 mapread 0x40f0d6 thru 0x410e44 (0x1d6f bytes) 000339[0] 1717013147.059714 trunc from 0x8e3026 to 0x6cf2be (0x213d67 bytes) 000340[0] 1717013147.081718 mapwrite 0x1e5379 thru 0x1e59fc (0x684 bytes) 000341[1] 1717013147.120645 read 0x64a598 thru 0x64ad37 (0x7a0 bytes) 000342[1] 1717013147.133884 trunc from 0x6cf2bf to 0x3298c4 (0x3a59fa bytes) 000344[0] 1717013147.166640 mapread 0x119156 thru 0x119ce9 (0xb94 bytes) 000347[0] 1717013147.189007 mapread 0x1e0f23 thru 0x1e186b (0x949 bytes) 000348[0] 1717013147.198572 write 0x0b8c73 thru 0x0b925e (0x5ec bytes) 000349[0] 1717013147.216602 mapread 0x0ee9d7 thru 0x0f08db (0x1f05 bytes) 000350[0] 1717013147.236278 mapwrite 0x6f28d4 thru 0x6f2d6b (0x498 bytes) 000351[1] 1717013147.298284 write 0x3c003f thru 0x3c1554 (0x1516 bytes) 000355[0] 1717013147.376969 read 0x515d20 thru 0x516e8b (0x116c bytes) 000357[0] 1717013147.405319 mapread 0x419487 thru 0x419d82 (0x8fc bytes) 000361[1] 1717013147.450045 write 0x9d6a83 thru 0x9d8569 (0x1ae7 bytes) 000363[0] 1717013147.470154 mapwrite 0x9bbdb7 thru 0x9bc9cc (0xc16 bytes) 000364[0] 1717013147.581407 trunc from 0x9d856a to 0x3b844b (0x62011e bytes) 000366[0] 1717013147.606425 read 0x0dcb2e thru 0x0ddba9 (0x107c bytes) 000367[0] 1717013147.613371 read 0x260aac thru 0x2610dd (0x632 bytes) 000368[1] 1717013147.628072 trunc from 0x3b844c to 0x206038 (0x1b2413 bytes) 000371[1] 1717013147.675817 read 0x11548f thru 0x115d71 (0x8e3 bytes) 000372[0] 1717013147.711739 read 0x17f5f7 thru 0x181576 (0x1f80 bytes) 000373[1] 1717013147.750855 read 0x0090a5 thru 0x00a833 (0x178f bytes) 000374[0] 1717013147.791799 mapwrite 0x4c3350 thru 0x4c3d21 (0x9d2 bytes) 000375[1] 1717013147.893298 mapread 0x4126cf thru 0x4130e4 (0xa16 bytes) 000376[1] 1717013147.918014 mapread 0x02f66c thru 0x02fdfc (0x791 bytes) 000377[1] 1717013147.951823 read 0x3ec186 thru 0x3ed8f5 (0x1770 bytes) 000378[1] 1717013147.954906 write 0x99f87f thru 0x9a15e4 (0x1d66 bytes) 000381[1] 1717013147.977255 trunc from 0x9a15e5 to 0x072454 (0x92f190 bytes) 000382[1] 1717013148.008614 read 0x0272f6 thru 0x028af9 (0x1804 bytes) 000385[1] 1717013148.041595 write 0x2b76af thru 0x2b8161 (0xab3 bytes) 000388[1] 1717013148.057367 mapwrite 0x2547bf thru 0x256732 (0x1f74 bytes) 000390[0] 1717013148.138953 mapwrite 0x29faec thru 0x2a03bd (0x8d2 bytes) 000391[1] 1717013148.205784 mapwrite 0x0b15c1 thru 0x0b2fe6 (0x1a26 bytes) 000392[0] 1717013148.277458 read 0x125827 thru 0x126c48 (0x1422 bytes) 000393[1] 1717013148.314873 write 0x5b02bb thru 0x5b0faa (0xcf0 bytes) 000394[0] 1717013148.316098 write 0x13b45e thru 0x13cbf6 (0x1799 bytes) 000396[0] 1717013148.357923 mapwrite 0x3997c7 thru 0x39b0c0 (0x18fa bytes) 000397[1] 1717013148.483723 read 0x17ee69 thru 0x17fee2 (0x107a bytes) 000398[1] 1717013148.533331 trunc from 0x5b0fab to 0x93b17c (0x38a1d2 bytes) 000400[0] 1717013148.580830 mapread 0x92ea2e thru 0x92f959 (0xf2c bytes) 000401[0] 1717013148.608694 mapwrite 0x8c1fa6 thru 0x8c3a68 (0x1ac3 bytes) 000402[0] 1717013148.696790 mapread 0x3d86c7 thru 0x3d9e71 (0x17ab bytes) 000403[1] 1717013148.717093 read 0x26addb thru 0x26c4b9 (0x16df bytes) 000405[1] 1717013148.819459 trunc from 0x93b17d to 0x0ea34e (0x850e2e bytes) 000406[1] 1717013148.857086 mapread 0x0e35d7 thru 0x0e3968 (0x392 bytes) 000407[1] 1717013148.866737 mapwrite 0x3be0a9 thru 0x3bfc40 (0x1b98 bytes) 000408[0] 1717013148.930170 trunc from 0x3bfc41 to 0x75c218 (0x39c5d8 bytes) 000409[0] 1717013148.961970 mapread 0x574d50 thru 0x57590e (0xbbf bytes) 000410[1] 1717013149.000840 mapwrite 0x1fcfac thru 0x1fe44f (0x14a4 bytes) 000412[1] 1717013149.104637 mapwrite 0x298d15 thru 0x299906 (0xbf2 bytes) 000413[1] 1717013149.169770 trunc from 0x75c219 to 0x35a42e (0x401dea bytes) 000415[0] 1717013149.193156 trunc from 0x35a42f to 0x5e1c6c (0x28783e bytes) 000418[0] 1717013149.259025 mapwrite 0x8233c7 thru 0x824360 (0xf9a bytes) 000420[0] 1717013149.334496 mapwrite 0x6d789c thru 0x6d9569 (0x1cce bytes) 000421[0] 1717013149.386169 trunc from 0x824361 to 0x38bd3e (0x498622 bytes) 000422[0] 1717013149.406897 mapwrite 0x8b302a thru 0x8b35bf (0x596 bytes) 000424[1] 1717013149.498173 mapwrite 0x610d84 thru 0x6110c4 (0x341 bytes) 000425[1] 1717013149.597658 read 0x101c83 thru 0x103b77 (0x1ef5 bytes) 000426[0] 1717013149.662322 mapwrite 0x6ace9d thru 0x6ae8d1 (0x1a35 bytes) 000428[1] 1717013149.779866 trunc from 0x8b35c0 to 0x8f0b97 (0x3d5d8 bytes) 000429[1] 1717013149.808971 mapread 0x882f51 thru 0x883236 (0x2e6 bytes) 000434[0] 1717013149.847743 write 0x282b4b thru 0x282e5b (0x311 bytes) 000436[1] 1717013149.883266 mapwrite 0x866b46 thru 0x867551 (0xa0c bytes) 000437[0] 1717013149.976957 trunc from 0x8f0b98 to 0x2a82b9 (0x6488de bytes) 000438[0] 1717013150.020315 trunc from 0x2a82ba to 0x5967d7 (0x2ee51e bytes) 000439[1] 1717013150.037558 read 0x17caeb thru 0x17dfa8 (0x14be bytes) 000441[0] 1717013150.098542 read 0x080058 thru 0x080fec (0xf95 bytes) 000443[0] 1717013150.147723 write 0x1ccc66 thru 0x1cdcc6 (0x1061 bytes) 000444[1] 1717013150.185714 trunc from 0x5967d8 to 0x5e9146 (0x5296f bytes) 000445[0] 1717013150.210585 mapread 0x1de7d9 thru 0x1df41b (0xc43 bytes) 000447[0] 1717013150.229493 write 0x6e8bf7 thru 0x6e9214 (0x61e bytes) 000449[0] 1717013150.248928 read 0x11e746 thru 0x11eb89 (0x444 bytes) 000450[1] 1717013150.287223 read 0x24d1cf thru 0x24d8c0 (0x6f2 bytes) 000451[0] 1717013150.322611 trunc from 0x6e9215 to 0x87a0c9 (0x190eb5 bytes) 000452[1] 1717013150.374267 write 0x2c5854 thru 0x2c5e13 (0x5c0 bytes) 000454[1] 1717013150.413010 mapwrite 0x05275f thru 0x053c3c (0x14de bytes) 000455[0] 1717013150.483363 mapread 0x6ce29e thru 0x6cebdf (0x942 bytes) 000457[1] 1717013150.540609 mapwrite 0x627413 thru 0x62892f (0x151d bytes) 000458[0] 1717013150.673615 read 0x5801f0 thru 0x581b90 (0x19a1 bytes) 000461[1] 1717013150.712858 mapwrite 0x418bc2 thru 0x41914a (0x589 bytes) 000462[0] 1717013150.777660 trunc from 0x87a0ca to 0x5a42c3 (0x2d5e06 bytes) 000463[1] 1717013150.805570 mapwrite 0x1c1c71 thru 0x1c1fea (0x37a bytes) 000464[0] 1717013150.870740 write 0x788cdd thru 0x789d7d (0x10a1 bytes) 000465[0] 1717013150.884720 mapread 0x1097c9 thru 0x1098ba (0xf2 bytes) 000466[0] 1717013150.927234 read 0x1f96db thru 0x1fa5bb (0xee1 bytes) 000467[1] 1717013150.933908 read 0x27a713 thru 0x27c6ff (0x1fed bytes) 000468[1] 1717013150.973094 mapwrite 0x28c686 thru 0x28da0c (0x1387 bytes) 000469[0] 1717013151.056290 read 0x391a33 thru 0x392e1d (0x13eb bytes) 000471[0] 1717013151.105823 read 0x6bb996 thru 0x6bbf03 (0x56e bytes) 000472[0] 1717013151.133798 mapread 0x469c0f thru 0x46ab30 (0xf22 bytes) 000476[0] 1717013151.155433 mapread 0x1b64bb thru 0x1b8227 (0x1d6d bytes) 000477[0] 1717013151.156208 mapwrite 0x0657ac thru 0x0659cd (0x222 bytes) 000478[0] 1717013151.234710 read 0x18e1a6 thru 0x18fcb9 (0x1b14 bytes) 000479[0] 1717013151.235049 read 0x699984 thru 0x69b21e (0x189b bytes) 000480[1] 1717013151.235345 trunc from 0x789d7e to 0x80c64e (0x828d1 bytes) 000481[1] 1717013151.280554 write 0x11f22a thru 0x11fb16 (0x8ed bytes) 000482[0] 1717013151.290837 trunc from 0x80c64f to 0x441e66 (0x3ca7e8 bytes) 000483[1] 1717013151.322700 mapwrite 0x83ce55 thru 0x83d45d (0x609 bytes) 000488[1] 1717013151.389981 mapwrite 0x3b66a6 thru 0x3b7a6c (0x13c7 bytes) 000489[0] 1717013151.437185 read 0x2cf66d thru 0x2d0389 (0xd1d bytes) 000492[1] 1717013151.496378 read 0x43fb5c thru 0x4410c9 (0x156e bytes) 000495[1] 1717013151.567407 read 0x5c3d83 thru 0x5c53b0 (0x162e bytes) 000497[1] 1717013151.568562 trunc from 0x83d45e to 0x02a3b5 (0x8130a8 bytes) 000499[1] 1717013151.606097 write 0x9a1354 thru 0x9a1780 (0x42d bytes) 000500[0] 1717013151.614767 mapwrite 0x5e2bfa thru 0x5e3e3c (0x1243 bytes) All operations completed A-OK! PASS 16b (15s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 16:05:53 (1717013153) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (1s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 16:05:55 (1717013155) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.363145 s, 23.1 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.276176 s, 30.4 MB/s ldlm.namespaces.MGC192.168.201.124@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6229800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6cdd800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b6229800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b6cdd800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b6229800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b6cdd800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 7.66722 s, 13.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.41561 s, 74.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.84423 s, 124 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.15595 s, 48.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.70706 s, 18.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.3883 s, 75.5 MB/s PASS 16d (24s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 16:06:19 (1717013179) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0903964 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0694992 s, 15.1 MB/s PASS 16e (3s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 16:06:22 (1717013182) TIMEOUT PASS 16f (23s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 16:06:45 (1717013205) TIMEOUT PASS 16g (23s) == sanityn test 16h: mmap read after truncate file ======= 16:07:08 (1717013228) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (3s) == sanityn test 16i: read after truncate file ============ 16:07:11 (1717013231) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (3s) == sanityn test 16j: race dio with buffered i/o ========== 16:07:14 (1717013234) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.715105 s, 36.7 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.565102 s, 46.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.05217 s, 12.8 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.256918 s, 102 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.58011 s, 16.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.46786 s, 56.0 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.30008 s, 11.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.765533 s, 34.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.91349 s, 28.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.29085 s, 11.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.4932 s, 10.5 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.445318 s, 58.9 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.62713 s, 41.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.02169 s, 13.0 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.12909 s, 12.3 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.453121 s, 57.9 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.590731 s, 44.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.61757 s, 16.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.84114 s, 14.2 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (20s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 16:07:35 (1717013255) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x1a7062c fsx: fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x232e1d3 skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 Wed May 29 16:08:26 EDT 2024 All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 2 done: rc=0 Wed May 29 16:08:28 EDT 2024 + fsx 3 done: rc=0 Wed May 29 16:08:28 EDT 2024 + fsx 4 done: rc=0 Wed May 29 16:08:28 EDT 2024 + fsx 5 done: rc=0 Wed May 29 16:08:28 EDT 2024 PASS 16k (57s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 16:08:32 (1717013312) fail_loc=0x8000030a PASS 17 (6s) == sanityn test 18: mmap sanity check =========================================================================================== 16:08:38 (1717013318) mmap test1: basic mmap operation (PASS, 0.09659s) mmap test2: MAP_PRIVATE not write back (PASS, 0.046247s) mmap test3: concurrent mmap ops on two nodes (PASS, 19.088s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.212s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.08301s) mmap test6: check mmap write/read content on two nodes (PASS, 0.15851s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0505s) PASS 18 (26s) == sanityn test 19: test concurrent uncached read races ========================================================================= 16:09:05 (1717013345) oleg124-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg124-client: oleg124-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 16:09:07 (1717013347) PASS 20 (3s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 16:09:10 (1717013350) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (3s) == sanityn test 23: others should see updated atime while another read============================================================== 16:09:13 (1717013353) now is 1717013354 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 new atime is 1717013415 PASS 23 (64s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 16:10:17 (1717013417) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 33792 3735552 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 41984 7496704 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 33792 3735552 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 41984 7496704 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.2K 403 114.8K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 114.5K 400 114.1K 1% /mnt/lustre[OST:1] filesystem_summary: 229.3K 386 228.9K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 403 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 400 114.1K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.3K 386 228.9K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 8.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 33.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 41.0M 7.1G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118003 403 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117200 400 116800 1% /mnt/lustre2[OST:1] filesystem_summary: 234786 386 234400 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 33792 3735552 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 41984 7496704 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 403 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 400 114.1K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.3K 386 228.9K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre[MDT:0] filesystem_summary: 502242 386 501856 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118003 403 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117200 400 116800 1% /mnt/lustre2[OST:1] filesystem_summary: 234786 386 234400 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 33792 3735552 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 41984 7496704 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 33792 3735552 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 41984 7496704 1% /mnt/lustre2 PASS 24a (4s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 16:10:21 (1717013421) PASS 24b (4s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 16:10:25 (1717013425) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (4s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 16:10:29 (1717013429) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (1s) == sanityn test 26a: allow mtime to get older ============ 16:10:30 (1717013430) utime: good mknod times 1717013430 <= 1717013431 <= 1717013431 for /mnt/lustre/f26a utime: good mknod times 1717013430 <= 1717013431 <= 1717013431 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (4s) == sanityn test 26b: sync mtime between ost and mds ====== 16:10:34 (1717013434) PASS 26b (5s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 16:10:39 (1717013439) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502390 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2024-05-29 16:10:40.000000000 -0400 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502390 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2024-05-29 16:10:40.000000000 -0400 Birth: - PASS 26c (5s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 16:10:45 (1717013445) 0 PASS 30 (6s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 16:10:51 (1717013451) fail_loc=0x314 PASS 31a (4s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 16:10:56 (1717013456) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg124-server mds-ost sync done. sleep 5 for ZFS zfs Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.201.124@tcp:/lustre 7542784 41984 7494656 1% /mnt/lustre2 PASS 31b (14s) == sanityn test 31r: open-rename(replace) race =========== 16:11:09 (1717013469) -rw-r--r-- 1 root root 0 May 29 16:11 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (6s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 16:11:15 (1717013475) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1211: 12520 Terminated tail -f $tfile PASS 31s (4s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 16:11:19 (1717013479) PASS 31t (4s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 16:11:23 (1717013483) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (2s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 16:11:25 (1717013485) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (2s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 16:11:27 (1717013487) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (2s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 16:11:29 (1717013489) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (1s) == sanityn test 34: no lock timeout under IO ============= 16:11:30 (1717013490) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg124-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6229800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6cdd800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b6229800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff8800b6cdd800.ost_server_uuid in FULL state after 0 sec oleg124-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6229800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6cdd800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b6229800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8800b6cdd800.ost_server_uuid in IDLE state after 0 sec oleg124-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6229800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6cdd800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b6229800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff8800b6cdd800.ost_server_uuid in FULL state after 0 sec oleg124-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6229800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6cdd800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b6229800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8800b6cdd800.ost_server_uuid in IDLE state after 0 sec oleg124-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6229800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6cdd800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b6229800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff8800b6cdd800.ost_server_uuid in IDLE state after 0 sec oleg124-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6229800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6cdd800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b6229800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8800b6cdd800.ost_server_uuid in IDLE state after 0 sec PASS 34 (99s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 16:13:09 (1717013589) fail_loc=0x80000317 Race attempt 0 Wait for 19992 20105 for 60 sec... - open/close 1109 (time 1717013602.73 total 10.01 last 110.84) - open/close 2351 (time 1717013612.74 total 20.02 last 124.05) - open/close 3400 (time 1717013622.74 total 30.02 last 104.89) total: 4000 open/close in 34.39 seconds: 116.30 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.201.124@tcp:/lustre 7.2G 43M 7.2G 1% /mnt/lustre 192.168.201.124@tcp:/lustre 7.2G 43M 7.2G 1% /mnt/lustre2 PASS 35 (66s) == sanityn test 36: handle ESTALE/open-unlink correctly == 16:14:15 (1717013655) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg124-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.750625 s, 69.8 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(0) *** before(7494656) after_dd(7437312) after(7488512) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.585412 s, 89.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(1) *** before(7488512) after_dd(7439360) after(7490560) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.654513 s, 80.1 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(2) *** before(7490560) after_dd(7437312) after(7488512) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.440697 s, 119 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(3) *** before(7488512) after_dd(7437312) after(7488512) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.455722 s, 115 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(4) *** before(7488512) after_dd(7437312) after(7488512) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.478496 s, 110 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(5) *** before(7488512) after_dd(7437312) after(7488512) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.420033 s, 125 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(6) *** before(7488512) after_dd(7439360) after(7490560) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.417292 s, 126 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(7) *** before(7490560) after_dd(7439360) after(7490560) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.469084 s, 112 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(8) *** before(7490560) after_dd(7437312) after(7488512) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.401232 s, 131 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(9) *** before(7488512) after_dd(7439360) after(7490560) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.548491 s, 95.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(10) *** before(7490560) after_dd(7433216) after(7484416) PASS 36 (231s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 16:18:06 (1717013886) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 - create 2482 (time 1717013898.31 total 10.00 last 248.19) - create 5290 (time 1717013908.31 total 20.00 last 280.77) - create 7901 (time 1717013918.31 total 30.00 last 261.04) total: 10000 create in 39.70 seconds: 251.88 ops/second PASS 37 (45s) == sanityn test 39a: file mtime does not change after rename ========================================================== 16:18:51 (1717013931) repeat after cancel_lru_locks PASS 39a (4s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 16:18:55 (1717013935) repeat after cancel_lru_locks PASS 39b (5s) == sanityn test 39c: check truncate mtime update ================================================================================ 16:19:00 (1717013940) repeat after cancel_lru_locks PASS 39c (4s) == sanityn test 39d: sync write should update mtime ====== 16:19:04 (1717013944) fail_loc=0x411 fail_loc=0 PASS 39d (3s) == sanityn test 40a: pdirops: create vs others ======================================================================== 16:19:07 (1717013947) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (11s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 16:19:18 (1717013958) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (10s) == sanityn test 40c: pdirops: link and others ======================================================================== 16:19:28 (1717013968) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (10s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 16:19:38 (1717013978) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (11s) == sanityn test 40e: pdirops: rename and others ======================================================================== 16:19:49 (1717013989) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (11s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 16:20:00 (1717014000) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (8s) == sanityn test 41b: pdirops: create vs create ======================================================================== 16:20:08 (1717014008) open: File exists Conflict PASS 41b (7s) == sanityn test 41c: pdirops: create vs link ======================================================================== 16:20:15 (1717014015) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (8s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 16:20:23 (1717014023) Conflict PASS 41d (7s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 16:20:30 (1717014030) Conflict PASS 41e (7s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 16:20:37 (1717014037) Conflict PASS 41f (6s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 16:20:43 (1717014043) Conflict PASS 41g (7s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 16:20:50 (1717014050) Conflict PASS 41h (7s) == sanityn test 41i: reint_open: create vs create ======== 16:20:57 (1717014057) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (777s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 16:33:54 (1717014834) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (5s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 16:33:59 (1717014839) open: File exists Conflict PASS 42b (6s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 16:34:05 (1717014845) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (6s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 16:34:11 (1717014851) Conflict PASS 42d (6s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 16:34:17 (1717014857) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (7s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 16:34:24 (1717014864) Conflict PASS 42f (7s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 16:34:31 (1717014871) Conflict PASS 42g (6s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 16:34:37 (1717014877) Conflict PASS 42h (6s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 16:34:43 (1717014883) PASS 43a (32s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 16:35:15 (1717014915) Conflict PASS 43b (7s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 16:35:22 (1717014922) Conflict PASS 43c (5s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 16:35:27 (1717014927) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (6s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 16:35:33 (1717014933) Conflict PASS 43e (6s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 16:35:39 (1717014939) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (6s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 16:35:45 (1717014945) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (6s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 16:35:51 (1717014951) Conflict PASS 43h (6s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 16:35:57 (1717014957) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 16:35:59 (1717014959) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (65s) == sanityn test 43k: unlink vs create ==================== 16:37:04 (1717015024) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (608s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 16:47:12 (1717015632) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Wed May 29 16:47:16 EDT 2024 PASS 44a (6s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 16:47:18 (1717015638) open: File exists Conflict PASS 44b (7s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 16:47:25 (1717015645) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (6s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 16:47:31 (1717015651) Conflict PASS 44d (6s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 16:47:37 (1717015657) Conflict PASS 44e (6s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 16:47:43 (1717015663) Conflict PASS 44f (6s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 16:47:49 (1717015669) Conflict PASS 44g (8s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 16:47:57 (1717015677) Conflict PASS 44h (7s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 16:48:04 (1717015684) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (2s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 16:48:06 (1717015686) PASS 45a (67s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 16:49:13 (1717015753) Conflict PASS 45b (6s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 16:49:19 (1717015759) Conflict PASS 45c (7s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 16:49:26 (1717015766) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (8s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 16:49:34 (1717015774) Conflict PASS 45e (7s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 16:49:41 (1717015781) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (7s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 16:49:48 (1717015788) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (8s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 16:49:56 (1717015796) Conflict PASS 45h (7s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 16:50:03 (1717015803) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 16:50:04 (1717015804) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (629s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 17:00:33 (1717016433) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (7s) == sanityn test 46b: pdirops: link vs create ======================================================================== 17:00:40 (1717016440) open: File exists Conflict PASS 46b (6s) == sanityn test 46c: pdirops: link vs link ======================================================================== 17:00:46 (1717016446) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (7s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 17:00:53 (1717016453) Conflict PASS 46d (6s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 17:00:59 (1717016459) Conflict PASS 46e (6s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 17:01:05 (1717016465) Conflict PASS 46f (7s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 17:01:12 (1717016472) Conflict PASS 46g (6s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 17:01:18 (1717016478) Conflict PASS 46h (7s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 17:01:25 (1717016485) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 17:01:26 (1717016486) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (2s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 17:01:28 (1717016488) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (2s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 17:01:30 (1717016490) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (1s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 17:01:32 (1717016492) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 17:01:33 (1717016493) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (2s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 17:01:35 (1717016495) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 17:01:36 (1717016496) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 17:01:37 (1717016497) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.015526 s, 660 kB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (9s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 17:01:46 (1717016506) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.014929 s, 10.7 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3514: kill: (31269) - No such process PASS 51a (4s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 17:01:51 (1717016511) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00994634 s, 103 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0318773 s, 32.9 MB/s 3145728 PASS 51b (14s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 17:02:05 (1717016525) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00950992 s, 108 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 17:02:12 (1717016532) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126962 s, 82.6 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 17:02:15 (1717016535) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2449 0x991 0x240000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2449 0x991 0x240000400 read lease(1) has applied. PASS 51e (4s) == sanityn test 54: rename locking ======================= 17:02:19 (1717016539) llite.lustre-ffff8800b6229800.xattr_cache=1 llite.lustre-ffff8800b6cdd800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505004 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-05-29 17:02:20.000000000 -0400 Modify: 2024-05-29 17:02:20.000000000 -0400 Change: 2024-05-29 17:02:20.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505007 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-05-29 17:02:25.000000000 -0400 Modify: 2024-05-29 17:02:26.000000000 -0400 Change: 2024-05-29 17:02:26.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505010 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-05-29 17:02:31.000000000 -0400 Modify: 2024-05-29 17:02:31.000000000 -0400 Change: 2024-05-29 17:02:31.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505009 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-05-29 17:02:31.000000000 -0400 Modify: 2024-05-29 17:02:31.000000000 -0400 Change: 2024-05-29 17:02:31.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505013 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-05-29 17:02:36.000000000 -0400 Modify: 2024-05-29 17:02:37.000000000 -0400 Change: 2024-05-29 17:02:37.000000000 -0400 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505012 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-05-29 17:02:36.000000000 -0400 Modify: 2024-05-29 17:02:37.000000000 -0400 Change: 2024-05-29 17:02:37.000000000 -0400 Birth: - PASS 54 (25s) == sanityn test 55a: rename vs unlink target dir ========= 17:02:44 (1717016564) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (8s) == sanityn test 55b: rename vs unlink source dir ========= 17:02:52 (1717016572) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (8s) == sanityn test 55c: rename vs unlink orphan target dir == 17:03:00 (1717016580) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (13s) == sanityn test 55d: rename file vs link ================= 17:03:13 (1717016593) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (10s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 17:03:23 (1717016603) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1717016604 chunksize: 4096 size: 16777216000000 write offset: 3636461568kB 0.564616 MB/s read offset: 3636461568kB inf MB/s llverdev: data verified successfully PASS 56a (27s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 17:03:50 (1717016630) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1717016631 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 2.49131 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (54s) == sanityn test 60: Verify data_version behaviour ======== 17:04:44 (1717016684) PASS 60 (3s) == sanityn test 70a: cd directory && rm directory ======== 17:04:47 (1717016687) PASS 70a (3s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 17:04:50 (1717016690) PASS 70b (3s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 17:04:53 (1717016693) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00737035 s, 8.9 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (2s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 17:04:55 (1717016695) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00722474 s, 9.1 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 17:04:56 (1717016696) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (2s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 17:04:58 (1717016698) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.0123634 s, 5.3 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 17:04:59 (1717016699) llite.lustre-ffff8800b6229800.xattr_cache=1 llite.lustre-ffff8800b6cdd800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (3s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 17:05:02 (1717016702) llite.lustre-ffff8800b6229800.xattr_cache=1 llite.lustre-ffff8800b6cdd800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (3s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 17:05:05 (1717016705) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0129658 s, 79.0 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0102796 s, 99.6 kB/s 11266: get lock2 11267: get lock1 11267: done 11267: get lock2 11266: done 11266: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 11266: cannot get lock1: Resource deadlock avoided 11267: done 11267: exit rc=0 11266: done 11266: exit rc=0 PASS 74 (7s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 17:05:12 (1717016712) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0241842 s, 86.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285144 s, 36.8 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4103: 11906 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (8s) == sanityn test 76: Verify MDT open_files listing ======== 17:05:20 (1717016720) opening files: ........ closing files: ........ PASS 76 (33s) == sanityn test 77a: check FIFO NRS policy =============== 17:05:53 (1717016753) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.206382 s, 81.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202293 s, 51.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116005 s, 90.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0197424 s, 53.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0723897 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0785023 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0812968 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0789339 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0867902 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0838588 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0860737 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0950461 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103232 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106468 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10981 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105681 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113401 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00317769 s, 330 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0787411 s, 13.3 MB/s , 0.082122 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0594312 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0645637 s, 16.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0522406 s, 20.1 MB/s , 0.0462982 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436503 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00475055 s, 221 MB/s , 0.0319386 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405831 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297779 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216603 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122201 s, 85.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424697 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183421 s, 57.2 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (5s) == sanityn test 77b: check CRR-N NRS policy ============== 17:05:58 (1717016758) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.185074 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023771 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101126 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231377 s, 45.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0847077 s, 12.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0863269 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0816236 s, 12.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0861753 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0818695 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0892144 s, 11.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0892527 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.095544 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107343 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0928921 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101578 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103142 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111983 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263139 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020641 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0278125 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00480842 s, 218 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181122 s, 57.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01818 s, 57.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0099218 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144409 s, 72.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205291 s, 51.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0218474 s, 48.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128427 s, 81.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143047 s, 73.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0155249 s, 67.5 MB/s , 0.0282508 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175214 s, 59.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178291 s, 58.8 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.161729 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013707 s, 76.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173184 s, 60.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181662 s, 57.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024668 s, 42.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0933376 s, 11.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0989413 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103253 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103035 s, 10.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0999983 s, 10.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100709 s, 10.4 MB/s 1048576 bytes (1.0 MB) copied, 0.113351 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.114209 s, 9.2 MB/s 1048576 bytes (1.0 MB) copied, 0.109949 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.114595 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11238 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112036 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257225 s, 40.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0244109 s, 43.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279288 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02256 s, 46.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235597 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125468 s, 83.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212365 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013981 s, 75.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167608 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351002 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186903 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325618 s, 32.2 MB/s , 0.0194654 s, 53.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209274 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217527 s, 48.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223087 s, 47.0 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (6s) == sanityn test 77c: check ORR NRS policy ================ 17:06:04 (1717016764) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.222501 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131503 s, 79.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147946 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268896 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309357 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0844413 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0786616 s, 13.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0972619 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.116181 s, 9.0 MB/s 1048576 bytes (1.0 MB) copied, 0.118528 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115099 s, 9.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0957982 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108495 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105441 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126988 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117668 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125883 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00231793 s, 452 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00186422 s, 562 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00370053 s, 283 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00414889 s, 253 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00409282 s, 256 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0018172 s, 577 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413408 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00188355 s, 557 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0322735 s, 32.5 MB/s , 0.0403359 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269481 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227283 s, 46.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233777 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134611 s, 77.9 MB/s , 0.00507458 s, 207 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00346868 s, 302 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.202128 s, 83.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292022 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436861 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103015 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11438 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0983761 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105292 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12428 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126416 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124185 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141942 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146253 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141433 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151416 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150707 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.159884 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.182767 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137224 s, 76.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178929 s, 58.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00349629 s, 300 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00220168 s, 476 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0801168 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00324692 s, 323 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0768458 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0667148 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180774 s, 58.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110953 s, 94.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155026 s, 67.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0408224 s, 25.7 MB/s , 0.0352926 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261144 s, 40.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359351 s, 29.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0426561 s, 24.6 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.182561 s, 91.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279251 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317201 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0615666 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0885014 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0910313 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0925117 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109184 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104985 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.101162 s, 10.4 MB/s 1048576 bytes (1.0 MB) copied, 0.105432 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109675 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11217 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12125 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113159 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122293 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128175 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311828 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316857 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0410429 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034655 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296669 s, 35.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295416 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302215 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035743 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342846 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02904 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249845 s, 42.0 MB/s , 0.0290738 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0308704 s, 34.0 MB/s , 0.0330078 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258692 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0282431 s, 37.1 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (7s) == sanityn test 77d: check TRR nrs policy ================ 17:06:11 (1717016771) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.172305 s, 97.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370478 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387118 s, 27.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0849983 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0742955 s, 14.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0525451 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0955321 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0717572 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101794 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100809 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106486 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106272 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102013 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0823272 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0996918 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108454 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130166 s, 8.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6cdd800.lock_unused_count=3 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6cdd800.lock_unused_count=4 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118449 s, 88.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0119043 s, 88.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00271426 s, 386 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00336217 s, 312 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00177515 s, 591 MB/s 1048576 bytes (1.0 MB) copied, 0.00187095 s, 560 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00243474 s, 431 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00182783 s, 574 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0029547 s, 355 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00413108 s, 254 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385018 s, 27.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0183862 s, 57.0 MB/s , 0.0302338 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02718 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233977 s, 44.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0417671 s, 25.1 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.173039 s, 97.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286079 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426052 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324974 s, 32.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0544667 s, 19.3 MB/s , 0.0321895 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0998824 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125946 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117177 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130188 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0912312 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143155 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118203 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160507 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146599 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162538 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153499 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143748 s, 72.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0116293 s, 90.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0265504 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265707 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151542 s, 69.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154304 s, 68.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162267 s, 64.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0208283 s, 50.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0220687 s, 47.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184436 s, 56.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207651 s, 50.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219708 s, 47.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235375 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240248 s, 43.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0290149 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246018 s, 42.6 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.170571 s, 98.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0364142 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192469 s, 54.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0471108 s, 22.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11308 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0985254 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121017 s, 8.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0957927 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127892 s, 8.2 MB/s 1048576 bytes (1.0 MB) copied, 0.113278 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12693 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137208 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117813 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128804 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130147 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11211 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148093 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033859 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245367 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348552 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274599 s, 38.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276045 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0422954 s, 24.8 MB/s , 0.0149403 s, 70.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353499 s, 29.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0289998 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294266 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031844 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344327 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293923 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032448 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0428593 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0438819 s, 23.9 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (8s) == sanityn test 77e: check TBF NID nrs policy ============ 17:06:19 (1717016779) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.201.24@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.183658 s, 91.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113947 s, 92.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240465 s, 43.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216198 s, 48.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108514 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154985 s, 67.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329915 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301705 s, 34.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126667 s, 8.3 MB/s 1048576 bytes (1.0 MB) copied, 0.127009 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128243 s, 8.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148714 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.157999 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151933 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.170277 s, 6.2 MB/s 1048576 bytes (1.0 MB) copied, 0.148364 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.192189 s, 5.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6cdd800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313592 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0019328 s, 543 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336621 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00347588 s, 302 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00197631 s, 531 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0603831 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032576 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0621416 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0617803 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0515798 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0523392 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.065903 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0535725 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0499863 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0504007 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0507247 s, 20.7 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.176173 s, 95.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294518 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264515 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032842 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267221 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101656 s, 10.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10267 s, 10.2 MB/s 1048576 bytes (1.0 MB) copied, 0.100056 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104341 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0911087 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0811793 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0764345 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136414 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15322 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127575 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148422 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169631 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0459569 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0446544 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00213381 s, 491 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449588 s, 23.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0272158 s, 38.5 MB/s , 0.0462997 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236895 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037032 s, 28.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0164651 s, 63.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0470545 s, 22.3 MB/s , 0.0340381 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481632 s, 21.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0479735 s, 21.9 MB/s , 0.0123536 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00981282 s, 107 MB/s , 0.00965807 s, 109 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.152507 s, 110 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209468 s, 50.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0212444 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0378194 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0638142 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.089198 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0824474 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0794422 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0928698 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101095 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.085283 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100139 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0911845 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118842 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101351 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.114679 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111682 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020064 s, 52.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00874604 s, 120 MB/s , 0.0060784 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00625064 s, 168 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171082 s, 61.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135598 s, 77.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00860398 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00672696 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881159 s, 119 MB/s , 0.00910318 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200789 s, 52.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295981 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115341 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012718 s, 82.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138654 s, 75.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132674 s, 79.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.177829 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165065 s, 63.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156138 s, 67.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0656524 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0718022 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0668177 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0744232 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0791812 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0839749 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0855684 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0859716 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0952206 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0933179 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0969327 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0874463 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0968726 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109061 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00198833 s, 527 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0379784 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0533194 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345786 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0474199 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0442746 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326704 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0627691 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291643 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281194 s, 37.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277146 s, 37.8 MB/s , 0.00878071 s, 119 MB/s 1048576 bytes (1.0 MB) copied, 0.0248383 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230427 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221039 s, 47.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197438 s, 53.1 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (10s) == sanityn test 77f: check TBF JobID nrs policy ========== 17:06:29 (1717016789) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.160762 s, 104 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265002 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283841 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.099078 s, 10.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109875 s, 9.5 MB/s 1048576 bytes (1.0 MB) copied, 0.112698 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0974493 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0889693 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0973785 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118034 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120957 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121211 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.120248 s, 8.7 MB/s 1048576 bytes (1.0 MB) copied, 0.112376 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128313 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110739 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122386 s, 8.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131481 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12591 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126784 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128368 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13483 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130567 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13001 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133348 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123272 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136604 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126803 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115149 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12015 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.142584 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118185 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144184 s, 7.3 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.197541 s, 84.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135449 s, 77.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186946 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021482 s, 48.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0742614 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0813937 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0742257 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.089989 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0912474 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0730026 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0928145 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0957198 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0929504 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0980531 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0955989 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0957692 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105926 s, 9.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0145876 s, 71.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238889 s, 43.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00282107 s, 372 MB/s 1048576 bytes (1.0 MB) copied, 0.00420359 s, 249 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0148783 s, 70.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0200505 s, 52.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315262 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00218877 s, 479 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026872 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161419 s, 65.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273201 s, 38.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253868 s, 41.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135176 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00890537 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201736 s, 52.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014028 s, 74.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.15693 s, 107 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203528 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237891 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018154 s, 57.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248657 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271815 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0862696 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0953594 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0773751 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100965 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102185 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0951463 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0891368 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11805 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121129 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0978588 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102548 s, 10.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00305581 s, 343 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0676322 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0634807 s, 16.5 MB/s , 0.0444221 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0511186 s, 20.5 MB/s , 0.0553013 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00441695 s, 237 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0603964 s, 17.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0725565 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331212 s, 31.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0433864 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303363 s, 34.6 MB/s , 0.00513903 s, 204 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0283965 s, 36.9 MB/s , 0.0207668 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192714 s, 54.4 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.1729 s, 97.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258455 s, 40.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314281 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0590824 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0776248 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0889106 s, 11.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0997151 s, 10.5 MB/s 1048576 bytes (1.0 MB) copied, 0.106811 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104517 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106969 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113893 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.128798 s, 8.1 MB/s 1048576 bytes (1.0 MB) copied, 0.120771 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134234 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124445 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141527 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146672 s, 7.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286207 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198637 s, 52.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241012 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0298119 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251166 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0290459 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027793 s, 37.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158864 s, 66.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294006 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148471 s, 70.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307325 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015405 s, 68.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0226796 s, 46.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166721 s, 62.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177324 s, 59.1 MB/s , 0.0180594 s, 58.1 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (9s) == sanityn test 77g: Change TBF type directly ============ 17:06:38 (1717016798) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (5s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 17:06:43 (1717016803) oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg124-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg124-client: oleg124-server: ssh exited with exit code 2 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg124-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg124-client: oleg124-server: ssh exited with exit code 12 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg124-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg124-client: oleg124-server: ssh exited with exit code 12 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg124-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg124-client: oleg124-server: ssh exited with exit code 12 PASS 77h (5s) == sanityn test 77i: Change rank of TBF rule ============= 17:06:48 (1717016808) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (10s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 17:06:58 (1717016818) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.38534 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0457163 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0463263 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0497948 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0732814 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0966877 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110322 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108788 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.089108 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.081327 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108357 s, 9.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.138052 s, 7.6 MB/s 1048576 bytes (1.0 MB) copied, 0.142055 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160879 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.164876 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.199162 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.203194 s, 5.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418964 s, 25.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0336543 s, 31.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0341743 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264024 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287388 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04822 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310537 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259236 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281951 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393662 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317918 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336279 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359044 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372286 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0397389 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447262 s, 23.4 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.149 s, 17.1 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.502 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (56s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 17:07:55 (1717016875) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg124-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg124-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg124-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg124-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.24993 s, 13.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028929 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0505129 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0859353 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0869909 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0902496 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0803389 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10346 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118806 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12568 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143323 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178012 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.189581 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.187068 s, 5.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.19488 s, 5.4 MB/s 1048576 bytes (1.0 MB) copied, 0.201048 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.214367 s, 4.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0221225 s, 47.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0190567 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023415 s, 44.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265849 s, 39.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187214 s, 56.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243892 s, 43.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0268663 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246455 s, 42.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0269333 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291146 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307445 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0308135 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329024 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0327932 s, 32.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348554 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559318 s, 18.7 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8353 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8944 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg124-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg124-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg124-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg124-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.24727 s, 13.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0410451 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0327442 s, 32.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0674033 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0670156 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0919394 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0930217 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103153 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109917 s, 9.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.125353 s, 8.4 MB/s , 0.125485 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.163756 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.167593 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.163249 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171824 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.208607 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.216804 s, 4.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026189 s, 40.0 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.026861 s, 39.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0222171 s, 47.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213234 s, 49.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285848 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280686 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301408 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0244333 s, 42.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309528 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295243 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311189 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311088 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0322668 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350552 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344022 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361019 s, 29.0 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7981 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.909 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (135s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 17:10:10 (1717017010) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg124-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg124-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg124-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg124-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.24271 s, 13.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0383193 s, 27.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0388679 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0781051 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0827207 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0985443 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108948 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110638 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.114032 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.159117 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.161577 s, 6.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.202517 s, 5.2 MB/s , 0.204272 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.209984 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.236698 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.238415 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.246806 s, 4.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0502257 s, 20.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540595 s, 19.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0577567 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.057731 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0654744 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0504466 s, 20.8 MB/s , 0.062855 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0716642 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0734247 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0587635 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0592628 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0671078 s, 15.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0731185 s, 14.3 MB/s , 0.0704987 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0531836 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0699791 s, 15.0 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.84 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8781 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg124-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg124-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg124-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg124-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.519972 s, 32.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0502399 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0596344 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349501 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258132 s, 40.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567383 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0640368 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122129 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127811 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0546186 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12717 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125459 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0686383 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145844 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113897 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10576 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.189237 s, 5.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0290945 s, 36.0 MB/s , 0.0323089 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0338095 s, 31.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0364569 s, 28.8 MB/s , 0.0344905 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301718 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030488 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332591 s, 31.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0597849 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0577669 s, 18.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0622339 s, 16.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0568495 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0617187 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0601946 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0557598 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0652461 s, 16.1 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8337 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9215 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (135s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 17:12:25 (1717017145) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.375011 s, 44.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314238 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293908 s, 35.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.088297 s, 11.9 MB/s , 0.095588 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0958819 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103244 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112337 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120668 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122356 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123902 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13687 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134528 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.135929 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.138082 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.139714 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147845 s, 7.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309583 s, 33.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0243127 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0502035 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0609754 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0433379 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0435656 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00312777 s, 335 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312358 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353977 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00997495 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221005 s, 47.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361923 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366232 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385348 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0398338 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0419086 s, 25.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.99648 s, 15.0 MB/s Write runtime is 8 s, speed is 12.500000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81387 s, 10.7 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.201.24@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.201.24@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.256308 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0322473 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369641 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125251 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121932 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120467 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1283 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1438 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133593 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147903 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146576 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143248 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154281 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153517 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151269 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.157891 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.163459 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186656 s, 56.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332084 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131669 s, 79.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00476466 s, 220 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195586 s, 53.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123492 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00590105 s, 178 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0695233 s, 15.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0029356 s, 357 MB/s , 0.0371107 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387704 s, 27.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0279903 s, 37.5 MB/s , 0.0291092 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184603 s, 56.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135975 s, 77.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033116 s, 31.7 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.09295 s, 17.2 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81371 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.201.24@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.242313 s, 69.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261467 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140523 s, 74.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238023 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0443087 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106765 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0976005 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106278 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111617 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105057 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109259 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150156 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146268 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153537 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154672 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.158707 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.16224 s, 6.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0409104 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0600015 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00479074 s, 219 MB/s 1048576 bytes (1.0 MB) copied, 0.0829503 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269551 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0623576 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0927718 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0656571 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0756032 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.06523 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0684121 s, 15.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0676027 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188059 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0692358 s, 15.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0699921 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0743567 s, 14.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.77863 s, 18.1 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95455 s, 21.2 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.236308 s, 71.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207762 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213411 s, 49.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197296 s, 53.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0668155 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.072414 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0790383 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0815451 s, 12.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0740239 s, 14.2 MB/s , 0.0863669 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.093182 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0892527 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0972191 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103692 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0989693 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136778 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.142629 s, 7.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00229095 s, 458 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416754 s, 25.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0621346 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0493804 s, 21.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0376554 s, 27.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00364713 s, 288 MB/s 1048576 bytes (1.0 MB) copied, 0.0343048 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0454547 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0457366 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0246945 s, 42.5 MB/s , 0.0170543 s, 61.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152719 s, 68.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0479713 s, 21.9 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0487281 s, 21.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0303816 s, 34.5 MB/s , 0.0212793 s, 49.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg124-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.99436 s, 10.5 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81078 s, 10.7 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.74025 s, 15.6 MB/s Write runtime is 8 s, speed is 12.500000 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81017 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.24097 s, 69.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136921 s, 76.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130031 s, 80.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0457979 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0832887 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0750309 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0913679 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0876296 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0991328 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101934 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0912997 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10564 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112942 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102419 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110866 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102476 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122566 s, 8.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352283 s, 29.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0263445 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0383467 s, 27.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0360296 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264927 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209021 s, 50.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212448 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021727 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262059 s, 40.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283568 s, 37.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0319509 s, 32.8 MB/s , 0.0317259 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0320289 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345829 s, 30.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0377267 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0386925 s, 27.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.6317 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4827 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.220205 s, 76.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206932 s, 50.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235017 s, 44.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0300324 s, 34.9 MB/s 1048576 bytes (1.0 MB) copied, 0.033435 s, 31.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389535 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.049733 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0623567 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0912051 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0820714 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0978763 s, 10.7 MB/s , 0.0977724 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0753502 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0798861 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.116092 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113055 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0941373 s, 11.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188774 s, 55.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276147 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217614 s, 48.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263378 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0266242 s, 39.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248017 s, 42.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198651 s, 52.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206425 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026421 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230313 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254397 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348359 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0280719 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296432 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0308005 s, 34.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0310973 s, 33.7 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.22004 s, 16.9 MB/s Write runtime is 8 s, speed is 12.500000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.79602 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.262507 s, 63.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206862 s, 50.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128355 s, 81.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269825 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0819184 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0906884 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0963133 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0944227 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0940681 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10624 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110083 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115161 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118127 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127759 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120561 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151618 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.140414 s, 7.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177681 s, 59.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216164 s, 48.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0036684 s, 286 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203754 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269165 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204112 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540636 s, 19.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0430856 s, 24.3 MB/s , 0.00229161 s, 458 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432431 s, 24.2 MB/s , 0.0384746 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00995325 s, 105 MB/s , 0.0438643 s, 23.9 MB/s , 0.0178408 s, 58.8 MB/s , 0.0479759 s, 21.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0419923 s, 25.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.96909 s, 10.5 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80411 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.98666 s, 10.5 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.78038 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (361s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 17:18:27 (1717017507) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (4s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 17:18:31 (1717017511) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg124-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.83433 s, 273 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg124-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0227 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (51s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 17:19:23 (1717017563) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.200674 s, 83.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105038 s, 99.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108815 s, 96.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111708 s, 93.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00814665 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00732333 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00781036 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342499 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017769 s, 59.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00802207 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136716 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149158 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.14003 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160818 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162467 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147244 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.175625 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0434234 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0380889 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325315 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353167 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037552 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401695 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0403526 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0440403 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0483369 s, 21.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0469284 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0468459 s, 22.4 MB/s , 0.046711 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0491723 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0500544 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0531605 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0614016 s, 17.1 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.34604 s, 16.5 MB/s Write runtime is 8 s, speed is 12.500000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96383 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.375694 s, 44.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02297 s, 45.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351535 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0827161 s, 12.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.099942 s, 10.5 MB/s , 0.0982876 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11362 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117995 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119706 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124007 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132027 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133924 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134651 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15736 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155507 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.200638 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.20567 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00726873 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00572682 s, 183 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00362951 s, 289 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0619186 s, 16.9 MB/s , 0.0701529 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00178526 s, 587 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0463518 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0827594 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385004 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348415 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271593 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022893 s, 45.8 MB/s , 0.0162742 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135725 s, 77.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117537 s, 89.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101542 s, 103 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg124-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg124-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.71675 s, 15.6 MB/s Write runtime is 8 s, speed is 12.500000 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95321 s, 21.2 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (74s) == sanityn test 77o: Changing rank should not panic ====== 17:20:37 (1717017637) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (6s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 17:20:43 (1717017643) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (56s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 17:21:40 (1717017700) mds.MDS.mdt.nrs_policies=tbf oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg124-client: oleg124-server: ssh exited with exit code 36 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg124-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg124-client: oleg124-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (16s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 17:21:57 (1717017717) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 8143 kill md_thread xargs PASS 77r (43s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 17:22:39 (1717017759) oleg124-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device oleg124-server: error: set_param: setting 'ost/OSS/*/nrs_orr_quantum'='1': No such device pdsh@oleg124-client: oleg124-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (3s) == sanityn test 79: xattr: intent error ================== 17:22:42 (1717017762) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272506022 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-05-29 17:22:43.000000000 -0400 Modify: 2024-05-29 17:22:43.000000000 -0400 Change: 2024-05-29 17:22:43.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (14s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 17:22:56 (1717017776) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 17:22:57 (1717017777) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (2s) == sanityn test 81a: rename and stat under striped directory ========================================================== 17:22:59 (1717017779) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 17:23:00 (1717017780) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (2s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 17:23:02 (1717017782) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 17:23:03 (1717017783) - open/close 1201 (time 1717017795.67 total 10.01 last 120.03) - open/close 2369 (time 1717017805.67 total 20.01 last 116.78) total: 2500 open/close in 21.07 seconds: 118.63 ops/second snapshot_time 1717017847.376647375 secs.nsecs start_time 1717017783.771868935 secs.nsecs elapsed_time 63.604778440 secs.nsecs open 2505 samples [usecs] 145 8901 2106502 2610900476 close 2504 samples [usecs] 116 4054 774604 446341572 mknod 2501 samples [usecs] 337 8815 1876909 2107760819 unlink 2500 samples [usecs] 467 31484 2751891 6077117263 mkdir 2 samples [usecs] 1061 2641 3702 8100602 rmdir 2 samples [usecs] 3562 7486 11048 68728040 rename 2500 samples [usecs] 350 26925 7859495 43257818061 getattr 3763 samples [usecs] 8 2784 141545 56958077 parallel_rename_file 2500 samples [usecs] 350 26925 7859495 43257818061 crossdir_rename 2500 samples [usecs] 350 26925 7859495 43257818061 PASS 81d (67s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 17:24:10 (1717017850) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6949 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6949 PASS 82 (3s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 17:24:13 (1717017853) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 17:24:14 (1717017854) fail_loc=0x8000060b PASS 84 (9s) == sanityn test 85: Lustre API root cache race =========== 17:24:23 (1717017863) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1717017864 Finishing test test1 at 1717017866 PASS 85 (6s) == sanityn test 90: open/create and unlink striped directory ========================================================== 17:24:29 (1717017869) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (2s) == sanityn test 91: chmod and unlink striped directory === 17:24:31 (1717017871) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (2s) == sanityn test 92: create remote directory under orphan directory ========================================================== 17:24:33 (1717017873) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (1s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 17:24:35 (1717017875) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5321 0x14c9 0x280000400 0 5370 0x14fa 0x240000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5322 0x14ca 0x280000400 0 5371 0x14fb 0x240000400 rc1=0 and rc2=0 PASS 93 (10s) == sanityn test 94: signal vs CP callback race =========== 17:24:45 (1717017885) osc.lustre-OST0000-osc-ffff8800b6229800.idle_timeout=0 osc.lustre-OST0000-osc-ffff8800b6cdd800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b6229800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b6cdd800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.225716 s, 36.3 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.02369 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5739: 24584 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.069986 s, 58.5 kB/s osc.lustre-OST0000-osc-ffff8800b6229800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b6cdd800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6229800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cdd800.idle_timeout=debug PASS 94 (12s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 17:24:57 (1717017897) llite.lustre-ffff8800b6229800.fast_read=0 llite.lustre-ffff8800b6cdd800.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0311698 s, 67.3 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff8800b6229800.fast_read=1 llite.lustre-ffff8800b6cdd800.fast_read=1 PASS 95a (21s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 17:25:18 (1717017918) llite.lustre-ffff8800b6229800.fast_read=0 llite.lustre-ffff8800b6cdd800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00819342 s, 1.5 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800b6229800.fast_read=1 llite.lustre-ffff8800b6cdd800.fast_read=1 PASS 95b (9s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 17:25:27 (1717017927) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (2s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 17:25:29 (1717017929) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00503251 s, 814 kB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (3s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 17:25:33 (1717017933) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0445702 s, 47.1 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (4s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 17:25:36 (1717017936) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0407596 s, 51.5 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (3s) == sanityn test 100e: DoM: read on open and file size ==== 17:25:39 (1717017939) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00426643 s, 2.8 MB/s PASS 100e (4s) == sanityn test 101a: Discard DoM data on unlink ========= 17:25:43 (1717017943) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00104134 s, 3.9 MB/s PASS 101a (3s) == sanityn test 101b: Discard DoM data on rename ========= 17:25:46 (1717017946) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00110533 s, 3.7 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 17:25:50 (1717017950) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00162019 s, 2.5 MB/s PASS 101c (4s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 17:25:55 (1717017955) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1717017956 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1717017959 Finishing test test23 at 1717017959 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 17:26:03 (1717017963) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (2s) == sanityn test 105: Glimpse and lock cancel race ======== 17:26:05 (1717017965) fail_loc=0x416 PASS 105 (28s) == sanityn test 106a: Verify the btime via statx() ======= 17:26:33 (1717017993) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (2s) == sanityn test 106b: Glimpse RPCs test for statx ======== 17:26:35 (1717017995) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 17:26:36 (1717017996) SKIP: sanityn test_106c statx() only test SKIP 106c (2s) == sanityn test 107a: Basic grouplock conflict =========== 17:26:38 (1717017998) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.110548 s, 94.9 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5378 0x1502 0x240000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 17:26:43 (1717018003) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.107454 s, 97.6 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5328 0x14d0 0x280000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6949 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) == sanityn test 108a: lseek: parallel updates ============ 17:26:52 (1717018012) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00376994 s, 2.7 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.32108 s, 1.9 MB/s PASS 108a (7s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 17:27:00 (1717018020) 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 4 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 6 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 12 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 13 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 24 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 25 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 26 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 29 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 35 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 36 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 38 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 39 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 42 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 48 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 50 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre 192.168.201.124@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.124@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg124-client.virtnet /mnt/lustre (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg124-server' oleg124-server: oleg124-server.virtnet: executing load_modules_local oleg124-server: Loading modules from /home/green/git/lustre-release/lustre oleg124-server: detected 4 online CPUs by sysfs oleg124-server: Force libcfs to create 2 CPU partitions oleg124-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre Starting client: oleg124-client.virtnet: -o user_xattr,flock oleg124-server@tcp:/lustre /mnt/lustre2 PASS 109 (559s) == sanityn test 110: do not grant another lock on resend ========================================================== 17:36:19 (1717018579) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-05-29 17:36:20.000000000 -0400 Modify: 2024-05-29 17:36:20.000000000 -0400 Change: 2024-05-29 17:36:20.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg124-client.virtnet oleg124-client.virtnet PASS 110 (65s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 17:37:24 (1717018644) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (2s) == sanityn test 112: update max-inherit in default LMV === 17:37:26 (1717018646) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (2s) == sanityn test 113: check servers of specified fs ======= 17:37:28 (1717018648) lustre-OST0000-osc-ffff8800b61cf800 active. lustre-OST0001-osc-ffff8800b61cf800 active. lustre-OST0000-osc-ffff8800b61cf800 active. lustre-OST0001-osc-ffff8800b61cf800 active. MGC192.168.201.124@tcp active. PASS 113 (3s) == sanityn test 114: implicit default LMV inherit ======== 17:37:31 (1717018651) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (1s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 17:37:32 (1717018652) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (2s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 17:37:34 (1717018654) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (1s) cleanup: ====================================================== == sanityn test complete, duration 5814 sec ============== 17:37:36 (1717018656) === sanityn: start cleanup 17:37:37 (1717018657) === Stopping clients: oleg124-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg124-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 17:39:56 (1717018796) ===