-----============= acceptance-small: sanityn ============----- Wed Apr 30 23:18:53 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg205-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 23:19:02 (1746069542) === Starting client oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Started clients oleg205-client.virtnet: 192.168.202.105@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) oleg205-client.virtnet: executing check_config_client /mnt/lustre oleg205-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg205-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a94af800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b3a5c000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a94af800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3a5c000.idle_timeout=debug disable quota as required oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 23:19:17 (1746069557) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242751 s, 43.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7041] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 23:19:18 (1746069558) PASS 0 (3s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 23:19:21 (1746069561) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 23:19:23 (1746069563) -rw-r--r-- 1 root root 0 Apr 30 23:19 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (3s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 23:19:26 (1746069566) -rw-r--r-- 1 root root 0 Apr 30 23:19 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 23:19:28 (1746069568) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 23:19:30 (1746069570) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (3s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 23:19:33 (1746069573) total 1 -rwxrwxrwx 1 root root 0 Apr 30 23:19 f2a -rwxrwxrwx 1 root root 0 Apr 30 23:19 f2b total 1 -rwxrwxrwx 1 root root 0 Apr 30 23:19 f2a -rwxrwxrwx 1 root root 0 Apr 30 23:19 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00528939 s, 96.8 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 23:19:35 (1746069575) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 23:19:36 (1746069576) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.257175 s, 8.2 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (4s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 23:19:40 (1746069580) PASS 3 (3s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 23:19:43 (1746069583) PASS 4 (3s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 23:19:46 (1746069586) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (3s) == sanityn test 6: remove of open file on other node ============================================================================ 23:19:49 (1746069589) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (2s) == sanityn test 7: remove of open directory on other node ======================================================================= 23:19:51 (1746069591) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 23:19:54 (1746069594) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 23:19:56 (1746069596) PASS 9a (3s) == sanityn test 9b: append to striped sparse file ======== 23:19:59 (1746069599) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236964 s, 44.3 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0186546 s, 0.2 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 23:20:01 (1746069601) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0045941 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00393401 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00546337 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00518219 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00440343 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00540835 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00647673 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0057505 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00501654 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00334179 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00365081 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00462024 s, 0.2 kB/s PASS 10a (3s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 23:20:04 (1746069604) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00951242 s, 323 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0276963 s, 148 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000241044 s, 12.7 MB/s PASS 10b (3s) == sanityn test 11: execution of file opened for write should return error ============================================================== 23:20:07 (1746069607) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (3s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 23:20:10 (1746069610) warning: '-runtime' deprecated, use '-t runtime' instead - link 897 (time 1746069621.20 total 10.00 last 89.66) - link 1942 (time 1746069631.20 total 20.00 last 104.50) - link 2945 (time 1746069641.21 total 30.01 last 100.25) - link 3763 (time 1746069651.21 total 40.01 last 81.76) - link 4642 (time 1746069661.21 total 50.02 last 87.87) - link 5680 (time 1746069671.22 total 60.02 last 103.76) - link 6583 (time 1746069681.23 total 70.03 last 90.18) - link 7395 (time 1746069691.23 total 80.04 last 81.17) - link 8454 (time 1746069701.24 total 90.04 last 105.84) total: 9643 link in 100.00 seconds: 96.43 ops/second using seed 4278664590 running for 100 seconds - stat 10000 (time 1746069619 ; total 7 ; last 7) - stat 20000 (time 1746069625 ; total 13 ; last 6) - stat 30000 (time 1746069631 ; total 19 ; last 6) - stat 40000 (time 1746069638 ; total 26 ; last 7) - stat 50000 (time 1746069645 ; total 33 ; last 7) - stat 60000 (time 1746069652 ; total 40 ; last 7) - stat 70000 (time 1746069659 ; total 47 ; last 7) - stat 77917 (time 1746069670 ; total 58 ; last 11) - stat 80000 (time 1746069676 ; total 64 ; last 6) - stat 82783 (time 1746069687 ; total 75 ; last 11) - stat 86241 (time 1746069698 ; total 86 ; last 11) - stat 90000 (time 1746069708 ; total 96 ; last 10) total: 92186 stats in 100 seconds: 921.859985 stats/second - unlinked 0 (time 1746069662 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile9643) error: No such file or directory total: 9642 unlinks in 96 seconds: 100.437500 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (22076) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (22078) - No such process PASS 12 (150s) == sanityn test 13: test directory page revocation ======= 23:22:40 (1746069760) f13 f13 PASS 13 (3s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 23:22:43 (1746069763) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4880: 23479 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (3s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 23:22:46 (1746069766) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4880: 24114 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (3s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 23:22:49 (1746069769) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 24748 Terminated $DIR1/$tdir/sleep 60 PASS 14b (3s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 23:22:52 (1746069772) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 25383 Terminated $DIR1/$tdir/sleep 60 PASS 14c (3s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 23:22:55 (1746069775) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 26019 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 23:22:58 (1746069778) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7521280 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7521280kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (19s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 23:23:17 (1746069797) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.329317 s, 25.5 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.285724 s, 29.4 MB/s Chance of close/open is 1 in 50 Seed set to 9799 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x83b8b0 000004[0] 1746069800.339133 trunc from 00000000 to 0x83b8af (0x83b8b0 bytes) 000005[1] 1746069800.391132 mapwrite 0x569402 thru 0x573f3b (0xab3a bytes) 000008[0] 1746069800.526747 read 0x666749 thru 0x66ec55 (0x850d bytes) 000010[1] 1746069800.571276 read 0x1224ce thru 0x1301d0 (0xdd03 bytes) 000012[1] 1746069800.592680 trunc from 0x83b8b0 to 0x06a27c (0x7d1633 bytes) 000014[1] 1746069800.620849 mapwrite 0x78ea28 thru 0x794710 (0x5ce9 bytes) 000015[1] 1746069800.713254 mapwrite 0x04a4ce thru 0x04f25f (0x4d92 bytes) 000017[1] 1746069800.781312 mapwrite 0x475bae thru 0x481169 (0xb5bc bytes) 000018[0] 1746069800.857911 mapread 0x0b7731 thru 0x0c2b7f (0xb44f bytes) 000019[1] 1746069800.897269 mapread 0x39503b thru 0x39f3c3 (0xa389 bytes) 000020[0] 1746069800.910851 read 0x086e2d thru 0x0891c0 (0x2394 bytes) 000022[0] 1746069800.933821 write 0x45afda thru 0x4699c7 (0xe9ee bytes) 000024[1] 1746069800.960448 mapread 0x29bc24 thru 0x29fbb5 (0x3f92 bytes) 000027[1] 1746069801.091951 mapread 0x213bd7 thru 0x21f057 (0xb481 bytes) 000031[0] 1746069801.140311 read 0x250dd0 thru 0x257585 (0x67b6 bytes) 000032[1] 1746069801.147209 mapread 0x02c922 thru 0x02d3be (0xa9d bytes) 000033[1] 1746069801.157769 read 0x46f770 thru 0x476f08 (0x7799 bytes) 000034[0] 1746069801.185187 mapwrite 0x18e4f7 thru 0x19db4a (0xf654 bytes) 000035[1] 1746069801.271454 trunc from 0x794711 to 0x1be8e9 (0x5d5e27 bytes) 000037[1] 1746069801.323865 mapread 0x04b633 thru 0x05a746 (0xf114 bytes) 000038[1] 1746069801.350808 mapread 0x06b0d3 thru 0x077788 (0xc6b6 bytes) 000041[1] 1746069801.398934 read 0x129d48 thru 0x135180 (0xb439 bytes) 000044[1] 1746069801.449186 mapwrite 0x65e13e thru 0x65e389 (0x24c bytes) 000045[0] 1746069801.559009 read 0x4ae7a6 thru 0x4bafc8 (0xc823 bytes) 000046[0] 1746069801.579264 write 0x0a662f thru 0x0aaf31 (0x4903 bytes) 000047[0] 1746069801.595625 write 0x22b3e9 thru 0x2329fb (0x7613 bytes) 000048[0] 1746069801.602498 trunc from 0x65e38a to 0x06b6ca (0x5f2cbf bytes) 000050[1] 1746069801.624575 trunc from 0x06b6cb to 0x05d219 (0xe4b1 bytes) 000053[0] 1746069801.689904 read 0x022db8 thru 0x030d7c (0xdfc5 bytes) 000055[0] 1746069801.728936 write 0x6cb497 thru 0x6d4e1b (0x9985 bytes) 000057[1] 1746069801.739099 trunc from 0x6d4e1c to 0x469248 (0x26bbd3 bytes) 000059[0] 1746069801.775389 mapwrite 0x25a0ca thru 0x269d73 (0xfcaa bytes) 000060[1] 1746069801.910614 mapread 0x42a694 thru 0x43a03d (0xf9aa bytes) 000063[0] 1746069801.960311 trunc from 0x469249 to 0x50358a (0x9a342 bytes) 000066[1] 1746069802.012681 read 0x05f1ae thru 0x06a764 (0xb5b7 bytes) 000069[0] 1746069802.048317 write 0x724317 thru 0x7319e2 (0xd6cc bytes) 000070[0] 1746069802.049687 read 0x6ad40d thru 0x6af2e8 (0x1edc bytes) 000073[0] 1746069802.061048 mapwrite 0x95778d thru 0x95b92d (0x41a1 bytes) 000074[1] 1746069802.175084 mapwrite 0x65d39d thru 0x66697d (0x95e1 bytes) 000075[1] 1746069802.294905 mapread 0x8443ec thru 0x8528b0 (0xe4c5 bytes) 000076[1] 1746069802.344305 mapwrite 0x0d8a6c thru 0x0e07d4 (0x7d69 bytes) 000081[1] 1746069802.484550 trunc from 0x95b92e to 0x5b3464 (0x3a84c9 bytes) 000088[0] 1746069802.574123 trunc from 0x5b3465 to 0x2465d1 (0x36ce93 bytes) 000090[1] 1746069802.647941 mapread 0x18ae73 thru 0x199588 (0xe716 bytes) 000093[1] 1746069802.728575 write 0x19ccf7 thru 0x1ac77b (0xfa85 bytes) 000095[1] 1746069802.808364 mapwrite 0x935c67 thru 0x93ed3a (0x90d4 bytes) 000096[0] 1746069802.935558 trunc from 0x93ed3b to 0x78de21 (0x1b0f19 bytes) 000097[0] 1746069802.964603 mapread 0x666792 thru 0x670a7c (0xa2eb bytes) 000098[0] 1746069802.995533 mapwrite 0x9c0c9f thru 0x9ca84b (0x9bad bytes) 000101[0] 1746069803.078397 read 0x069464 thru 0x077064 (0xdc01 bytes) 000103[1] 1746069803.098464 read 0x82e184 thru 0x83c335 (0xe1b2 bytes) 000106[1] 1746069803.127729 read 0x24a81c thru 0x2516cd (0x6eb2 bytes) 000107[1] 1746069803.138715 read 0x6d8605 thru 0x6d9b36 (0x1532 bytes) 000108[1] 1746069803.159853 mapwrite 0x357ba2 thru 0x363bd7 (0xc036 bytes) 000110[0] 1746069803.267830 mapwrite 0x5ea2f6 thru 0x5f591b (0xb626 bytes) 000112[0] 1746069803.429973 trunc from 0x9ca84c to 0x3ec436 (0x5de415 bytes) 000113[1] 1746069803.468711 trunc from 0x3ec437 to 0x653786 (0x267350 bytes) 000116[1] 1746069803.525685 write 0x5bddc6 thru 0x5c4d4c (0x6f87 bytes) 000117[1] 1746069803.549038 write 0x84d1f4 thru 0x84ed92 (0x1b9f bytes) 000118[0] 1746069803.552108 mapread 0x1e7434 thru 0x1efe9c (0x8a69 bytes) 000120[1] 1746069803.585631 write 0x01a396 thru 0x028807 (0xe472 bytes) 000125[0] 1746069803.681314 write 0x0ab820 thru 0x0af77d (0x3f5e bytes) 000129[0] 1746069803.750522 read 0x789f97 thru 0x790da1 (0x6e0b bytes) 000130[1] 1746069803.792961 read 0x409200 thru 0x412607 (0x9408 bytes) 000132[0] 1746069803.802099 mapwrite 0x15d012 thru 0x16a144 (0xd133 bytes) 000134[0] 1746069803.905012 read 0x328a78 thru 0x336e0f (0xe398 bytes) 000142[1] 1746069803.966416 read 0x1af21f thru 0x1ba6df (0xb4c1 bytes) 000143[0] 1746069803.978808 read 0x3b3ed5 thru 0x3c2637 (0xe763 bytes) 000144[0] 1746069803.994621 mapwrite 0x8f28a8 thru 0x8f5140 (0x2899 bytes) 000148[0] 1746069804.087986 mapread 0x359d3b thru 0x35dfc2 (0x4288 bytes) 000149[1] 1746069804.127600 trunc from 0x8f5141 to 0x0e9de2 (0x80b35e bytes) 000150[1] 1746069804.158116 write 0x92e36d thru 0x939511 (0xb1a5 bytes) 000153[1] 1746069804.173961 mapread 0x79721a thru 0x7a66cf (0xf4b6 bytes) 000154[1] 1746069804.201097 write 0x4c50a9 thru 0x4c8398 (0x32f0 bytes) 000156[0] 1746069804.228697 read 0x7b5c81 thru 0x7ba1c9 (0x4549 bytes) 000159[1] 1746069804.272224 read 0x6f22df thru 0x6f2784 (0x4a6 bytes) 000162[0] 1746069804.276828 mapread 0x8d5e3a thru 0x8d9263 (0x342a bytes) 000165[0] 1746069804.309190 mapwrite 0x7958d7 thru 0x79634c (0xa76 bytes) 000167[0] 1746069804.393404 write 0x4bfeef thru 0x4c96dc (0x97ee bytes) 000170[1] 1746069804.410859 read 0x06068c thru 0x06cedf (0xc854 bytes) 000171[1] 1746069804.430279 write 0x5ff700 thru 0x604ea1 (0x57a2 bytes) 000173[0] 1746069804.470094 write 0x7b390c thru 0x7b7b2b (0x4220 bytes) 000174[0] 1746069804.514271 trunc from 0x939512 to 0x510eb4 (0x42865d bytes) 000175[0] 1746069804.541015 mapwrite 0x58a822 thru 0x59a27a (0xfa59 bytes) 000177[1] 1746069804.645070 mapwrite 0x6ee84e thru 0x6f02c0 (0x1a73 bytes) 000178[1] 1746069804.725649 mapread 0x1a9ecf thru 0x1b1802 (0x7934 bytes) 000180[1] 1746069804.771095 mapwrite 0x13ed95 thru 0x142390 (0x35fc bytes) truncating to largest ever: 0x97964d 000182[0] 1746069804.852197 trunc from 0x6f02c1 to 0x97964c (0x28938c bytes) 000183[0] 1746069804.880919 trunc from 0x97964d to 0x8360c0 (0x14358c bytes) 000185[1] 1746069804.891077 trunc from 0x8360c1 to 0x429d30 (0x40c390 bytes) 000186[1] 1746069804.923792 mapread 0x084936 thru 0x0871ec (0x28b7 bytes) 000188[1] 1746069804.949159 write 0x667865 thru 0x66be5b (0x45f7 bytes) 000189[1] 1746069804.967816 write 0x9c30a1 thru 0x9cb4c6 (0x8426 bytes) 000191[1] 1746069805.000109 write 0x8628bf thru 0x867c0b (0x534d bytes) 000193[1] 1746069805.018670 mapwrite 0x5c51e6 thru 0x5d140b (0xc226 bytes) 000196[1] 1746069805.078417 write 0x5eef08 thru 0x5f6495 (0x758e bytes) 000202[0] 1746069805.108536 read 0x4ce697 thru 0x4d331f (0x4c89 bytes) 000203[0] 1746069805.129546 mapwrite 0x0628a1 thru 0x06dd6a (0xb4ca bytes) 000206[0] 1746069805.258493 write 0x50ba82 thru 0x515319 (0x9898 bytes) 000209[0] 1746069805.286212 read 0x89dd48 thru 0x8ab99e (0xdc57 bytes) 000211[1] 1746069805.300361 read 0x5890e8 thru 0x593d20 (0xac39 bytes) 000212[0] 1746069805.336855 trunc from 0x9cb4c7 to 0x46dfc4 (0x55d502 bytes) 000214[0] 1746069805.370460 write 0x765b76 thru 0x76cf79 (0x7404 bytes) 000216[1] 1746069805.383310 mapwrite 0x5fb178 thru 0x6002b8 (0x5141 bytes) 000218[1] 1746069805.497227 mapwrite 0x535b6b thru 0x53bef0 (0x6386 bytes) 000219[1] 1746069805.563037 mapread 0x6fe346 thru 0x70b028 (0xcce3 bytes) 000220[1] 1746069805.624728 trunc from 0x76cf7a to 0x21587b (0x5576fe bytes) 000222[1] 1746069805.644747 mapwrite 0x270425 thru 0x279e96 (0x9a72 bytes) 000224[0] 1746069805.773727 trunc from 0x279e97 to 0x0df698 (0x19a7fe bytes) 000225[0] 1746069805.813192 mapread 0x0a4044 thru 0x0adf47 (0x9f04 bytes) 000226[1] 1746069805.844058 mapread 0x06ce93 thru 0x06dca8 (0xe16 bytes) 000228[0] 1746069805.886295 trunc from 0x0df699 to 0x0057e7 (0xd9eb1 bytes) 000232[1] 1746069805.973290 mapread 0x001e6d thru 0x0057e7 (0x397b bytes) 000235[1] 1746069806.001255 read 0x004e79 thru 0x0057e7 (0x96f bytes) 000238[1] 1746069806.011614 write 0x368d5b thru 0x36adab (0x2051 bytes) 000239[1] 1746069806.035527 write 0x8ad5e8 thru 0x8b6148 (0x8b61 bytes) 000240[1] 1746069806.053260 write 0x8445ed thru 0x84a5cb (0x5fdf bytes) 000241[0] 1746069806.096781 read 0x842132 thru 0x842aea (0x9b9 bytes) 000242[1] 1746069806.117634 write 0x85ede5 thru 0x86c34c (0xd568 bytes) 000243[0] 1746069806.156604 read 0x0297ae thru 0x02ff2b (0x677e bytes) 000245[0] 1746069806.196836 mapwrite 0x1a5fbb thru 0x1a7734 (0x177a bytes) 000246[0] 1746069806.294165 write 0x1a15be thru 0x1a8ac4 (0x7507 bytes) 000247[0] 1746069806.295648 trunc from 0x8b6149 to 0x7af5b3 (0x106b95 bytes) 000250[1] 1746069806.328657 mapread 0x3d3060 thru 0x3dc1e7 (0x9188 bytes) 000252[1] 1746069806.397504 read 0x54e0ec thru 0x55b4ad (0xd3c2 bytes) 000254[0] 1746069806.424092 read 0x06fc9c thru 0x07798b (0x7cf0 bytes) 000257[0] 1746069806.430575 trunc from 0x7af5b4 to 0x81699c (0x673e9 bytes) 000258[1] 1746069806.476247 read 0x40ccef thru 0x418460 (0xb772 bytes) 000259[0] 1746069806.495600 mapwrite 0x9df391 thru 0x9e50bb (0x5d2b bytes) 000260[0] 1746069806.599810 read 0x6a0aae thru 0x6af4f3 (0xea46 bytes) 000261[0] 1746069806.616141 mapread 0x762dff thru 0x76d6d6 (0xa8d8 bytes) 000262[1] 1746069806.648557 mapread 0x31bbfa thru 0x32a41c (0xe823 bytes) 000267[1] 1746069806.716702 mapwrite 0x2792a6 thru 0x27a34a (0x10a5 bytes) 000270[1] 1746069806.824215 read 0x9888e8 thru 0x993cc6 (0xb3df bytes) 000271[1] 1746069806.840532 mapread 0x415894 thru 0x421aef (0xc25c bytes) 000272[0] 1746069806.888502 read 0x6c4ad6 thru 0x6cdb7e (0x90a9 bytes) 000274[1] 1746069806.905463 mapwrite 0x40c919 thru 0x417c36 (0xb31e bytes) 000275[0] 1746069807.000169 trunc from 0x9e50bc to 0x29e59c (0x746b1f bytes) 000276[0] 1746069807.030988 trunc from 0x29e59d to 0x125cec (0x1788b0 bytes) 000277[1] 1746069807.058895 mapwrite 0x7ea86d thru 0x7f22e7 (0x7a7b bytes) 000278[1] 1746069807.179895 read 0x6210a9 thru 0x625754 (0x46ac bytes) 000279[1] 1746069807.197217 read 0x595b2c thru 0x5a23bc (0xc891 bytes) 000282[0] 1746069807.221455 mapread 0x15dc5f thru 0x15dd62 (0x104 bytes) 000285[0] 1746069807.276502 write 0x0c7a00 thru 0x0d0fea (0x95eb bytes) 000286[0] 1746069807.313435 read 0x0354f9 thru 0x0389c3 (0x34cb bytes) 000288[0] 1746069807.338243 mapread 0x490414 thru 0x49f98d (0xf57a bytes) 000291[0] 1746069807.418529 write 0x4ee6c5 thru 0x4f5235 (0x6b71 bytes) 000292[0] 1746069807.437599 mapread 0x3e74f7 thru 0x3ee4c9 (0x6fd3 bytes) 000293[1] 1746069807.451915 trunc from 0x7f22e8 to 0x44d092 (0x3a5255 bytes) 000294[1] 1746069807.483890 mapread 0x3a1ea0 thru 0x3ae8ee (0xca4f bytes) 000295[0] 1746069807.499063 read 0x43b62f thru 0x44096d (0x533f bytes) 000296[0] 1746069807.516379 mapwrite 0x566ca9 thru 0x5755e4 (0xe93c bytes) 000298[1] 1746069807.641319 mapwrite 0x426824 thru 0x42ec39 (0x8416 bytes) 000302[1] 1746069807.767719 write 0x9deac5 thru 0x9dec2a (0x166 bytes) 000305[0] 1746069807.811950 mapread 0x2679a2 thru 0x267d57 (0x3b6 bytes) 000306[0] 1746069807.841183 read 0x3d173d thru 0x3d8786 (0x704a bytes) 000307[1] 1746069807.853955 mapwrite 0x47bafe thru 0x484320 (0x8823 bytes) 000308[0] 1746069807.901065 mapread 0x097315 thru 0x0993be (0x20aa bytes) 000309[0] 1746069807.917435 read 0x2dcd72 thru 0x2e68ce (0x9b5d bytes) 000310[1] 1746069807.931769 trunc from 0x9dec2b to 0x215b7e (0x7c90ac bytes) 000311[1] 1746069807.961955 mapwrite 0x8f4e36 thru 0x902bb2 (0xdd7d bytes) 000312[1] 1746069808.064801 read 0x41c473 thru 0x41f10e (0x2c9c bytes) truncating to largest ever: 0x99593d 000314[1] 1746069808.074565 trunc from 0x902bb3 to 0x99593c (0x92d8a bytes) 000319[1] 1746069808.121907 read 0x97bb94 thru 0x97d51e (0x198b bytes) 000320[1] 1746069808.127004 write 0x79e68c thru 0x7a66d4 (0x8049 bytes) 000321[1] 1746069808.135968 read 0x63c990 thru 0x64c16a (0xf7db bytes) 000322[0] 1746069808.156547 write 0x58b967 thru 0x58cf0f (0x15a9 bytes) 000323[0] 1746069808.192527 trunc from 0x99593d to 0x3bb21a (0x5da722 bytes) 000324[0] 1746069808.228733 mapread 0x131d3a thru 0x13d5a0 (0xb867 bytes) 000325[1] 1746069808.255841 read 0x32499f thru 0x32c385 (0x79e7 bytes) 000326[1] 1746069808.341384 trunc from 0x3bb21b to 0x68cc57 (0x2d1a3d bytes) 000329[1] 1746069808.402742 write 0x344f22 thru 0x3469da (0x1ab9 bytes) 000330[0] 1746069808.424489 mapwrite 0x030c41 thru 0x03a929 (0x9ce9 bytes) 000331[0] 1746069808.512451 mapread 0x4e1338 thru 0x4e4566 (0x322f bytes) 000333[0] 1746069808.579845 mapwrite 0x486cb2 thru 0x48cba6 (0x5ef5 bytes) 000335[1] 1746069808.651284 trunc from 0x68cc58 to 0x4a056f (0x1ec6e8 bytes) 000337[1] 1746069808.671923 trunc from 0x4a0570 to 0x117f5a (0x388615 bytes) 000340[1] 1746069808.693160 write 0x69e51d thru 0x6a6bcd (0x86b1 bytes) 000342[0] 1746069808.707812 read 0x30cb42 thru 0x3188c2 (0xbd81 bytes) 000343[1] 1746069808.754525 trunc from 0x6a6bce to 0x00553d (0x6a1690 bytes) 000344[0] 1746069808.773515 read 0x003e3a thru 0x00553d (0x1704 bytes) 000347[1] 1746069808.801886 mapread 0x000737 thru 0x00553d (0x4e07 bytes) 000348[0] 1746069808.836426 mapread 0x004e08 thru 0x00553d (0x736 bytes) 000349[1] 1746069808.848656 mapwrite 0x38e1b5 thru 0x3995f7 (0xb443 bytes) 000351[1] 1746069808.963949 mapwrite 0x6bcf95 thru 0x6c99ea (0xca56 bytes) 000352[1] 1746069809.058463 mapwrite 0x4fdc53 thru 0x505a11 (0x7dbf bytes) 000355[0] 1746069809.139033 write 0x88659f thru 0x88724e (0xcb0 bytes) 000356[0] 1746069809.155787 read 0x76f995 thru 0x7747b8 (0x4e24 bytes) 000358[1] 1746069809.194408 write 0x6014d6 thru 0x6017db (0x306 bytes) 000363[1] 1746069809.256574 write 0x91eed0 thru 0x92e512 (0xf643 bytes) 000365[1] 1746069809.277149 read 0x1b6a27 thru 0x1c3e67 (0xd441 bytes) 000367[1] 1746069809.291438 write 0x3de7da thru 0x3e924d (0xaa74 bytes) 000368[1] 1746069809.297189 read 0x810189 thru 0x815f06 (0x5d7e bytes) 000369[1] 1746069809.302794 mapwrite 0x507745 thru 0x50c32a (0x4be6 bytes) 000370[0] 1746069809.362242 read 0x7534ac thru 0x75510d (0x1c62 bytes) 000372[0] 1746069809.400473 mapread 0x55479e thru 0x55728a (0x2aed bytes) 000373[1] 1746069809.418675 mapwrite 0x01fac9 thru 0x028303 (0x883b bytes) 000374[0] 1746069809.500896 mapwrite 0x3195b7 thru 0x327b67 (0xe5b1 bytes) 000378[0] 1746069809.596140 mapread 0x230eda thru 0x2384ee (0x7615 bytes) 000381[0] 1746069809.601079 mapread 0x818c44 thru 0x819d27 (0x10e4 bytes) 000383[0] 1746069809.608381 mapwrite 0x8b84ab thru 0x8c5990 (0xd4e6 bytes) 000386[0] 1746069809.703891 mapwrite 0x9741ac thru 0x97d42b (0x9280 bytes) 000388[1] 1746069809.776741 trunc from 0x97d42c to 0x0f2f6b (0x88a4c0 bytes) 000390[0] 1746069809.811082 write 0x39e911 thru 0x39f6f8 (0xde8 bytes) 000391[1] 1746069809.825714 write 0x945d52 thru 0x94ebca (0x8e79 bytes) 000393[1] 1746069809.847750 mapread 0x00b1a8 thru 0x019a58 (0xe8b1 bytes) 000394[0] 1746069809.862434 mapwrite 0x39b70f thru 0x39ec3e (0x3530 bytes) 000396[0] 1746069809.952503 mapwrite 0x40b130 thru 0x418786 (0xd657 bytes) 000397[0] 1746069810.052831 trunc from 0x94ebcb to 0x77b6a8 (0x1d3522 bytes) 000398[1] 1746069810.066319 write 0x853f49 thru 0x858151 (0x4209 bytes) 000399[0] 1746069810.084572 mapread 0x4077b8 thru 0x40ab07 (0x3350 bytes) 000400[0] 1746069810.099089 mapwrite 0x7f76b8 thru 0x804ac0 (0xd409 bytes) 000403[1] 1746069810.318276 mapread 0x329501 thru 0x331aee (0x85ee bytes) 000406[0] 1746069810.365171 trunc from 0x858152 to 0x8f2dca (0x9ac79 bytes) 000408[0] 1746069810.403371 trunc from 0x8f2dcb to 0x5b9c82 (0x339148 bytes) 000409[0] 1746069810.431881 trunc from 0x5b9c83 to 0x108677 (0x4b160b bytes) 000415[1] 1746069810.469288 trunc from 0x108678 to 0x5a6225 (0x49dbae bytes) 000417[0] 1746069810.510330 mapread 0x24431c thru 0x24f4ca (0xb1af bytes) 000418[1] 1746069810.549439 write 0x1f3805 thru 0x1fb41a (0x7c16 bytes) 000421[1] 1746069810.574861 write 0x0e2b80 thru 0x0e98a1 (0x6d22 bytes) 000424[1] 1746069810.608165 read 0x3ebc36 thru 0x3f070c (0x4ad7 bytes) 000425[0] 1746069810.629861 read 0x23dd1a thru 0x24b0d7 (0xd3be bytes) 000426[1] 1746069810.668669 trunc from 0x5a6226 to 0x24a01c (0x35c209 bytes) 000427[0] 1746069810.698987 read 0x0235e4 thru 0x024108 (0xb25 bytes) 000430[0] 1746069810.758125 mapwrite 0x6fac07 thru 0x6fe1a0 (0x359a bytes) 000433[1] 1746069810.897465 write 0x4f6e46 thru 0x4fddcb (0x6f86 bytes) 000435[0] 1746069810.929411 mapread 0x1331d5 thru 0x13f9f5 (0xc821 bytes) 000436[0] 1746069810.987144 write 0x4f97a8 thru 0x5039e1 (0xa23a bytes) 000438[1] 1746069811.034536 mapread 0x0d1b13 thru 0x0d9d8d (0x827b bytes) 000443[1] 1746069811.097301 write 0x75f7c7 thru 0x76d74d (0xdf87 bytes) 000444[0] 1746069811.108441 read 0x2b198d thru 0x2bdfb3 (0xc627 bytes) 000445[0] 1746069811.129535 mapread 0x477f4e thru 0x47b276 (0x3329 bytes) 000446[1] 1746069811.153090 trunc from 0x76d74e to 0x8a6881 (0x139134 bytes) 000449[0] 1746069811.199489 trunc from 0x8a6882 to 0x43adf4 (0x46ba8d bytes) 000451[1] 1746069811.235663 read 0x2d8ad9 thru 0x2ddd3a (0x5262 bytes) 000452[1] 1746069811.244521 mapwrite 0x8b7edf thru 0x8c7767 (0xf889 bytes) 000457[1] 1746069811.372078 mapread 0x779177 thru 0x77d532 (0x43bc bytes) 000458[1] 1746069811.386957 mapread 0x25908a thru 0x264545 (0xb4bc bytes) 000460[0] 1746069811.417204 write 0x267a16 thru 0x273bfd (0xc1e8 bytes) 000461[0] 1746069811.439478 mapread 0x8545e0 thru 0x859a07 (0x5428 bytes) 000464[0] 1746069811.482563 trunc from 0x8c7768 to 0x72656b (0x1a11fc bytes) 000465[0] 1746069811.503862 trunc from 0x72656c to 0x435f11 (0x2f065a bytes) 000467[0] 1746069811.527402 write 0x9549b1 thru 0x955b18 (0x1168 bytes) 000469[1] 1746069811.547080 trunc from 0x955b19 to 0x5bf4fc (0x39661c bytes) 000471[0] 1746069811.577157 mapread 0x047385 thru 0x04d2fa (0x5f76 bytes) 000475[0] 1746069811.610776 write 0x25632d thru 0x2618ec (0xb5c0 bytes) 000476[1] 1746069811.634402 mapwrite 0x3baf0f thru 0x3c30fc (0x81ee bytes) 000477[1] 1746069811.714620 read 0x2b0cf0 thru 0x2b7330 (0x6641 bytes) 000478[0] 1746069811.734245 trunc from 0x5bf4fd to 0x50ff2a (0xaf5d2 bytes) 000479[1] 1746069811.757063 trunc from 0x50ff2b to 0x548d39 (0x38e0f bytes) 000481[1] 1746069811.781984 trunc from 0x548d3a to 0x6dfec5 (0x19718c bytes) 000484[0] 1746069811.794149 read 0x447b31 thru 0x44d371 (0x5841 bytes) 000486[1] 1746069811.826218 trunc from 0x6dfec6 to 0x69d38b (0x42b3a bytes) 000488[1] 1746069811.873334 write 0x1624cb thru 0x16c5ce (0xa104 bytes) 000489[0] 1746069811.885046 mapread 0x35c472 thru 0x361ece (0x5a5d bytes) 000490[1] 1746069811.926867 mapread 0x1738fd thru 0x17f86a (0xbf6e bytes) 000491[0] 1746069811.940162 mapwrite 0x5c5089 thru 0x5c6aef (0x1a67 bytes) 000494[1] 1746069812.000287 write 0x268af2 thru 0x273af3 (0xb002 bytes) 000495[0] 1746069812.026283 read 0x4e8033 thru 0x4eab44 (0x2b12 bytes) 000499[1] 1746069812.065200 mapwrite 0x734b00 thru 0x742812 (0xdd13 bytes) 000500[1] 1746069812.138228 read 0x080fcc thru 0x083e6d (0x2ea2 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 9812 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000008[1] 1746069812.609006 write 0x8e6000 thru 0x8edd38 (0x7d39 bytes) truncating to largest ever: 0x421b2c 000009[0] 1746069812.634560 trunc from 0x8edd39 to 0x421b2b (0x4cc20d bytes) 000013[0] 1746069812.668648 mapread 0x02e000 thru 0x03ab02 (0xcb03 bytes) 000014[1] 1746069812.690438 trunc from 0x421b2c to 0x408d61 (0x18dca bytes) 000019[0] 1746069812.725478 read 0x223000 thru 0x230456 (0xd457 bytes) 000020[1] 1746069812.737245 mapwrite 0x45d000 thru 0x46551f (0x8520 bytes) 000022[1] 1746069812.872278 trunc from 0x465520 to 0x2490f0 (0x21c42f bytes) 000024[0] 1746069812.899149 trunc from 0x2490f1 to 0x12590c (0x1237e4 bytes) 000025[0] 1746069812.923002 write 0x5de000 thru 0x5e6772 (0x8773 bytes) 000026[0] 1746069812.937178 read 0x5c5000 thru 0x5cb0c8 (0x60c9 bytes) 000027[0] 1746069812.945812 read 0x5dd000 thru 0x5e5e64 (0x8e65 bytes) truncating to largest ever: 0x591918 000028[0] 1746069812.955596 trunc from 0x5e6773 to 0x591917 (0x54e5b bytes) 000029[0] 1746069812.979111 read 0x323000 thru 0x3268f8 (0x38f9 bytes) truncating to largest ever: 0x8816b9 000030[0] 1746069812.986916 trunc from 0x591918 to 0x8816b8 (0x2efda1 bytes) 000031[0] 1746069813.009318 write 0x768000 thru 0x773f0e (0xbf0f bytes) truncating to largest ever: 0x8c07fe 000033[1] 1746069813.023857 trunc from 0x8816b9 to 0x8c07fd (0x3f145 bytes) 000036[0] 1746069813.085028 trunc from 0x8c07fe to 0x89d900 (0x22efd bytes) 000037[1] 1746069813.112635 read 0x4cb000 thru 0x4d08b7 (0x58b8 bytes) 000038[1] 1746069813.132069 trunc from 0x89d901 to 0x72374b (0x17a1b5 bytes) 000039[1] 1746069813.167079 mapread 0x350000 thru 0x353bdb (0x3bdc bytes) 000040[1] 1746069813.185864 trunc from 0x72374c to 0x8b22fa (0x18ebaf bytes) 000041[0] 1746069813.200825 mapread 0x721000 thru 0x727ae1 (0x6ae2 bytes) 000042[1] 1746069813.219211 read 0x46c000 thru 0x477c7c (0xbc7d bytes) 000043[1] 1746069813.226132 write 0x655000 thru 0x6580ed (0x30ee bytes) 000046[0] 1746069813.246574 read 0x8a4000 thru 0x8a7bfe (0x3bff bytes) 000049[1] 1746069813.265662 trunc from 0x8b22fb to 0x327654 (0x58aca6 bytes) 000051[1] 1746069813.300391 write 0x972000 thru 0x97c6a3 (0xa6a4 bytes) 000052[1] 1746069813.311091 trunc from 0x97c6a4 to 0x3738d8 (0x608dcb bytes) 000053[1] 1746069813.329162 trunc from 0x3738d9 to 0x5fcf72 (0x28969a bytes) 000054[1] 1746069813.351934 write 0x46c000 thru 0x46dae2 (0x1ae3 bytes) 000055[0] 1746069813.363576 trunc from 0x5fcf73 to 0x1b139e (0x44bbd4 bytes) 000056[0] 1746069813.404936 write 0x2e0000 thru 0x2ec34a (0xc34b bytes) 000058[0] 1746069813.427856 write 0x3e0000 thru 0x3ea0ec (0xa0ed bytes) 000059[1] 1746069813.433240 read 0x2c6000 thru 0x2ccd57 (0x6d58 bytes) 000060[0] 1746069813.497113 write 0x96d000 thru 0x97cef6 (0xfef7 bytes) 000062[0] 1746069813.524295 read 0x1cb000 thru 0x1cbecd (0xece bytes) 000063[1] 1746069813.528943 read 0x292000 thru 0x2a18f2 (0xf8f3 bytes) 000064[1] 1746069813.551478 mapwrite 0x8ae000 thru 0x8aeaac (0xaad bytes) 000066[1] 1746069813.619170 write 0x8ab000 thru 0x8b1b5f (0x6b60 bytes) 000067[0] 1746069813.632108 write 0x658000 thru 0x660b0a (0x8b0b bytes) 000068[1] 1746069813.659192 mapread 0x167000 thru 0x173918 (0xc919 bytes) 000069[1] 1746069813.700968 mapread 0x28e000 thru 0x293891 (0x5892 bytes) 000071[0] 1746069813.724769 write 0x1bb000 thru 0x1c449b (0x949c bytes) 000074[1] 1746069813.754032 write 0x495000 thru 0x49a00c (0x500d bytes) 000075[1] 1746069813.766471 mapwrite 0x18b000 thru 0x19849d (0xd49e bytes) 000076[1] 1746069813.830975 mapwrite 0x321000 thru 0x32ce1a (0xbe1b bytes) 000077[1] 1746069813.891294 trunc from 0x97cef7 to 0x3d2b30 (0x5aa3c6 bytes) 000080[1] 1746069813.929707 mapwrite 0x730000 thru 0x739f66 (0x9f67 bytes) 000081[0] 1746069814.043085 read 0x708000 thru 0x714988 (0xc989 bytes) 000082[1] 1746069814.055678 mapwrite 0x32a000 thru 0x32c6f3 (0x26f4 bytes) 000083[0] 1746069814.139817 mapwrite 0x8fa000 thru 0x908140 (0xe141 bytes) 000084[1] 1746069814.235089 write 0x66d000 thru 0x676067 (0x9068 bytes) 000085[1] 1746069814.243088 read 0x256000 thru 0x256ebc (0xebd bytes) 000087[0] 1746069814.282615 mapwrite 0x2b3000 thru 0x2c03a6 (0xd3a7 bytes) 000089[1] 1746069814.377956 write 0x99b000 thru 0x9a418e (0x918f bytes) 000090[0] 1746069814.405471 mapread 0x082000 thru 0x08576c (0x376d bytes) 000092[1] 1746069814.441954 read 0x185000 thru 0x1893a7 (0x43a8 bytes) 000093[0] 1746069814.447075 read 0x732000 thru 0x733625 (0x1626 bytes) 000094[0] 1746069814.449679 write 0x37e000 thru 0x37fb45 (0x1b46 bytes) 000095[0] 1746069814.459241 read 0x255000 thru 0x25fa4e (0xaa4f bytes) 000096[0] 1746069814.478010 trunc from 0x9a418f to 0x8281f3 (0x17bf9b bytes) 000099[1] 1746069814.509013 mapwrite 0x4c9000 thru 0x4cd544 (0x4545 bytes) 000105[1] 1746069814.635858 read 0x243000 thru 0x2482f0 (0x52f1 bytes) 000107[0] 1746069814.654925 mapwrite 0x5a6000 thru 0x5ac980 (0x6981 bytes) 000108[0] 1746069814.743180 mapwrite 0x606000 thru 0x610338 (0xa339 bytes) 000111[0] 1746069814.806170 read 0x359000 thru 0x3662f7 (0xd2f8 bytes) 000117[0] 1746069814.847879 mapread 0x05d000 thru 0x05dc8b (0xc8c bytes) 000118[0] 1746069814.853046 read 0x064000 thru 0x068153 (0x4154 bytes) 000119[0] 1746069814.858497 read 0x061000 thru 0x06272d (0x172e bytes) 000123[1] 1746069814.894405 mapwrite 0x764000 thru 0x77058d (0xc58e bytes) 000124[0] 1746069814.982537 write 0x8c3000 thru 0x8c9c74 (0x6c75 bytes) 000125[0] 1746069815.000793 write 0x68f000 thru 0x699dae (0xadaf bytes) 000127[0] 1746069815.005204 mapwrite 0x010000 thru 0x01a10c (0xa10d bytes) 000130[1] 1746069815.106112 trunc from 0x8c9c75 to 0x2762df (0x653995 bytes) 000131[0] 1746069815.124767 trunc from 0x2762e0 to 0x804014 (0x58dd35 bytes) 000132[0] 1746069815.139667 trunc from 0x804015 to 0x528831 (0x2db7e3 bytes) 000134[1] 1746069815.157987 mapread 0x2f7000 thru 0x2fd0bb (0x60bc bytes) 000135[1] 1746069815.181606 read 0x0d0000 thru 0x0d0bbd (0xbbe bytes) 000140[1] 1746069815.191481 read 0x098000 thru 0x0a364b (0xb64c bytes) 000143[0] 1746069815.198636 mapread 0x058000 thru 0x06285e (0xa85f bytes) 000144[0] 1746069815.210890 mapwrite 0x261000 thru 0x26ec32 (0xdc33 bytes) 000146[0] 1746069815.304917 read 0x01d000 thru 0x029ba3 (0xcba4 bytes) 000149[1] 1746069815.329927 write 0x79d000 thru 0x79f683 (0x2684 bytes) 000153[0] 1746069815.360610 write 0x5f9000 thru 0x602b2a (0x9b2b bytes) 000155[1] 1746069815.384167 mapwrite 0x843000 thru 0x84ddb9 (0xadba bytes) 000158[1] 1746069815.491972 read 0x504000 thru 0x510c1d (0xcc1e bytes) 000168[0] 1746069815.587778 write 0x8e6000 thru 0x8f4bd5 (0xebd6 bytes) 000170[0] 1746069815.612053 read 0x529000 thru 0x52f7cc (0x67cd bytes) 000172[0] 1746069815.619422 mapread 0x6dc000 thru 0x6df852 (0x3853 bytes) 000173[1] 1746069815.633838 write 0x156000 thru 0x1594b1 (0x34b2 bytes) 000177[1] 1746069815.672238 mapread 0x2e1000 thru 0x2eea36 (0xda37 bytes) 000180[0] 1746069815.707751 read 0x7ad000 thru 0x7b36cd (0x66ce bytes) 000181[0] 1746069815.731270 read 0x2a1000 thru 0x2a66ed (0x56ee bytes) 000186[0] 1746069815.739293 mapread 0x100000 thru 0x100463 (0x464 bytes) 000187[1] 1746069815.743146 mapread 0x446000 thru 0x44f299 (0x929a bytes) 000189[1] 1746069815.755913 mapwrite 0x50a000 thru 0x516480 (0xc481 bytes) 000192[1] 1746069815.856546 trunc from 0x8f4bd6 to 0x489d05 (0x46aed0 bytes) 000193[0] 1746069815.868587 mapwrite 0x276000 thru 0x27e044 (0x8045 bytes) 000195[0] 1746069815.947756 trunc from 0x489d06 to 0x4cf10d (0x45408 bytes) 000196[1] 1746069815.962088 mapread 0x0f8000 thru 0x0fb2ad (0x32ae bytes) 000197[1] 1746069816.003249 write 0x8c3000 thru 0x8c781e (0x481f bytes) 000198[1] 1746069816.012462 mapwrite 0x7c7000 thru 0x7d4c5f (0xdc60 bytes) 000200[0] 1746069816.082516 write 0x070000 thru 0x0781a9 (0x81aa bytes) 000202[1] 1746069816.125754 read 0x4d4000 thru 0x4d71fa (0x31fb bytes) 000204[1] 1746069816.146673 mapread 0x758000 thru 0x767810 (0xf811 bytes) 000206[0] 1746069816.160683 write 0x1cf000 thru 0x1d2d30 (0x3d31 bytes) 000207[1] 1746069816.180896 write 0x295000 thru 0x295ecd (0xece bytes) 000209[1] 1746069816.211776 read 0x6d6000 thru 0x6d68ad (0x8ae bytes) 000211[0] 1746069816.231251 write 0x002000 thru 0x0030b8 (0x10b9 bytes) truncating to largest ever: 0x9be72e 000212[0] 1746069816.255925 trunc from 0x8c781f to 0x9be72d (0xf6f0f bytes) 000215[0] 1746069816.283166 read 0x19f000 thru 0x1aad9e (0xbd9f bytes) 000216[1] 1746069816.300102 read 0x15b000 thru 0x1647cb (0x97cc bytes) 000218[0] 1746069816.321267 mapwrite 0x18c000 thru 0x18d467 (0x1468 bytes) 000222[1] 1746069816.422432 mapread 0x196000 thru 0x196017 (0x18 bytes) 000223[1] 1746069816.438001 read 0x464000 thru 0x470b6b (0xcb6c bytes) 000225[0] 1746069816.453413 mapread 0x65b000 thru 0x6637ba (0x87bb bytes) 000227[0] 1746069816.473748 write 0x6fd000 thru 0x6fe4c0 (0x14c1 bytes) 000229[0] 1746069816.505062 write 0x92d000 thru 0x9325c6 (0x55c7 bytes) 000231[1] 1746069816.520919 mapwrite 0x2aa000 thru 0x2b2346 (0x8347 bytes) 000233[0] 1746069816.633783 mapwrite 0x8d9000 thru 0x8e8a5c (0xfa5d bytes) 000235[0] 1746069816.719555 mapwrite 0x288000 thru 0x28eddc (0x6ddd bytes) 000242[1] 1746069816.807729 trunc from 0x9be72e to 0x186e73 (0x8378ba bytes) 000247[1] 1746069816.869849 mapwrite 0x371000 thru 0x3776e5 (0x66e6 bytes) 000249[1] 1746069816.980301 read 0x0cd000 thru 0x0d88f7 (0xb8f8 bytes) 000250[0] 1746069817.029830 write 0x389000 thru 0x391fe5 (0x8fe6 bytes) 000251[1] 1746069817.045496 mapread 0x2fd000 thru 0x303e0d (0x6e0e bytes) 000252[1] 1746069817.101131 write 0x086000 thru 0x093cd6 (0xdcd7 bytes) 000255[1] 1746069817.118936 trunc from 0x391fe6 to 0x07e3e1 (0x313c04 bytes) 000256[0] 1746069817.147992 trunc from 0x07e3e2 to 0x1c671a (0x148339 bytes) 000260[1] 1746069817.193044 write 0x02d000 thru 0x038d3f (0xbd40 bytes) 000261[0] 1746069817.203849 read 0x185000 thru 0x18760a (0x260b bytes) 000262[1] 1746069817.244202 read 0x092000 thru 0x096863 (0x4864 bytes) 000263[1] 1746069817.275445 trunc from 0x1c671b to 0x3cd1c0 (0x206aa6 bytes) 000264[0] 1746069817.312117 trunc from 0x3cd1c1 to 0x3349cc (0x987f4 bytes) 000265[1] 1746069817.341695 mapread 0x2ca000 thru 0x2cd7f6 (0x37f7 bytes) 000266[0] 1746069817.377430 trunc from 0x3349cd to 0x53a950 (0x205f84 bytes) 000267[1] 1746069817.415122 trunc from 0x53a951 to 0x09a8d2 (0x4a007e bytes) 000268[1] 1746069817.438752 mapread 0x087000 thru 0x093385 (0xc386 bytes) 000271[0] 1746069817.499576 read 0x043000 thru 0x04bf67 (0x8f68 bytes) 000278[1] 1746069817.525091 mapread 0x031000 thru 0x038afd (0x7afe bytes) 000279[1] 1746069817.554748 mapwrite 0x175000 thru 0x17e75e (0x975f bytes) 000280[0] 1746069817.657828 mapwrite 0x9bb000 thru 0x9c0396 (0x5397 bytes) 000283[1] 1746069817.846204 read 0x203000 thru 0x20dc55 (0xac56 bytes) 000285[0] 1746069817.880864 write 0x63e000 thru 0x63e06b (0x6c bytes) 000297[1] 1746069817.959243 read 0x64d000 thru 0x64e361 (0x1362 bytes) 000298[0] 1746069817.988143 mapread 0x821000 thru 0x8293f6 (0x83f7 bytes) 000300[0] 1746069818.057261 read 0x256000 thru 0x261682 (0xb683 bytes) 000306[1] 1746069818.074791 mapread 0x919000 thru 0x926766 (0xd767 bytes) 000307[0] 1746069818.126303 mapread 0x323000 thru 0x326635 (0x3636 bytes) 000309[1] 1746069818.142598 mapread 0x682000 thru 0x68fe79 (0xde7a bytes) 000311[0] 1746069818.164321 mapread 0x48c000 thru 0x48e340 (0x2341 bytes) 000314[1] 1746069818.199545 trunc from 0x9c0397 to 0x50072e (0x4bfc68 bytes) 000315[0] 1746069818.244213 read 0x163000 thru 0x169dc5 (0x6dc6 bytes) 000316[0] 1746069818.263020 read 0x09f000 thru 0x0a9591 (0xa592 bytes) 000317[0] 1746069818.270509 mapwrite 0x1c2000 thru 0x1caa9f (0x8aa0 bytes) 000318[1] 1746069818.396867 mapread 0x1fe000 thru 0x208d27 (0xad28 bytes) 000321[1] 1746069818.439942 mapread 0x1b3000 thru 0x1bc930 (0x9931 bytes) 000323[1] 1746069818.459326 mapread 0x35e000 thru 0x36a5a6 (0xc5a7 bytes) 000324[0] 1746069818.484828 read 0x350000 thru 0x356ab2 (0x6ab3 bytes) 000325[0] 1746069818.491903 read 0x3ba000 thru 0x3c2804 (0x8805 bytes) 000327[1] 1746069818.498926 mapwrite 0x6cb000 thru 0x6da797 (0xf798 bytes) 000328[1] 1746069818.609083 mapwrite 0x290000 thru 0x29b5ca (0xb5cb bytes) 000332[0] 1746069818.690012 write 0x937000 thru 0x938b2b (0x1b2c bytes) 000333[0] 1746069818.698961 mapwrite 0x09c000 thru 0x0a31d6 (0x71d7 bytes) 000334[1] 1746069818.788104 trunc from 0x938b2c to 0x91f7e3 (0x19348 bytes) 000335[0] 1746069818.820324 mapwrite 0x9bd000 thru 0x9c3c00 (0x6c01 bytes) 000336[1] 1746069818.907574 write 0x342000 thru 0x34d8a2 (0xb8a3 bytes) 000339[1] 1746069818.938052 mapread 0x128000 thru 0x12bf0c (0x3f0d bytes) 000344[1] 1746069818.986564 trunc from 0x9c3c01 to 0x84a292 (0x17996e bytes) 000346[0] 1746069818.999389 mapread 0x408000 thru 0x4111ea (0x91eb bytes) 000351[1] 1746069819.040055 read 0x480000 thru 0x486a7c (0x6a7d bytes) 000352[0] 1746069819.045012 read 0x6c5000 thru 0x6d088d (0xb88e bytes) 000354[1] 1746069819.051109 read 0x3f0000 thru 0x3f3524 (0x3525 bytes) 000357[0] 1746069819.054633 write 0x21c000 thru 0x22b140 (0xf141 bytes) 000358[0] 1746069819.073610 mapwrite 0x46b000 thru 0x472915 (0x7916 bytes) 000359[0] 1746069819.147362 read 0x440000 thru 0x445eaa (0x5eab bytes) 000360[0] 1746069819.163163 trunc from 0x84a293 to 0x5082f1 (0x341fa1 bytes) 000366[0] 1746069819.231310 write 0x438000 thru 0x43915c (0x115d bytes) 000367[0] 1746069819.257997 write 0x224000 thru 0x22cf02 (0x8f03 bytes) 000368[1] 1746069819.263965 read 0x167000 thru 0x16b127 (0x4128 bytes) 000370[0] 1746069819.292831 read 0x140000 thru 0x14acc6 (0xacc7 bytes) 000371[0] 1746069819.298224 mapread 0x025000 thru 0x029294 (0x4295 bytes) 000372[1] 1746069819.309921 read 0x477000 thru 0x47ac0a (0x3c0b bytes) 000374[1] 1746069819.314726 mapwrite 0x4b7000 thru 0x4c01e5 (0x91e6 bytes) 000375[0] 1746069819.376933 mapwrite 0x8e2000 thru 0x8f1241 (0xf242 bytes) 000376[0] 1746069819.486198 read 0x5d5000 thru 0x5d980a (0x480b bytes) 000378[0] 1746069819.516120 write 0x94d000 thru 0x95188f (0x4890 bytes) 000379[1] 1746069819.526590 read 0x492000 thru 0x49d7c3 (0xb7c4 bytes) 000380[1] 1746069819.549483 mapread 0x436000 thru 0x4446e1 (0xe6e2 bytes) 000381[1] 1746069819.563981 trunc from 0x951890 to 0x2cd8e7 (0x683fa8 bytes) 000386[1] 1746069819.618321 write 0x009000 thru 0x009beb (0xbec bytes) 000387[1] 1746069819.623939 write 0x155000 thru 0x15e8cf (0x98d0 bytes) 000391[0] 1746069819.644048 write 0x3fb000 thru 0x402d19 (0x7d1a bytes) 000393[1] 1746069819.663165 mapwrite 0x68a000 thru 0x6901e6 (0x61e7 bytes) 000394[0] 1746069819.748118 write 0x0cb000 thru 0x0d4185 (0x9186 bytes) truncating to largest ever: 0x9f3ccb 000395[0] 1746069819.757036 trunc from 0x6901e7 to 0x9f3cca (0x363ae4 bytes) 000396[0] 1746069819.769970 mapread 0x12a000 thru 0x135896 (0xb897 bytes) 000399[0] 1746069819.807209 mapwrite 0x550000 thru 0x551ef9 (0x1efa bytes) 000402[0] 1746069819.875295 read 0x125000 thru 0x1285de (0x35df bytes) 000404[1] 1746069819.889461 mapread 0x0c2000 thru 0x0c767c (0x567d bytes) 000405[0] 1746069819.927818 mapwrite 0x5dc000 thru 0x5e8e5a (0xce5b bytes) 000406[0] 1746069819.997600 mapread 0x5bb000 thru 0x5c4d65 (0x9d66 bytes) 000407[1] 1746069820.022339 trunc from 0x9f3ccb to 0x895d21 (0x15dfa9 bytes) 000408[1] 1746069820.062842 read 0x627000 thru 0x62e2e8 (0x72e9 bytes) 000410[1] 1746069820.093829 write 0x524000 thru 0x529143 (0x5144 bytes) 000411[1] 1746069820.098964 write 0x16a000 thru 0x16f170 (0x5171 bytes) 000413[1] 1746069820.108397 write 0x6c3000 thru 0x6cac73 (0x7c74 bytes) 000415[0] 1746069820.121417 trunc from 0x895d22 to 0x3ea573 (0x4ab7ae bytes) 000420[0] 1746069820.168030 read 0x307000 thru 0x309c39 (0x2c3a bytes) 000421[1] 1746069820.228836 write 0x21c000 thru 0x228a3c (0xca3d bytes) 000423[1] 1746069820.242614 write 0x8d2000 thru 0x8d48f0 (0x28f1 bytes) 000424[1] 1746069820.252928 trunc from 0x8d48f1 to 0x397124 (0x53d7cc bytes) 000429[1] 1746069820.289439 read 0x371000 thru 0x37a79d (0x979e bytes) 000430[0] 1746069820.330928 mapread 0x03a000 thru 0x03dc6f (0x3c70 bytes) 000435[1] 1746069820.366126 trunc from 0x397125 to 0x6143b6 (0x27d292 bytes) 000436[1] 1746069820.399994 trunc from 0x6143b7 to 0x008e1b (0x60b59b bytes) 000437[1] 1746069820.424477 write 0x0a5000 thru 0x0b0854 (0xb855 bytes) 000438[0] 1746069820.428794 mapwrite 0x8b3000 thru 0x8bff85 (0xcf86 bytes) 000440[1] 1746069820.596289 mapread 0x459000 thru 0x45e1dc (0x51dd bytes) 000446[1] 1746069820.670031 read 0x0bd000 thru 0x0be37e (0x137f bytes) 000448[0] 1746069820.676743 mapread 0x6ff000 thru 0x705fad (0x6fae bytes) 000449[1] 1746069820.704232 mapread 0x2b6000 thru 0x2b6b48 (0xb49 bytes) 000450[1] 1746069820.708276 write 0x4dc000 thru 0x4eaa66 (0xea67 bytes) 000452[0] 1746069820.722618 trunc from 0x8bff86 to 0x0885ef (0x837996 bytes) 000454[0] 1746069820.744987 read 0x039000 thru 0x04039a (0x739b bytes) 000460[1] 1746069820.797941 mapwrite 0x2a9000 thru 0x2b48f3 (0xb8f4 bytes) 000461[1] 1746069820.892380 mapread 0x08c000 thru 0x091c41 (0x5c42 bytes) 000462[1] 1746069820.902465 mapwrite 0x36d000 thru 0x371bdc (0x4bdd bytes) 000464[1] 1746069820.967553 read 0x31e000 thru 0x32d80b (0xf80c bytes) 000466[1] 1746069821.018805 read 0x03c000 thru 0x03f0b0 (0x30b1 bytes) 000467[1] 1746069821.019335 mapwrite 0x234000 thru 0x234ccf (0xcd0 bytes) 000468[1] 1746069821.067089 mapread 0x2da000 thru 0x2e8172 (0xe173 bytes) 000469[1] 1746069821.081933 trunc from 0x371bdd to 0x66462d (0x2f2a51 bytes) 000470[1] 1746069821.128161 read 0x56f000 thru 0x57b354 (0xc355 bytes) 000471[0] 1746069821.138137 trunc from 0x66462e to 0x8b5e35 (0x251808 bytes) 000472[0] 1746069821.166522 mapwrite 0x594000 thru 0x59b011 (0x7012 bytes) 000474[1] 1746069821.360934 read 0x617000 thru 0x618ddd (0x1dde bytes) 000476[1] 1746069821.381602 mapwrite 0x6c1000 thru 0x6cb68f (0xa690 bytes) 000478[0] 1746069821.470863 read 0x232000 thru 0x241774 (0xf775 bytes) 000481[1] 1746069821.487324 write 0x154000 thru 0x1584a7 (0x44a8 bytes) 000482[1] 1746069821.514617 mapread 0x0be000 thru 0x0c2907 (0x4908 bytes) 000483[1] 1746069821.528969 mapwrite 0x3b8000 thru 0x3c4c52 (0xcc53 bytes) 000484[1] 1746069821.615394 write 0x25a000 thru 0x267a75 (0xda76 bytes) 000487[0] 1746069821.645593 mapwrite 0x860000 thru 0x862cf8 (0x2cf9 bytes) 000488[1] 1746069821.741335 mapread 0x70b000 thru 0x7127d0 (0x77d1 bytes) 000489[0] 1746069821.769184 read 0x635000 thru 0x6402d2 (0xb2d3 bytes) 000491[0] 1746069821.785068 write 0x6fe000 thru 0x6feba8 (0xba9 bytes) 000495[1] 1746069821.813445 read 0x418000 thru 0x424199 (0xc19a bytes) 000496[1] 1746069821.832973 mapwrite 0x357000 thru 0x35d338 (0x6339 bytes) 000499[1] 1746069821.929130 mapwrite 0x6df000 thru 0x6ea442 (0xb443 bytes) All operations completed A-OK! PASS 16a (26s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 23:23:43 (1746069823) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.198477 s, 42.3 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.217406 s, 38.6 MB/s Chance of close/open is 1 in 50 Seed set to 9824 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x7a8e6e 000004[1] 1746069825.300299 trunc from 00000000 to 0x7a8e6d (0x7a8e6e bytes) 000005[0] 1746069825.326648 read 0x46cda3 thru 0x46e530 (0x178e bytes) 000007[1] 1746069825.352232 mapwrite 0x1e1d29 thru 0x1e1efe (0x1d6 bytes) 000008[1] 1746069825.462434 read 0x1a90f4 thru 0x1a9ae5 (0x9f2 bytes) 000011[0] 1746069825.465882 mapread 0x37768c thru 0x3790c0 (0x1a35 bytes) 000013[1] 1746069825.493403 mapread 0x008748 thru 0x009f11 (0x17ca bytes) 000015[1] 1746069825.506256 trunc from 0x7a8e6e to 0x297e5a (0x511013 bytes) 000016[1] 1746069825.537049 read 0x021157 thru 0x022ea3 (0x1d4d bytes) 000018[0] 1746069825.582973 write 0x8d6ec2 thru 0x8d8e9a (0x1fd9 bytes) 000019[1] 1746069825.613021 mapread 0x793c23 thru 0x7949a2 (0xd80 bytes) 000022[1] 1746069825.670897 trunc from 0x8d8e9b to 0x148252 (0x790c48 bytes) 000023[1] 1746069825.707909 mapread 0x039884 thru 0x039d15 (0x492 bytes) 000025[1] 1746069825.715699 write 0x0f6b68 thru 0x0f84a3 (0x193c bytes) 000026[0] 1746069825.737420 mapread 0x0eaec5 thru 0x0ebd02 (0xe3e bytes) 000028[0] 1746069825.787775 write 0x19f313 thru 0x19f763 (0x451 bytes) 000030[0] 1746069825.812332 mapwrite 0x67cc1a thru 0x67e139 (0x1520 bytes) 000031[1] 1746069825.894925 read 0x453569 thru 0x4540e6 (0xb7e bytes) 000034[1] 1746069825.934951 mapwrite 0x2ff541 thru 0x2ffdb9 (0x879 bytes) truncating to largest ever: 0x8e6937 000038[0] 1746069826.078546 trunc from 0x67e13a to 0x8e6936 (0x2687fd bytes) 000041[0] 1746069826.153958 trunc from 0x8e6937 to 0x3883d9 (0x55e55d bytes) 000042[0] 1746069826.179050 trunc from 0x3883da to 0x06699a (0x321a3f bytes) 000043[0] 1746069826.196083 write 0x0d3a19 thru 0x0d519b (0x1783 bytes) 000044[1] 1746069826.197012 trunc from 0x0d519c to 0x4e650d (0x411372 bytes) 000047[1] 1746069826.236967 trunc from 0x4e650e to 0x8d5817 (0x3ef30a bytes) 000048[1] 1746069826.260253 write 0x1cab92 thru 0x1cc531 (0x19a0 bytes) truncating to largest ever: 0x977852 000049[0] 1746069826.268194 trunc from 0x8d5818 to 0x977851 (0xa203a bytes) 000050[0] 1746069826.295664 mapwrite 0x6f9564 thru 0x6f95d8 (0x75 bytes) 000051[0] 1746069826.356742 mapread 0x04614d thru 0x046ac2 (0x976 bytes) 000052[1] 1746069826.374412 read 0x241243 thru 0x2426d5 (0x1493 bytes) 000053[1] 1746069826.390077 mapwrite 0x2d3c26 thru 0x2d57d4 (0x1baf bytes) 000054[1] 1746069826.468920 mapread 0x5a8cd9 thru 0x5aa828 (0x1b50 bytes) 000055[1] 1746069826.506731 write 0x5755eb thru 0x57565b (0x71 bytes) 000056[0] 1746069826.526944 read 0x422444 thru 0x422c5f (0x81c bytes) 000057[0] 1746069826.540905 write 0x7c9843 thru 0x7ca068 (0x826 bytes) 000058[1] 1746069826.560876 write 0x87f964 thru 0x87fcbe (0x35b bytes) 000060[1] 1746069826.583422 mapread 0x8d043f thru 0x8d20a7 (0x1c69 bytes) truncating to largest ever: 0x9bde7a 000061[0] 1746069826.613022 trunc from 0x977852 to 0x9bde79 (0x46628 bytes) 000063[0] 1746069826.647802 mapwrite 0x3ec4a6 thru 0x3ee300 (0x1e5b bytes) 000067[0] 1746069826.708878 mapwrite 0x240bf7 thru 0x24196a (0xd74 bytes) 000068[1] 1746069826.764800 read 0x54f4af thru 0x54f4b5 (0x7 bytes) 000069[1] 1746069826.775023 mapwrite 0x50e5a5 thru 0x50ffa7 (0x1a03 bytes) 000070[0] 1746069826.818883 read 0x76b4c3 thru 0x76bf12 (0xa50 bytes) 000071[0] 1746069826.828257 mapread 0x85592b thru 0x856460 (0xb36 bytes) 000073[0] 1746069826.833705 read 0x95979e thru 0x95a5b3 (0xe16 bytes) 000075[0] 1746069826.837525 read 0x2cb570 thru 0x2cc747 (0x11d8 bytes) 000076[0] 1746069826.852318 trunc from 0x9bde7a to 0x34f82e (0x66e64b bytes) 000077[0] 1746069826.875564 mapread 0x1988b4 thru 0x199426 (0xb73 bytes) 000078[0] 1746069826.896100 write 0x63610f thru 0x63620b (0xfd bytes) 000080[1] 1746069826.906775 read 0x1c942b thru 0x1ca274 (0xe4a bytes) 000081[1] 1746069826.919431 write 0x8cb8a0 thru 0x8cbdf0 (0x551 bytes) 000083[0] 1746069826.941822 mapwrite 0x6c0557 thru 0x6c2447 (0x1ef1 bytes) 000086[1] 1746069827.038311 write 0x43bdb3 thru 0x43c9c8 (0xc16 bytes) 000087[1] 1746069827.061126 mapwrite 0x49283f thru 0x494733 (0x1ef5 bytes) 000091[1] 1746069827.146213 trunc from 0x8cbdf1 to 0x56bc70 (0x360180 bytes) 000094[0] 1746069827.184373 read 0x22882c thru 0x229d7b (0x1550 bytes) 000099[1] 1746069827.199286 write 0x45ecb6 thru 0x45faa0 (0xdeb bytes) 000102[0] 1746069827.226462 mapread 0x06bc55 thru 0x06ca58 (0xe04 bytes) 000103[1] 1746069827.244656 mapread 0x3fac42 thru 0x3fb6fe (0xabd bytes) 000104[0] 1746069827.250537 write 0x86d3db thru 0x86d5aa (0x1d0 bytes) 000106[0] 1746069827.273956 write 0x6fa65d thru 0x6fb563 (0xf07 bytes) 000108[1] 1746069827.288462 mapread 0x0ff2ef thru 0x10097e (0x1690 bytes) 000110[0] 1746069827.322124 trunc from 0x86d5ab to 0x5820c4 (0x2eb4e6 bytes) 000111[0] 1746069827.352967 mapread 0x0f7371 thru 0x0f88c5 (0x1555 bytes) 000113[0] 1746069827.391137 mapwrite 0x1da056 thru 0x1db189 (0x1134 bytes) 000115[1] 1746069827.446661 read 0x38129e thru 0x381904 (0x667 bytes) 000121[0] 1746069827.495254 mapread 0x166f72 thru 0x16895a (0x19e9 bytes) 000122[0] 1746069827.502076 mapwrite 0x1c1adf thru 0x1c296a (0xe8c bytes) 000123[1] 1746069827.553128 mapread 0x120eb1 thru 0x12165f (0x7af bytes) truncating to largest ever: 0x9e5ca6 000124[0] 1746069827.580824 trunc from 0x5820c5 to 0x9e5ca5 (0x463be1 bytes) 000125[0] 1746069827.604307 mapread 0x765959 thru 0x766428 (0xad0 bytes) 000128[0] 1746069827.629046 write 0x7c086e thru 0x7c267a (0x1e0d bytes) 000130[0] 1746069827.645181 mapwrite 0x57e283 thru 0x57f3d5 (0x1153 bytes) 000134[0] 1746069827.691893 read 0x7f72be thru 0x7f73f1 (0x134 bytes) 000136[1] 1746069827.708159 write 0x780af8 thru 0x781586 (0xa8f bytes) 000138[1] 1746069827.733391 read 0x1b4562 thru 0x1b4898 (0x337 bytes) 000139[1] 1746069827.745079 write 0x431893 thru 0x433237 (0x19a5 bytes) 000142[1] 1746069827.761034 trunc from 0x9e5ca6 to 0x798c94 (0x24d011 bytes) 000146[0] 1746069827.809147 trunc from 0x798c95 to 0x33d729 (0x45b56b bytes) 000149[1] 1746069827.854776 trunc from 0x33d72a to 0x8063b9 (0x4c8c90 bytes) 000150[0] 1746069827.872903 write 0x2632fc thru 0x26525d (0x1f62 bytes) 000152[1] 1746069827.900168 mapread 0x40e61d thru 0x40e9cd (0x3b1 bytes) 000153[1] 1746069827.918917 read 0x1a5519 thru 0x1a5e40 (0x928 bytes) 000154[1] 1746069827.937718 read 0x58951e thru 0x58a518 (0xffb bytes) 000158[0] 1746069827.952813 write 0x55abc0 thru 0x55bf23 (0x1364 bytes) 000160[1] 1746069827.967528 mapread 0x35278d thru 0x3531dc (0xa50 bytes) 000162[1] 1746069827.995638 read 0x582739 thru 0x583f82 (0x184a bytes) 000163[1] 1746069828.007251 trunc from 0x8063ba to 0x383207 (0x4831b2 bytes) 000167[0] 1746069828.072687 trunc from 0x383208 to 0x9939ed (0x6107e6 bytes) 000168[0] 1746069828.099030 read 0x1f0b6c thru 0x1f1f41 (0x13d6 bytes) 000169[0] 1746069828.115084 trunc from 0x9939ee to 0x34ba3d (0x647fb0 bytes) 000172[1] 1746069828.126854 read 0x1a397c thru 0x1a43ba (0xa3f bytes) 000173[1] 1746069828.148577 mapread 0x1dc0bc thru 0x1dc542 (0x487 bytes) 000174[0] 1746069828.170190 write 0x67556c thru 0x6760aa (0xb3f bytes) 000175[0] 1746069828.179290 trunc from 0x6760ab to 0x79c533 (0x126489 bytes) 000177[1] 1746069828.196819 write 0x76624b thru 0x7669ac (0x762 bytes) 000178[1] 1746069828.216734 mapread 0x2ac3b4 thru 0x2ac88b (0x4d8 bytes) 000179[1] 1746069828.230539 write 0x8d413e thru 0x8d4235 (0xf8 bytes) 000180[0] 1746069828.235985 mapwrite 0x274ed1 thru 0x2752bc (0x3ec bytes) 000182[1] 1746069828.320030 write 0x276cb1 thru 0x277574 (0x8c4 bytes) 000184[1] 1746069828.344916 trunc from 0x8d4236 to 0x52258c (0x3b1ca9 bytes) 000190[0] 1746069828.393886 read 0x504662 thru 0x505096 (0xa35 bytes) 000191[1] 1746069828.405484 read 0x46f22e thru 0x470b47 (0x191a bytes) 000194[0] 1746069828.418957 mapwrite 0x07809d thru 0x079ca8 (0x1c0c bytes) 000195[0] 1746069828.478598 mapread 0x1a3545 thru 0x1a3842 (0x2fe bytes) 000200[1] 1746069828.518539 read 0x242de9 thru 0x244345 (0x155d bytes) 000206[1] 1746069828.539896 mapread 0x3b8880 thru 0x3b9de5 (0x1566 bytes) 000211[1] 1746069828.546808 mapread 0x08608b thru 0x087537 (0x14ad bytes) 000212[1] 1746069828.554387 read 0x166ebb thru 0x16818c (0x12d2 bytes) 000214[1] 1746069828.557763 trunc from 0x52258d to 0x248ff7 (0x2d9595 bytes) 000216[1] 1746069828.595071 trunc from 0x248ff8 to 0x99e357 (0x755360 bytes) 000219[1] 1746069828.633937 mapwrite 0x56e2bd thru 0x56f502 (0x1246 bytes) 000220[1] 1746069828.682246 mapread 0x42987e thru 0x42a956 (0x10d9 bytes) 000221[1] 1746069828.690414 write 0x3c1b78 thru 0x3c277e (0xc07 bytes) 000224[0] 1746069828.712632 write 0x37c42e thru 0x37e141 (0x1d14 bytes) 000225[1] 1746069828.752833 trunc from 0x99e358 to 0x410478 (0x58dedf bytes) 000226[1] 1746069828.786689 trunc from 0x410479 to 0x1455c6 (0x2caeb2 bytes) 000227[0] 1746069828.800650 mapread 0x02f794 thru 0x030d0e (0x157b bytes) 000228[0] 1746069828.833715 read 0x03197a thru 0x032b86 (0x120d bytes) 000234[0] 1746069828.872561 trunc from 0x1455c7 to 0x43edef (0x2f9829 bytes) 000235[0] 1746069828.913931 trunc from 0x43edf0 to 0x7f14ac (0x3b26bd bytes) 000236[1] 1746069828.943729 trunc from 0x7f14ad to 0x973a7f (0x1825d3 bytes) 000239[0] 1746069828.992643 mapwrite 0x2fc8f7 thru 0x2fd0cf (0x7d9 bytes) 000240[0] 1746069829.111457 trunc from 0x973a80 to 0x3efbde (0x583ea1 bytes) 000241[1] 1746069829.136162 mapread 0x3ece1c thru 0x3ed3f0 (0x5d5 bytes) 000242[1] 1746069829.171873 mapread 0x15a19e thru 0x15a4b9 (0x31c bytes) 000244[1] 1746069829.189332 write 0x60f568 thru 0x610e93 (0x192c bytes) 000245[1] 1746069829.209145 mapwrite 0x5f13c4 thru 0x5f1ed8 (0xb15 bytes) 000246[1] 1746069829.276138 mapwrite 0x8b59a7 thru 0x8b6c4f (0x12a9 bytes) 000247[0] 1746069829.389549 mapread 0x8a7233 thru 0x8a8da0 (0x1b6e bytes) 000248[0] 1746069829.416928 read 0x505897 thru 0x505c3b (0x3a5 bytes) 000254[0] 1746069829.432614 write 0x7449be thru 0x744d3b (0x37e bytes) 000259[0] 1746069829.477477 trunc from 0x8b6c50 to 0x853551 (0x636fe bytes) 000261[1] 1746069829.517457 write 0x2db0ad thru 0x2db89c (0x7f0 bytes) 000263[0] 1746069829.547478 read 0x1f6cea thru 0x1f80df (0x13f6 bytes) 000264[0] 1746069829.568258 read 0x0346d6 thru 0x03608c (0x19b7 bytes) 000266[0] 1746069829.589114 read 0x27d138 thru 0x27e077 (0xf40 bytes) 000267[0] 1746069829.612823 read 0x7bf85c thru 0x7c00c7 (0x86c bytes) 000270[1] 1746069829.652321 write 0x3a2c27 thru 0x3a2f40 (0x31a bytes) 000272[1] 1746069829.693421 write 0x149312 thru 0x14b30b (0x1ffa bytes) 000273[0] 1746069829.713736 trunc from 0x853552 to 0x02c256 (0x8272fb bytes) 000275[1] 1746069829.749420 mapwrite 0x7b8afc thru 0x7b987f (0xd84 bytes) 000276[0] 1746069829.805195 trunc from 0x7b9880 to 0x52797c (0x291f03 bytes) 000277[1] 1746069829.847522 write 0x4f8c26 thru 0x4faacd (0x1ea8 bytes) 000280[1] 1746069829.892153 mapwrite 0x0ed0da thru 0x0ee244 (0x116b bytes) truncating to largest ever: 0x9ecabc 000281[1] 1746069829.951849 trunc from 0x52797d to 0x9ecabb (0x4c513f bytes) 000282[1] 1746069829.991324 write 0x47cd71 thru 0x47d028 (0x2b8 bytes) 000287[1] 1746069830.020694 read 0x3f6802 thru 0x3f873b (0x1f3a bytes) 000295[0] 1746069830.088685 trunc from 0x9ecabc to 0x7cf936 (0x21d185 bytes) 000297[1] 1746069830.154853 read 0x1073ea thru 0x10753a (0x151 bytes) 000300[0] 1746069830.180030 read 0x703357 thru 0x70455f (0x1209 bytes) 000301[1] 1746069830.183433 trunc from 0x7cf937 to 0x9ae642 (0x1ded0c bytes) 000302[1] 1746069830.207212 write 0x84d762 thru 0x84f3ae (0x1c4d bytes) 000303[0] 1746069830.215634 mapwrite 0x7e2525 thru 0x7e29e5 (0x4c1 bytes) 000304[0] 1746069830.278160 mapread 0x5dac5f thru 0x5db7cb (0xb6d bytes) 000305[0] 1746069830.313456 mapread 0x75f299 thru 0x760547 (0x12af bytes) 000306[1] 1746069830.342788 read 0x63be54 thru 0x63daf9 (0x1ca6 bytes) 000307[1] 1746069830.353217 mapread 0x2e612e thru 0x2e7230 (0x1103 bytes) 000308[1] 1746069830.364022 trunc from 0x9ae643 to 0x6ce71d (0x2dff25 bytes) 000309[0] 1746069830.402718 mapwrite 0x022a7c thru 0x023a07 (0xf8c bytes) 000311[1] 1746069830.503201 mapread 0x38bdd5 thru 0x38c553 (0x77f bytes) 000313[0] 1746069830.536318 mapwrite 0x23737b thru 0x2386d3 (0x1359 bytes) 000314[1] 1746069830.600849 trunc from 0x6ce71e to 0x194335 (0x53a3e8 bytes) 000316[0] 1746069830.634919 mapwrite 0x27819a thru 0x27893e (0x7a5 bytes) 000317[1] 1746069830.736460 mapread 0x10680a thru 0x107576 (0xd6d bytes) 000320[1] 1746069830.780752 write 0x37958b thru 0x37a5ef (0x1065 bytes) 000322[1] 1746069830.820903 mapwrite 0x849b68 thru 0x84b389 (0x1822 bytes) 000324[1] 1746069830.902751 read 0x078988 thru 0x07a5c4 (0x1c3d bytes) 000326[0] 1746069830.937902 mapread 0x5074dd thru 0x507ef4 (0xa18 bytes) 000327[0] 1746069830.963431 trunc from 0x84b38a to 0x467f90 (0x3e33f9 bytes) 000330[1] 1746069831.020994 mapread 0x06e3a0 thru 0x06f7c1 (0x1422 bytes) 000334[1] 1746069831.094690 trunc from 0x467f91 to 0x6a278a (0x23a7fa bytes) 000340[0] 1746069831.147228 trunc from 0x6a278b to 0x678c2a (0x29b60 bytes) 000341[0] 1746069831.168692 trunc from 0x678c2b to 0x9799a9 (0x300d7f bytes) 000342[1] 1746069831.179486 mapwrite 0x72e4be thru 0x72ff77 (0x1aba bytes) 000346[1] 1746069831.284145 read 0x0ed7a1 thru 0x0ee845 (0x10a5 bytes) 000347[1] 1746069831.303813 write 0x739c4f thru 0x73b1df (0x1591 bytes) 000352[0] 1746069831.342015 mapwrite 0x84e6db thru 0x84f5cb (0xef1 bytes) 000354[1] 1746069831.427653 mapwrite 0x35ebab thru 0x35ff97 (0x13ed bytes) 000358[0] 1746069831.522431 read 0x82c167 thru 0x82c9b4 (0x84e bytes) 000359[1] 1746069831.534444 mapwrite 0x8a7e42 thru 0x8a7f44 (0x103 bytes) 000360[0] 1746069831.574424 mapread 0x311610 thru 0x3118ba (0x2ab bytes) 000362[0] 1746069831.588323 write 0x4d000e thru 0x4d0874 (0x867 bytes) 000363[0] 1746069831.617615 mapread 0x031e87 thru 0x031eaa (0x24 bytes) 000364[1] 1746069831.632077 write 0x061b91 thru 0x062df1 (0x1261 bytes) 000365[0] 1746069831.653516 write 0x1c8f7e thru 0x1c8f8a (0xd bytes) 000367[0] 1746069831.678806 write 0x2df583 thru 0x2e14ac (0x1f2a bytes) 000368[1] 1746069831.698251 mapread 0x2f0c35 thru 0x2f12fe (0x6ca bytes) 000369[1] 1746069831.722949 read 0x7e90e0 thru 0x7e995c (0x87d bytes) 000371[0] 1746069831.741320 trunc from 0x9799aa to 0x3f79bb (0x581fee bytes) 000372[1] 1746069831.779043 mapread 0x2a1a3c thru 0x2a344b (0x1a10 bytes) 000377[0] 1746069831.848940 mapwrite 0x95a4de thru 0x95af9a (0xabd bytes) 000380[1] 1746069831.938757 write 0x7f0cd1 thru 0x7f2641 (0x1971 bytes) 000383[0] 1746069832.007980 mapread 0x7eef82 thru 0x7ef19f (0x21e bytes) 000386[0] 1746069832.047600 write 0x596b3d thru 0x598672 (0x1b36 bytes) 000392[0] 1746069832.078703 mapread 0x4a0062 thru 0x4a0143 (0xe2 bytes) 000393[0] 1746069832.095617 mapread 0x4bdcd1 thru 0x4bf2ea (0x161a bytes) 000396[0] 1746069832.115895 mapwrite 0x4fd31b thru 0x4fef11 (0x1bf7 bytes) 000397[0] 1746069832.155895 read 0x863447 thru 0x863777 (0x331 bytes) 000398[1] 1746069832.170009 mapread 0x371326 thru 0x372cc9 (0x19a4 bytes) 000400[0] 1746069832.199629 read 0x279d0d thru 0x27a21b (0x50f bytes) 000404[1] 1746069832.237094 trunc from 0x95af9b to 0x1ac4a4 (0x7aeaf6 bytes) 000405[0] 1746069832.263182 write 0x1b197e thru 0x1b2ce2 (0x1365 bytes) 000407[0] 1746069832.285066 mapread 0x048f63 thru 0x049395 (0x433 bytes) 000410[0] 1746069832.334762 write 0x376774 thru 0x37798c (0x1219 bytes) 000412[0] 1746069832.361836 read 0x178a82 thru 0x179caf (0x122e bytes) 000413[0] 1746069832.401268 write 0x93d694 thru 0x93e123 (0xa90 bytes) 000415[1] 1746069832.428862 mapread 0x01b37d thru 0x01c87b (0x14ff bytes) 000416[1] 1746069832.473876 read 0x7e3e3e thru 0x7e5cd8 (0x1e9b bytes) 000417[1] 1746069832.486307 read 0x6f9ceb thru 0x6facf6 (0x100c bytes) 000419[0] 1746069832.507658 mapwrite 0x3cba11 thru 0x3cbd9b (0x38b bytes) 000422[0] 1746069832.581248 mapwrite 0x805a7f thru 0x805b28 (0xaa bytes) 000423[0] 1746069832.641835 write 0x231d6a thru 0x2334f2 (0x1789 bytes) 000429[0] 1746069832.724236 mapwrite 0x31c581 thru 0x31e0ad (0x1b2d bytes) 000430[0] 1746069832.789050 mapread 0x24ceae thru 0x24d754 (0x8a7 bytes) 000433[0] 1746069832.831695 trunc from 0x93e124 to 0x03d358 (0x900dcb bytes) 000434[0] 1746069832.853135 trunc from 0x03d359 to 0x93957b (0x8fc223 bytes) 000435[1] 1746069832.881501 write 0x640a40 thru 0x641a47 (0x1008 bytes) 000437[1] 1746069832.915563 mapread 0x71c361 thru 0x71d2fb (0xf9b bytes) 000439[0] 1746069832.947067 trunc from 0x93957c to 0x6cbaf2 (0x26da89 bytes) 000440[0] 1746069832.987673 mapwrite 0x64f3a5 thru 0x650d78 (0x19d4 bytes) 000441[0] 1746069833.060121 write 0x59811f thru 0x598405 (0x2e7 bytes) 000443[1] 1746069833.061368 mapread 0x3e6486 thru 0x3e690b (0x486 bytes) 000447[0] 1746069833.092948 mapread 0x397790 thru 0x399366 (0x1bd7 bytes) 000451[0] 1746069833.110144 mapread 0x34047a thru 0x342375 (0x1efc bytes) 000453[1] 1746069833.139356 trunc from 0x6cbaf3 to 0x2817d8 (0x44a31a bytes) 000455[1] 1746069833.206998 mapread 0x0f9b00 thru 0x0fae08 (0x1309 bytes) 000456[0] 1746069833.227751 trunc from 0x2817d9 to 0x3be9df (0x13d207 bytes) 000458[0] 1746069833.259281 write 0x2aa4de thru 0x2ab4ca (0xfed bytes) 000459[0] 1746069833.280810 mapwrite 0x5c70e7 thru 0x5c7f79 (0xe93 bytes) 000460[1] 1746069833.326447 mapwrite 0x410812 thru 0x4124fd (0x1cec bytes) 000461[1] 1746069833.400427 read 0x2a33f2 thru 0x2a3ef1 (0xb00 bytes) 000462[1] 1746069833.411198 trunc from 0x5c7f7a to 0x157b66 (0x470413 bytes) 000464[0] 1746069833.439415 write 0x2c48b6 thru 0x2c587f (0xfca bytes) 000465[0] 1746069833.452276 trunc from 0x2c5880 to 0x6c8509 (0x402c8a bytes) 000467[1] 1746069833.479181 trunc from 0x6c850a to 0x85068d (0x188184 bytes) 000468[1] 1746069833.514844 mapread 0x357f9a thru 0x359d63 (0x1dca bytes) 000469[0] 1746069833.521304 mapwrite 0x31a575 thru 0x31b84e (0x12da bytes) 000471[0] 1746069833.589118 read 0x6e914b thru 0x6ea68e (0x1544 bytes) 000473[0] 1746069833.624580 mapwrite 0x65a742 thru 0x65bff5 (0x18b4 bytes) 000477[0] 1746069833.697486 write 0x4bb9f4 thru 0x4bbf0c (0x519 bytes) 000478[0] 1746069833.708126 write 0x5a48f6 thru 0x5a4c6f (0x37a bytes) 000479[1] 1746069833.716559 trunc from 0x85068e to 0x384b21 (0x4cbb6c bytes) 000482[0] 1746069833.784577 mapread 0x304670 thru 0x305b8d (0x151e bytes) 000483[0] 1746069833.807915 mapwrite 0x4e1b87 thru 0x4e341d (0x1897 bytes) 000484[0] 1746069833.893673 read 0x3faa20 thru 0x3fb97a (0xf5b bytes) 000485[1] 1746069833.914147 read 0x01a8ee thru 0x01af6d (0x680 bytes) 000489[0] 1746069833.939225 write 0x5aa5af thru 0x5ab557 (0xfa9 bytes) 000492[1] 1746069833.967488 mapread 0x3d79af thru 0x3d80fe (0x750 bytes) 000493[0] 1746069833.984918 trunc from 0x5ab558 to 0x72d5d3 (0x18207c bytes) 000494[0] 1746069834.008782 trunc from 0x72d5d4 to 0x65b536 (0xd209d bytes) 000496[0] 1746069834.022609 trunc from 0x65b537 to 0x54573d (0x115df9 bytes) 000498[1] 1746069834.039637 read 0x2802eb thru 0x28116f (0xe85 bytes) 000499[0] 1746069834.055629 trunc from 0x54573e to 0x1ad9c1 (0x397d7c bytes) 000500[1] 1746069834.073118 write 0x224963 thru 0x225598 (0xc36 bytes) All operations completed A-OK! PASS 16b (13s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 23:23:56 (1746069836) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (1s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 23:23:58 (1746069838) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.248843 s, 33.7 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.210196 s, 39.9 MB/s ldlm.namespaces.MGC192.168.202.105@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800a94af800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3a5c000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800a94af800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b3a5c000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800a94af800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b3a5c000.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.77414 s, 15.5 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.76772 s, 59.3 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.02116 s, 103 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.95225 s, 35.5 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.0583 s, 20.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.45321 s, 72.2 MB/s PASS 16d (24s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 23:24:22 (1746069862) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0944609 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.075285 s, 13.9 MB/s PASS 16e (3s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 23:24:25 (1746069865) TIMEOUT PASS 16f (23s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 23:24:48 (1746069888) TIMEOUT PASS 16g (24s) == sanityn test 16h: mmap read after truncate file ======= 23:25:12 (1746069912) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (3s) == sanityn test 16i: read after truncate file ============ 23:25:15 (1746069915) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (3s) == sanityn test 16j: race dio with buffered i/o ========== 23:25:19 (1746069919) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.566183 s, 46.3 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.519612 s, 50.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.51825 s, 17.3 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.277709 s, 94.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.29829 s, 20.2 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.254803 s, 103 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.25869 s, 20.8 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.775748 s, 33.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.827916 s, 31.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.55913 s, 16.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.67649 s, 15.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.561915 s, 46.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.766625 s, 34.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.03142 s, 12.9 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.14161 s, 12.2 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.622566 s, 42.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.844012 s, 31.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.25161 s, 11.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.42661 s, 10.8 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (20s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 23:25:39 (1746069939) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported truncating to largest ever: 0x232e1d3 fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x1a7062c fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 Wed Apr 30 23:26:05 EDT 2025 + fsx 2 done: rc=0 Wed Apr 30 23:26:05 EDT 2025 + fsx 3 done: rc=0 Wed Apr 30 23:26:05 EDT 2025 + fsx 4 done: rc=0 Wed Apr 30 23:26:05 EDT 2025 + fsx 5 done: rc=0 Wed Apr 30 23:26:05 EDT 2025 PASS 16k (29s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 23:26:08 (1746069968) fail_loc=0x8000030a PASS 17 (7s) == sanityn test 18: mmap sanity check =========================================================================================== 23:26:15 (1746069975) mmap test1: basic mmap operation (PASS, 0.11181s) mmap test2: MAP_PRIVATE not write back (PASS, 0.059439s) mmap test3: concurrent mmap ops on two nodes (PASS, 16.95s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.2524s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.093788s) mmap test6: check mmap write/read content on two nodes (PASS, 0.14747s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.46227s) mmap test11: multi-thread shared mmap (PASS, 0.55004s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0397s) PASS 18 (28s) == sanityn test 19: test concurrent uncached read races ========================================================================= 23:26:43 (1746070003) oleg205-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg205-client: oleg205-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 23:26:45 (1746070005) PASS 20 (3s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 23:26:49 (1746070009) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (3s) == sanityn test 23: others should see updated atime while another read============================================================== 23:26:52 (1746070012) now is 1746070014 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 new atime is 1746070075 PASS 23 (65s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 23:27:57 (1746070077) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 114.5K 401 114.2K 1% /mnt/lustre[OST:1] filesystem_summary: 229.4K 386 229.0K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 401 114.2K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.4K 386 229.0K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 8.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 30.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 38.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118000 400 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117297 401 116896 1% /mnt/lustre2[OST:1] filesystem_summary: 234882 386 234496 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 401 114.2K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.4K 386 229.0K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre[MDT:0] filesystem_summary: 502242 386 501856 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118000 400 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117297 401 116896 1% /mnt/lustre2[OST:1] filesystem_summary: 234882 386 234496 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre2 PASS 24a (3s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 23:28:00 (1746070080) PASS 24b (3s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 23:28:03 (1746070083) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (3s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 23:28:06 (1746070086) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (2s) == sanityn test 26a: allow mtime to get older ============ 23:28:08 (1746070088) utime: good mknod times 1746070088 <= 1746070089 <= 1746070089 for /mnt/lustre/f26a utime: good mknod times 1746070088 <= 1746070089 <= 1746070089 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (4s) == sanityn test 26b: sync mtime between ost and mds ====== 23:28:12 (1746070092) PASS 26b (5s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 23:28:17 (1746070097) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-04-30 23:28:17.000000000 -0400 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-04-30 23:28:17.000000000 -0400 Birth: - PASS 26c (3s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 23:28:22 (1746070102) 0 PASS 30 (5s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 23:28:26 (1746070106) fail_loc=0x314 PASS 31a (4s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 23:28:30 (1746070110) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg205-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.202.105@tcp:/lustre 7542784 38912 7499776 1% /mnt/lustre2 PASS 31b (13s) == sanityn test 31r: open-rename(replace) race =========== 23:28:43 (1746070123) -rw-r--r-- 1 root root 0 Apr 30 23:28 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (6s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 23:28:49 (1746070129) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1213: 13531 Terminated tail -f $tfile PASS 31s (3s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 23:28:52 (1746070132) PASS 31t (5s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 23:28:58 (1746070138) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (2s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 23:29:00 (1746070140) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 23:29:01 (1746070141) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (2s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 23:29:03 (1746070143) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (1s) == sanityn test 34: no lock timeout under IO ============= 23:29:05 (1746070145) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg205-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a94af800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800a94af800.ost_server_uuid in IDLE state after 0 sec oleg205-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a94af800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800a94af800.ost_server_uuid in FULL state after 0 sec oleg205-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a94af800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800a94af800.ost_server_uuid in IDLE state after 0 sec oleg205-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a94af800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800a94af800.ost_server_uuid in FULL state after 0 sec oleg205-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a94af800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800a94af800.ost_server_uuid in IDLE state after 0 sec oleg205-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a94af800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800a94af800.ost_server_uuid in FULL state after 0 sec PASS 34 (97s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 23:30:41 (1746070241) fail_loc=0x80000317 Race attempt 0 Wait for 20184 20303 for 60 sec... - open/close 1477 (time 1746070254.95 total 10.00 last 147.70) - open/close 2942 (time 1746070264.95 total 20.01 last 146.39) total: 4000 open/close in 26.38 seconds: 151.62 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.202.105@tcp:/lustre 7.2G 40M 7.2G 1% /mnt/lustre 192.168.202.105@tcp:/lustre 7.2G 40M 7.2G 1% /mnt/lustre2 PASS 35 (66s) == sanityn test 36: handle ESTALE/open-unlink correctly == 23:31:47 (1746070307) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg205-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.601006 s, 87.2 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7497728) after_dd(7435264) after(7486464) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.482344 s, 109 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7486464) after_dd(7440384) after(7491584) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.636983 s, 82.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7491584) after_dd(7442432) after(7493632) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.694703 s, 75.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7493632) after_dd(7442432) after(7493632) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.665048 s, 78.8 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7493632) after_dd(7439360) after(7490560) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.585325 s, 89.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7490560) after_dd(7436288) after(7487488) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.673699 s, 77.8 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7487488) after_dd(7439360) after(7490560) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.679608 s, 77.1 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7490560) after_dd(7442432) after(7493632) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.599821 s, 87.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7493632) after_dd(7440384) after(7491584) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.429676 s, 122 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7491584) after_dd(7442432) after(7493632) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.607957 s, 86.2 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7493632) after_dd(7442432) after(7493632) PASS 36 (233s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 23:35:40 (1746070540) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 - create 3132 (time 1746070552.29 total 10.01 last 313.02) - create 5979 (time 1746070562.30 total 20.01 last 284.65) - create 8579 (time 1746070572.30 total 30.01 last 259.99) total: 10000 create in 35.30 seconds: 283.26 ops/second PASS 37 (41s) == sanityn test 39a: file mtime does not change after rename ========================================================== 23:36:21 (1746070581) repeat after cancel_lru_locks PASS 39a (4s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 23:36:25 (1746070585) repeat after cancel_lru_locks PASS 39b (5s) == sanityn test 39c: check truncate mtime update ================================================================================ 23:36:31 (1746070591) repeat after cancel_lru_locks PASS 39c (6s) == sanityn test 39d: sync write should update mtime ====== 23:36:36 (1746070596) fail_loc=0x411 fail_loc=0 PASS 39d (4s) == sanityn test 40a: pdirops: create vs others ======================================================================== 23:36:40 (1746070600) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (11s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 23:36:51 (1746070611) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (11s) == sanityn test 40c: pdirops: link and others ======================================================================== 23:37:02 (1746070622) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (10s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 23:37:12 (1746070632) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (11s) == sanityn test 40e: pdirops: rename and others ======================================================================== 23:37:23 (1746070643) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (10s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 23:37:33 (1746070653) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (8s) == sanityn test 41b: pdirops: create vs create ======================================================================== 23:37:41 (1746070661) open: File exists Conflict PASS 41b (7s) == sanityn test 41c: pdirops: create vs link ======================================================================== 23:37:48 (1746070668) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (7s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 23:37:55 (1746070675) Conflict PASS 41d (8s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 23:38:03 (1746070683) Conflict PASS 41e (6s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 23:38:09 (1746070689) Conflict PASS 41f (8s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 23:38:17 (1746070697) Conflict PASS 41g (9s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 23:38:26 (1746070706) Conflict PASS 41h (8s) == sanityn test 41i: reint_open: create vs create ======== 23:38:34 (1746070714) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (749s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 23:51:03 (1746071463) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (8s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 23:51:11 (1746071471) open: File exists Conflict PASS 42b (7s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 23:51:18 (1746071478) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (7s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 23:51:25 (1746071485) Conflict PASS 42d (7s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 23:51:32 (1746071492) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (7s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 23:51:39 (1746071499) Conflict PASS 42f (7s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 23:51:46 (1746071506) Conflict PASS 42g (7s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 23:51:53 (1746071513) Conflict PASS 42h (7s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 23:52:00 (1746071520) PASS 43a (31s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 23:52:31 (1746071551) Conflict PASS 43b (6s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 23:52:37 (1746071557) Conflict PASS 43c (7s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 23:52:44 (1746071564) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (6s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 23:52:50 (1746071570) Conflict PASS 43e (7s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 23:52:57 (1746071577) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (7s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 23:53:04 (1746071584) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (6s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 23:53:10 (1746071590) Conflict PASS 43h (7s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 23:53:17 (1746071597) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 23:53:18 (1746071598) mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (62s) == sanityn test 43k: unlink vs create ==================== 23:54:20 (1746071660) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (515s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 00:02:55 (1746072175) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Thu May 1 00:02:59 EDT 2025 PASS 44a (5s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 00:03:00 (1746072180) open: File exists Conflict PASS 44b (6s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 00:03:06 (1746072186) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (5s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 00:03:11 (1746072191) Conflict PASS 44d (5s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 00:03:16 (1746072196) Conflict PASS 44e (5s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 00:03:21 (1746072201) Conflict PASS 44f (5s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 00:03:26 (1746072206) Conflict PASS 44g (4s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 00:03:30 (1746072210) Conflict PASS 44h (5s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 00:03:35 (1746072215) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 00:03:36 (1746072216) PASS 45a (40s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 00:04:16 (1746072256) Conflict PASS 45b (5s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 00:04:21 (1746072261) Conflict PASS 45c (5s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 00:04:26 (1746072266) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (7s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 00:04:33 (1746072273) Conflict PASS 45e (6s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 00:04:39 (1746072279) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (6s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 00:04:46 (1746072286) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (6s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 00:04:51 (1746072291) Conflict PASS 45h (5s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 00:04:56 (1746072296) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 00:04:57 (1746072297) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (436s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 00:12:13 (1746072733) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (6s) == sanityn test 46b: pdirops: link vs create ======================================================================== 00:12:19 (1746072739) open: File exists Conflict PASS 46b (7s) == sanityn test 46c: pdirops: link vs link ======================================================================== 00:12:26 (1746072746) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (6s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 00:12:32 (1746072752) Conflict PASS 46d (6s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 00:12:38 (1746072758) Conflict PASS 46e (6s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 00:12:44 (1746072764) Conflict PASS 46f (5s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 00:12:49 (1746072769) Conflict PASS 46g (6s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 00:12:55 (1746072775) Conflict PASS 46h (5s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 00:13:00 (1746072780) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 00:13:01 (1746072781) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 00:13:03 (1746072783) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (2s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 00:13:04 (1746072784) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (1s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 00:13:05 (1746072785) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 00:13:06 (1746072786) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 00:13:07 (1746072787) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 00:13:08 (1746072788) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 00:13:09 (1746072789) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00983915 s, 1.0 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (7s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 00:13:17 (1746072797) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00961563 s, 16.5 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3519: kill: (10602) - No such process PASS 51a (4s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 00:13:21 (1746072801) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00826242 s, 124 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349096 s, 30.0 MB/s 3145728 PASS 51b (15s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 00:13:36 (1746072816) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0123559 s, 82.9 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 00:13:43 (1746072823) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173329 s, 60.5 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 00:13:46 (1746072826) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2448 0x990 0x240000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2448 0x990 0x240000400 read lease(1) has applied. PASS 51e (4s) == sanityn test 54: rename locking ======================= 00:13:50 (1746072830) llite.lustre-ffff8800a94af800.xattr_cache=1 llite.lustre-ffff8800b3a5c000.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505012 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 00:13:51.000000000 -0400 Modify: 2025-05-01 00:13:51.000000000 -0400 Change: 2025-05-01 00:13:51.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505015 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 00:13:56.000000000 -0400 Modify: 2025-05-01 00:13:57.000000000 -0400 Change: 2025-05-01 00:13:57.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505018 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 00:14:02.000000000 -0400 Modify: 2025-05-01 00:14:02.000000000 -0400 Change: 2025-05-01 00:14:02.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505017 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 00:14:02.000000000 -0400 Modify: 2025-05-01 00:14:02.000000000 -0400 Change: 2025-05-01 00:14:02.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505021 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 00:14:07.000000000 -0400 Modify: 2025-05-01 00:14:08.000000000 -0400 Change: 2025-05-01 00:14:08.000000000 -0400 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505020 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 00:14:07.000000000 -0400 Modify: 2025-05-01 00:14:08.000000000 -0400 Change: 2025-05-01 00:14:08.000000000 -0400 Birth: - PASS 54 (25s) == sanityn test 55a: rename vs unlink target dir ========= 00:14:15 (1746072855) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (7s) == sanityn test 55b: rename vs unlink source dir ========= 00:14:22 (1746072862) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (8s) == sanityn test 55c: rename vs unlink orphan target dir == 00:14:30 (1746072870) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (13s) == sanityn test 55d: rename file vs link ================= 00:14:43 (1746072883) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (9s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 00:14:52 (1746072892) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1746072893 chunksize: 4096 size: 16777216000000 write offset: 16384000000kB 1.38725 MB/s read offset: 16384000000kB inf MB/s llverdev: data verified successfully PASS 56a (47s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 00:15:39 (1746072939) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1746072940 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 3.21248 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (43s) == sanityn test 60: Verify data_version behaviour ======== 00:16:22 (1746072982) PASS 60 (2s) == sanityn test 70a: cd directory && rm directory ======== 00:16:24 (1746072984) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 00:16:27 (1746072987) PASS 70b (2s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 00:16:29 (1746072989) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00975224 s, 6.7 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (2s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 00:16:31 (1746072991) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00597442 s, 11.0 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 00:16:32 (1746072992) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (2s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 00:16:34 (1746072994) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00864578 s, 7.6 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 00:16:35 (1746072995) llite.lustre-ffff8800a94af800.xattr_cache=1 llite.lustre-ffff8800b3a5c000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (3s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 00:16:38 (1746072998) llite.lustre-ffff8800a94af800.xattr_cache=1 llite.lustre-ffff8800b3a5c000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (2s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 00:16:40 (1746073000) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00554895 s, 185 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00557742 s, 184 kB/s 23061: get lock2 23062: get lock1 23062: done 23062: get lock2 23061: done 23061: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 23061: cannot get lock1: Resource deadlock avoided 23062: done 23062: exit rc=0 23061: done 23061: exit rc=0 PASS 74 (7s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 00:16:47 (1746073007) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0232791 s, 90.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134656 s, 77.9 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4108: 23702 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (7s) == sanityn test 76: Verify MDT open_files listing ======== 00:16:54 (1746073014) opening files: ........ closing files: ........ PASS 76 (25s) == sanityn test 77a: check FIFO NRS policy =============== 00:17:19 (1746073039) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.136332 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206934 s, 50.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216884 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0468034 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559468 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0508454 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0519674 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0532201 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0531926 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0614593 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0654046 s, 16.0 MB/s , 0.0659642 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0703151 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.068664 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0653747 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0672854 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.073267 s, 14.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0209136 s, 50.1 MB/s 1048576 bytes (1.0 MB) copied, 0.00456534 s, 230 MB/s 1048576 bytes (1.0 MB) copied, 0.016823 s, 62.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00555912 s, 189 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174881 s, 60.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00620034 s, 169 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00865071 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020796 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207864 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209993 s, 49.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215385 s, 48.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224343 s, 46.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226075 s, 46.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177237 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208074 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217315 s, 48.3 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (4s) == sanityn test 77b: check CRR-N NRS policy ============== 00:17:23 (1746073043) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.218194 s, 76.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0338144 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240975 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370352 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0771059 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.068737 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0812874 s, 12.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.090368 s, 11.6 MB/s , 0.0796255 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.087004 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108251 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121431 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0885312 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102682 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12133 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103991 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128049 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0034161 s, 307 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.001853 s, 566 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154077 s, 68.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163959 s, 64.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164654 s, 63.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257834 s, 40.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329101 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189411 s, 55.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222441 s, 47.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00566523 s, 185 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219013 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341516 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245768 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186668 s, 56.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259127 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247141 s, 42.4 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.159977 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234425 s, 44.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316816 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.068737 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0737188 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0654614 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.07166 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0721632 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0772188 s, 13.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0835393 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.086261 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0844882 s, 12.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0937779 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0832882 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0939453 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0913679 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119826 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100694 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101135 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0016706 s, 628 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154261 s, 68.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0278529 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00183223 s, 572 MB/s , 0.00223059 s, 470 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316826 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00292709 s, 358 MB/s , 0.0285171 s, 36.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.039211 s, 26.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0355157 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116835 s, 89.7 MB/s , 0.023045 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104671 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108091 s, 97.0 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (5s) == sanityn test 77c: check ORR NRS policy ================ 00:17:28 (1746073048) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.152667 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221733 s, 47.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252854 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0487132 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0522069 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.068501 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0720748 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0749942 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0712501 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0750469 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0776179 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0812347 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0745029 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0840962 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0761387 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.087703 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0904425 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196539 s, 53.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00233258 s, 450 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291741 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268322 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00224061 s, 468 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0717289 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413809 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0766556 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0692294 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0277903 s, 37.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0478982 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00596363 s, 176 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226824 s, 46.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0161044 s, 65.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120706 s, 86.9 MB/s , 0.0145838 s, 71.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.15346 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233098 s, 45.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208301 s, 50.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0626818 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0713871 s, 14.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0695798 s, 15.1 MB/s , 0.0670282 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0734393 s, 14.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0756846 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0776315 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0618982 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0677047 s, 15.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0705108 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0740722 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0695405 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0772788 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0910446 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221133 s, 47.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146006 s, 71.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125957 s, 83.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261109 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101868 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259256 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123652 s, 84.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0134644 s, 77.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144793 s, 72.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162625 s, 64.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169658 s, 61.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196199 s, 53.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202221 s, 51.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0235408 s, 44.5 MB/s , 0.0223778 s, 46.9 MB/s , 0.023483 s, 44.7 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.15254 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202927 s, 51.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105198 s, 99.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307254 s, 34.1 MB/s , 0.0183269 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0520505 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0580613 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0528295 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0610336 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.060442 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0422309 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0670633 s, 15.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0790459 s, 13.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0698451 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0650326 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.068726 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0795014 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303109 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316783 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0438393 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0445254 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352438 s, 29.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0330273 s, 31.7 MB/s , 0.0340541 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033966 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369577 s, 28.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0363055 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0511916 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372609 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382127 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405298 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388386 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0439875 s, 23.8 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (7s) == sanityn test 77d: check TRR nrs policy ================ 00:17:35 (1746073055) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.135905 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015652 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00951911 s, 110 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195902 s, 53.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0210229 s, 49.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258642 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0843475 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0863498 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0907979 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0910581 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0902076 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0769179 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0762183 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0786227 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0762693 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0847216 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0943588 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203933 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154318 s, 67.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140568 s, 74.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141995 s, 73.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127167 s, 82.5 MB/s , 0.0127543 s, 82.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276684 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0335452 s, 31.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227986 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242207 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0023595 s, 444 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0255227 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205006 s, 51.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00968561 s, 108 MB/s 1048576 bytes (1.0 MB) copied, 0.0353786 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016456 s, 63.7 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.139373 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175648 s, 59.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151743 s, 69.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032193 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.077517 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0790687 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0896663 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.091064 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0766644 s, 13.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0987207 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100497 s, 10.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0803615 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100748 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0893288 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.092218 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0961408 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102594 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238744 s, 43.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018936 s, 55.4 MB/s , 0.0142455 s, 73.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233363 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00289833 s, 362 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150032 s, 69.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.001665 s, 630 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343938 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0433353 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00280826 s, 373 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130306 s, 80.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00188656 s, 556 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362423 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292134 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030256 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313151 s, 33.5 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.168152 s, 99.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172868 s, 60.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216397 s, 48.5 MB/s , 0.0213469 s, 49.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175761 s, 59.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.073785 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0784575 s, 13.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0818732 s, 12.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0684297 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0610737 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0675954 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0668603 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.071593 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0825253 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0782296 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0869069 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0953992 s, 11.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143765 s, 72.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00902065 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150089 s, 69.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190619 s, 55.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0105543 s, 99.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016593 s, 63.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.014707 s, 71.3 MB/s , 0.0110487 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129001 s, 81.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137739 s, 76.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143122 s, 73.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0151083 s, 69.4 MB/s , 0.0147789 s, 71.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159384 s, 65.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171955 s, 61.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167939 s, 62.4 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (5s) == sanityn test 77e: check TBF NID nrs policy ============ 00:17:40 (1746073060) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.202.5@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.111335 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013858 s, 75.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159491 s, 65.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0441314 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0378457 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0441749 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0501364 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0450982 s, 23.3 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0570137 s, 18.4 MB/s , 0.0439009 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0573277 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0712577 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0755491 s, 13.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0702052 s, 14.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0727256 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0751317 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0756322 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161291 s, 65.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191739 s, 54.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125868 s, 83.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112206 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115296 s, 90.9 MB/s 1+0 records in 1+0 records out , 0.0153993 s, 68.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0185298 s, 56.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135609 s, 77.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0158372 s, 66.2 MB/s , 0.0159113 s, 65.9 MB/s , 0.0159382 s, 65.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201605 s, 52.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205525 s, 51.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out , 0.0211677 s, 49.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0212871 s, 49.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0212765 s, 49.3 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.110726 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155592 s, 67.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193745 s, 54.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141511 s, 74.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185717 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0464991 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0596369 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462453 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0499348 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0647462 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0755084 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0682055 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101678 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0845981 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110015 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113597 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103709 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324835 s, 32.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0219311 s, 47.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0297168 s, 35.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0374565 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272279 s, 38.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0265022 s, 39.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0034029 s, 308 MB/s 1048576 bytes (1.0 MB) copied, 0.0205153 s, 51.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191129 s, 54.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0170318 s, 61.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0152669 s, 68.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139705 s, 75.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123568 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197424 s, 53.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111756 s, 93.8 MB/s 1048576 bytes (1.0 MB) copied, 0.013121 s, 79.9 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.121454 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116894 s, 89.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010911 s, 96.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188071 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0346122 s, 30.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0333323 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0319589 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0457047 s, 22.9 MB/s , 0.0449592 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.048517 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04264 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0428688 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0570349 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0448047 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0465851 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0571449 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0551123 s, 19.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0090004 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108104 s, 97.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00934377 s, 112 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0156132 s, 67.2 MB/s , 0.00915715 s, 115 MB/s 1048576 bytes (1.0 MB) copied, 0.0100405 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104514 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011991 s, 87.4 MB/s , 0.0122657 s, 85.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127413 s, 82.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138527 s, 75.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142387 s, 73.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150708 s, 69.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015304 s, 68.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162034 s, 64.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174677 s, 60.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.124373 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216103 s, 48.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145433 s, 72.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405871 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506706 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0590727 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0643512 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0631974 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.059428 s, 17.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0621148 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0577185 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0637836 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0583377 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0566015 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0713633 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0721638 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0755369 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120493 s, 87.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00493016 s, 213 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00329211 s, 319 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187648 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019082 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00572387 s, 183 MB/s 1048576 bytes (1.0 MB) copied, 0.0055927 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0346709 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0022117 s, 474 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196603 s, 53.3 MB/s , 0.00188117 s, 557 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192836 s, 54.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164468 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145606 s, 72.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117142 s, 89.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103249 s, 102 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (9s) == sanityn test 77f: check TBF JobID nrs policy ========== 00:17:49 (1746073069) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.164955 s, 102 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115629 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249225 s, 42.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0640889 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0671274 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0683239 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.075303 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0742811 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0677206 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0799586 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0833515 s, 12.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0938849 s, 11.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0931291 s, 11.3 MB/s , 0.0936237 s, 11.2 MB/s 1048576 bytes (1.0 MB) copied, 0.087227 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0905072 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102411 s, 10.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249475 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029981 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313101 s, 33.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262499 s, 39.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0263245 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247833 s, 42.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220835 s, 47.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238361 s, 44.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240687 s, 43.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0194295 s, 54.0 MB/s , 0.0233827 s, 44.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225182 s, 46.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0303001 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245601 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223349 s, 46.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0338142 s, 31.0 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.119085 s, 141 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224281 s, 46.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185294 s, 56.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0863628 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0850716 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0896047 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0778041 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0820513 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0984324 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102067 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106936 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100164 s, 10.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0991592 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100231 s, 10.5 MB/s 1048576 bytes (1.0 MB) copied, 0.108733 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109256 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123945 s, 8.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101272 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00818598 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242825 s, 43.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115639 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012973 s, 80.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101131 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111952 s, 93.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122597 s, 85.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124278 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133534 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344709 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156575 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235676 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183239 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200334 s, 52.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021163 s, 49.5 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.124379 s, 135 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011286 s, 92.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206158 s, 50.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113614 s, 92.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245338 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.039652 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0655879 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0504612 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0690327 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0511728 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0704106 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0651636 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0673332 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0837042 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0710386 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0791996 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104366 s, 10.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152249 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00162941 s, 644 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160978 s, 65.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154485 s, 67.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00150864 s, 695 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171798 s, 61.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00220251 s, 476 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160868 s, 65.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026217 s, 40.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269955 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243653 s, 43.0 MB/s 1048576 bytes (1.0 MB) copied, 0.00211078 s, 497 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0306555 s, 34.2 MB/s , 0.0307582 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260762 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00440803 s, 238 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.136844 s, 123 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131288 s, 79.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193544 s, 54.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0582785 s, 18.0 MB/s , 0.0617651 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0694899 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0663928 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0634042 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0729581 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0668127 s, 15.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.071636 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0733844 s, 14.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0755457 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0712092 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0795138 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0826801 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0784296 s, 13.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238762 s, 43.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00446776 s, 235 MB/s , 0.00173918 s, 603 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216629 s, 48.4 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0267636 s, 39.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0035095 s, 299 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00186647 s, 562 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00813845 s, 129 MB/s 1048576 bytes (1.0 MB) copied, 0.00336556 s, 312 MB/s 1048576 bytes (1.0 MB) copied, 0.00938263 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210131 s, 49.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00162318 s, 646 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240833 s, 43.5 MB/s , 0.0201295 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0255671 s, 41.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188394 s, 55.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (8s) == sanityn test 77g: Change TBF type directly ============ 00:17:57 (1746073077) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (4s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 00:18:01 (1746073081) oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg205-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg205-client: oleg205-server: ssh exited with exit code 2 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg205-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg205-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg205-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12 PASS 77h (5s) == sanityn test 77i: Change rank of TBF rule ============= 00:18:06 (1746073086) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (9s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 00:18:15 (1746073095) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.124344 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126908 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107473 s, 97.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158384 s, 66.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0477496 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401075 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.051617 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469131 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0460398 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0612388 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0828973 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0757204 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0876828 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0884002 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0852135 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0853701 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0950848 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219968 s, 47.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00566686 s, 185 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215896 s, 48.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234686 s, 44.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192351 s, 54.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260407 s, 40.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231533 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00793699 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214683 s, 48.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00230182 s, 456 MB/s 1048576 bytes (1.0 MB) copied, 0.0145278 s, 72.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0017759 s, 590 MB/s , 0.00178591 s, 587 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188075 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00378233 s, 277 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212807 s, 49.3 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.30646 s, 19.8 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4877 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (51s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 00:19:06 (1746073146) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg205-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg205-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg205-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg205-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.23519 s, 13.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00713064 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230282 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325489 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404117 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0422481 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416453 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0522729 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0560295 s, 18.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.140878 s, 7.4 MB/s , 0.138652 s, 7.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.156003 s, 6.7 MB/s , 0.144797 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.156351 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160798 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.16786 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154841 s, 6.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134661 s, 77.9 MB/s , 0.0160136 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171957 s, 61.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164755 s, 63.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145766 s, 71.9 MB/s , 0.013677 s, 76.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148696 s, 70.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158634 s, 66.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189186 s, 55.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189772 s, 55.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0196562 s, 53.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0198232 s, 52.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022041 s, 47.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220426 s, 47.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235034 s, 44.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287153 s, 36.5 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9131 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9589 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg205-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg205-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg205-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg205-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.26157 s, 13.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0473713 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0544124 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0776508 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0817402 s, 12.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106793 s, 9.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0837111 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123238 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110066 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113119 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.16943 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.165857 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178275 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.195809 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.201468 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.200444 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.209516 s, 5.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0318803 s, 32.9 MB/s 1+0 records in 1+0 records out , 0.0329839 s, 31.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0317877 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276516 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285527 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302601 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389129 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389484 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343555 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.038477 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358267 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370625 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0278112 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300295 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404261 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357193 s, 29.4 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8447 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9323 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (135s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 00:21:21 (1746073281) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg205-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg205-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg205-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg205-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.2485 s, 13.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.057967 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0663427 s, 15.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0775656 s, 13.5 MB/s , 0.0751401 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0993852 s, 10.6 MB/s , 0.0995997 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107274 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0983234 s, 10.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.115784 s, 9.1 MB/s , 0.115055 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147089 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149354 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.157384 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.182434 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178076 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.194454 s, 5.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178306 s, 58.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162711 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200817 s, 52.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0202291 s, 51.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0206727 s, 50.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217041 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216893 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209132 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209239 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212674 s, 49.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206928 s, 50.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0201868 s, 51.9 MB/s , 0.0215541 s, 48.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221911 s, 47.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0218228 s, 48.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025673 s, 40.8 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8942 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9289 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg205-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg205-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg205-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg205-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.25023 s, 13.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0673908 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0788395 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.099544 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0987906 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0961276 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.095312 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107128 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129306 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0798304 s, 13.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0910732 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147089 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0943421 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144742 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148227 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121578 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169115 s, 6.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229007 s, 45.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206065 s, 50.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248741 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229936 s, 45.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262154 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277594 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285645 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285736 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307999 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349599 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373777 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374025 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389305 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412836 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424944 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481432 s, 21.8 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7757 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9823 s, 5.2 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (137s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 00:23:38 (1746073418) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.326112 s, 51.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158939 s, 66.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0078498 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192559 s, 54.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114625 s, 91.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0628177 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0668035 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0498685 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.047619 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0494175 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495374 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0503484 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0551377 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0778645 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.065669 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0899752 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0795262 s, 13.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217217 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185272 s, 56.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207311 s, 50.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211855 s, 49.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022254 s, 47.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279666 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216788 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217773 s, 48.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235861 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259279 s, 40.4 MB/s , 0.0261428 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257528 s, 40.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264482 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272817 s, 38.4 MB/s , 0.0293586 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031166 s, 33.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.68518 s, 18.4 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.79373 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.202.5@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.202.5@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.238646 s, 70.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013733 s, 76.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016991 s, 61.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436999 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0516917 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0516887 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0475611 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0532889 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0547652 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0518071 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0518583 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0537666 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0574364 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.251198 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.256768 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.312878 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.31653 s, 3.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115007 s, 91.2 MB/s , 0.0195762 s, 53.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173204 s, 60.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0128696 s, 81.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0132 s, 79.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115757 s, 90.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246391 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121233 s, 86.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013936 s, 75.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00167304 s, 627 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00172658 s, 607 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179204 s, 58.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115627 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00176294 s, 595 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173939 s, 60.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01809 s, 58.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.60567 s, 18.7 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82312 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.202.5@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.35786 s, 46.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332767 s, 31.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0310118 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341069 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0696431 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0798857 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0617293 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0894576 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0954653 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0957849 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0961487 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0889353 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.138738 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125863 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108689 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124167 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148827 s, 7.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0433609 s, 24.2 MB/s , 0.0430313 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447132 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353468 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0376345 s, 27.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0535007 s, 19.6 MB/s , 0.0423858 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030512 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261452 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0346251 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316433 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326462 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377976 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388916 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396548 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0403001 s, 26.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.06122 s, 17.3 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.98627 s, 21.0 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.48933 s, 34.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449937 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0321578 s, 32.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0440857 s, 23.8 MB/s , 0.0292152 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238028 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385605 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447173 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.237128 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.239221 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.253018 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.249737 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.282283 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.283697 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.247264 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.314754 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.333013 s, 3.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033788 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019178 s, 54.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220039 s, 47.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444887 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283819 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0375235 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0333258 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361625 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.038555 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0496647 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0458969 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04855 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.05153 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0525178 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0549968 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.056978 s, 18.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 10.0207 s, 10.5 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82367 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.10725 s, 17.2 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82297 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.888797 s, 18.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203705 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0499801 s, 21.0 MB/s , 0.0461343 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0419185 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387759 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0671496 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0604352 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0601841 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126514 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130683 s, 8.0 MB/s , 0.137809 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130902 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.166508 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143302 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169994 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160566 s, 6.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286143 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00848347 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00156138 s, 672 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00967979 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227608 s, 46.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173465 s, 60.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132651 s, 79.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133498 s, 78.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135112 s, 77.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0360938 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155537 s, 67.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157174 s, 66.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174484 s, 60.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288927 s, 36.3 MB/s , 0.0180063 s, 58.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185721 s, 56.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.6678 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4877 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.32099 s, 52.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361042 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305586 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0766418 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0765565 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0812474 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0874699 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0953639 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.098489 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107877 s, 9.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.116698 s, 9.0 MB/s 1048576 bytes (1.0 MB) copied, 0.116917 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109289 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115255 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115566 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126173 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13263 s, 7.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00172951 s, 606 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00534033 s, 196 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00287075 s, 365 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0317521 s, 33.0 MB/s , 0.0191097 s, 54.9 MB/s , 0.034917 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.043929 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0290357 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0451418 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00260194 s, 403 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00351446 s, 298 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0224924 s, 46.6 MB/s , 0.0465886 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0471182 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0483451 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01765 s, 59.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.54862 s, 18.9 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.7845 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.4777 s, 35.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204128 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235653 s, 44.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0455951 s, 23.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0481782 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0636078 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0722009 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0584911 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0729437 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0651573 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0816249 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0617477 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0817488 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112099 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107077 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104879 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132913 s, 7.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222861 s, 47.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141457 s, 74.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152703 s, 68.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202488 s, 51.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0155606 s, 67.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186794 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188231 s, 55.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0193431 s, 54.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0354625 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201875 s, 51.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168436 s, 62.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0176041 s, 59.6 MB/s , 0.0242266 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0199437 s, 52.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236975 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240734 s, 43.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.9279 s, 10.6 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80726 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.92987 s, 10.6 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81043 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (362s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 00:29:40 (1746073780) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (4s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 00:29:44 (1746073784) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg205-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.89405 s, 269 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg205-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0628 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (53s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 00:30:37 (1746073837) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.198876 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212891 s, 49.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407177 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.070168 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0578231 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0766027 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.076471 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0579477 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0573427 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0620777 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0951823 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0969187 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0922736 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0731852 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0794777 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0851014 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100482 s, 10.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0346735 s, 30.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0450551 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371577 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369727 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372113 s, 28.2 MB/s , 0.0522718 s, 20.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0431832 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284752 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.036755 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223387 s, 46.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353965 s, 29.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360429 s, 29.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0115208 s, 91.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0379153 s, 27.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0213322 s, 49.2 MB/s , 0.0407416 s, 25.7 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg205-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.3603 s, 16.5 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96804 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.233024 s, 72.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241561 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201428 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268509 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101461 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112833 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121329 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119009 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123987 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130248 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126866 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132296 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.142033 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141204 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.14075 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.140352 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148408 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243705 s, 43.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030252 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019952 s, 52.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0174906 s, 60.0 MB/s , 0.0176118 s, 59.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193131 s, 54.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222458 s, 47.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310972 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336594 s, 31.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0345699 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368365 s, 28.5 MB/s , 0.0380071 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0400292 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427074 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0450858 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04956 s, 21.2 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg205-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg205-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.38555 s, 19.5 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97968 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (71s) == sanityn test 77o: Changing rank should not panic ====== 00:31:49 (1746073909) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (6s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 00:31:55 (1746073915) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (51s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 00:32:47 (1746073967) mds.MDS.mdt.nrs_policies=tbf oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg205-client: oleg205-server: ssh exited with exit code 36 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg205-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (21s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 00:33:07 (1746073987) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 20399 kill md_thread xargs PASS 77r (41s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 00:33:49 (1746074029) oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device oleg205-server: error: set_param: setting 'ost/OSS/*/nrs_orr_quantum'='1': No such device pdsh@oleg205-client: oleg205-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (5s) == sanityn test 79: xattr: intent error ================== 00:33:54 (1746074034) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505770 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 00:33:55.000000000 -0400 Modify: 2025-05-01 00:33:55.000000000 -0400 Change: 2025-05-01 00:33:55.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (14s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 00:34:08 (1746074048) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (2s) == sanityn test 80b: Accessing directory during migration ========================================================== 00:34:10 (1746074050) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (2s) == sanityn test 81a: rename and stat under striped directory ========================================================== 00:34:12 (1746074052) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 00:34:13 (1746074053) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (2s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 00:34:15 (1746074055) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 00:34:16 (1746074056) - open/close 1254 (time 1746074069.10 total 10.00 last 125.34) - open/close 2439 (time 1746074079.11 total 20.01 last 118.42) total: 2500 open/close in 20.50 seconds: 121.94 ops/second snapshot_time 1746074124.172608083 secs.nsecs start_time 1746074057.849986996 secs.nsecs elapsed_time 66.322621087 secs.nsecs open 2505 samples [usecs] 101 6713 1680702 1794386920 close 2504 samples [usecs] 102 6874 653147 398703909 mknod 2501 samples [usecs] 287 6344 1416259 1265545627 unlink 2500 samples [usecs] 392 44597 2891103 16647803011 mkdir 2 samples [usecs] 775 1456 2231 2720561 rmdir 2 samples [usecs] 5636 9362 14998 119411540 rename 2500 samples [usecs] 291 57063 8910669 66211496889 getattr 3765 samples [usecs] 5 3566 98570 43755520 parallel_rename_file 2500 samples [usecs] 291 57063 8910669 66211496889 crossdir_rename 2500 samples [usecs] 291 57063 8910669 66211496889 PASS 81d (70s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 00:35:27 (1746074127) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7041 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7041 PASS 82 (3s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 00:35:30 (1746074130) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (2s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 00:35:32 (1746074132) fail_loc=0x8000060b PASS 84 (8s) == sanityn test 85: Lustre API root cache race =========== 00:35:40 (1746074140) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1746074141 Finishing test test1 at 1746074143 PASS 85 (6s) == sanityn test 90: open/create and unlink striped directory ========================================================== 00:35:46 (1746074146) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 00:35:48 (1746074148) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 00:35:50 (1746074150) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (1s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 00:35:51 (1746074151) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5125 0x1405 0x280000400 0 5141 0x1415 0x240000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5142 0x1416 0x240000400 1 5126 0x1406 0x280000400 rc1=0 and rc2=0 PASS 93 (12s) == sanityn test 94: signal vs CP callback race =========== 00:36:03 (1746074163) osc.lustre-OST0000-osc-ffff8800a94af800.idle_timeout=0 osc.lustre-OST0000-osc-ffff8800b3a5c000.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800a94af800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b3a5c000.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.20377 s, 40.2 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.02477 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5764: 2871 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0335225 s, 122 kB/s osc.lustre-OST0000-osc-ffff8800a94af800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b3a5c000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a94af800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3a5c000.idle_timeout=debug PASS 94 (12s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 00:36:15 (1746074175) llite.lustre-ffff8800a94af800.fast_read=0 llite.lustre-ffff8800b3a5c000.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0326941 s, 64.1 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff8800a94af800.fast_read=1 llite.lustre-ffff8800b3a5c000.fast_read=1 PASS 95a (22s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 00:36:37 (1746074197) llite.lustre-ffff8800a94af800.fast_read=0 llite.lustre-ffff8800b3a5c000.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00495458 s, 2.5 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800a94af800.fast_read=1 llite.lustre-ffff8800b3a5c000.fast_read=1 PASS 95b (10s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 00:36:47 (1746074207) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (2s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 00:36:49 (1746074209) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00588789 s, 696 kB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (4s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 00:36:53 (1746074213) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0453959 s, 46.2 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (4s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 00:36:57 (1746074217) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0530202 s, 39.6 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (3s) == sanityn test 100e: DoM: read on open and file size ==== 00:37:00 (1746074220) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00325528 s, 3.7 MB/s PASS 100e (4s) == sanityn test 101a: Discard DoM data on unlink ========= 00:37:04 (1746074224) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0039468 s, 1.0 MB/s PASS 101a (4s) == sanityn test 101b: Discard DoM data on rename ========= 00:37:08 (1746074228) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000856219 s, 4.8 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 00:37:11 (1746074231) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00113757 s, 3.6 MB/s PASS 101c (5s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 00:37:17 (1746074237) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1746074238 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1746074241 Finishing test test23 at 1746074241 PASS 103 (9s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 00:37:26 (1746074246) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (2s) == sanityn test 105: Glimpse and lock cancel race ======== 00:37:28 (1746074248) fail_loc=0x416 PASS 105 (24s) == sanityn test 106a: Verify the btime via statx() ======= 00:37:52 (1746074272) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 00:37:54 (1746074274) SKIP: sanityn test_106b statx() only test SKIP 106b (2s) == sanityn test 106c: Verify statx attributes mask ======= 00:37:55 (1746074275) SKIP: sanityn test_106c statx() only test SKIP 106c (2s) == sanityn test 107a: Basic grouplock conflict =========== 00:37:57 (1746074277) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.166644 s, 62.9 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5131 0x140b 0x280000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 First grouplock blocks second one PASS 107a (6s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 00:38:03 (1746074283) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.130458 s, 80.4 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5150 0x141e 0x240000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7041 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (10s) == sanityn test 108a: lseek: parallel updates ============ 00:38:13 (1746074293) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.0100251 s, 997 kB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.41702 s, 1.9 MB/s PASS 108a (8s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 00:38:21 (1746074301) 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 4 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 5 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 6 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 9 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 11 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 12 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 16 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 18 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 20 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 21 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 22 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 24 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 26 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 28 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 29 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 31 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 32 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 34 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 35 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 36 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 37 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 42 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 46 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 47 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.202.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2 PASS 109 (629s) == sanityn test 110: do not grant another lock on resend ========================================================== 00:48:50 (1746074930) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 00:48:51.000000000 -0400 Modify: 2025-05-01 00:48:51.000000000 -0400 Change: 2025-05-01 00:48:51.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg205-client.virtnet oleg205-client.virtnet PASS 110 (66s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 00:49:56 (1746074996) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (2s) == sanityn test 112: update max-inherit in default LMV === 00:49:58 (1746074998) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (2s) == sanityn test 113: check servers of specified fs ======= 00:50:00 (1746075000) lustre-OST0000-osc-ffff8800a83a4000 active. lustre-OST0001-osc-ffff8800a83a4000 active. lustre-OST0000-osc-ffff8800a83a4000 active. lustre-OST0001-osc-ffff8800a83a4000 active. MGC192.168.202.105@tcp active. PASS 113 (4s) == sanityn test 114: implicit default LMV inherit ======== 00:50:04 (1746075004) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (2s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 00:50:06 (1746075006) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (1s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 00:50:08 (1746075008) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (1s) == sanityn test 200: service remains healthy while able to process request ========================================================== 00:50:10 (1746075010) at_max=10 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=20 fail_loc=0x1e1 fail_val=20 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1149 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1782 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1341 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1381 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1311 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1303 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1553 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1463 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1555 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1481 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1645 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1436 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2212 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1827 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2185 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1569 s, 0.1 kB/s , 40.2082 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1721 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2187 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3358 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2567 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2322 s, 0.1 kB/s , 60.2433 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.1923 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3345 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3119 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3206 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3247 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.5297 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3596 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4036 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3905 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4852 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4419 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4381 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4339 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.454 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.533 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.551 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.571 s, 0.0 kB/s at_max=600 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=116 oleg205-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a7de2000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800a7de2000.ost_server_uuid in IDLE state after 0 sec PASS 200 (111s) cleanup: ====================================================== == sanityn test complete, duration 5587 sec ============== 00:52:01 (1746075121) === sanityn: start cleanup 00:52:02 (1746075122) === Stopping clients: oleg205-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg205-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 00:54:23 (1746075263) ===