-----============= acceptance-small: sanityn ============----- Thu May 1 15:28:34 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg328-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 15:28:45 (1746127725) === Starting client oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Started clients oleg328-client.virtnet: 192.168.203.128@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) oleg328-client.virtnet: executing check_config_client /mnt/lustre oleg328-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg328-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5c14000.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012d012800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c14000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012d012800.idle_timeout=debug disable quota as required oleg328-server: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 15:28:59 (1746127739) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260482 s, 40.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7024] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 15:29:00 (1746127740) PASS 0 (4s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 15:29:04 (1746127744) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 15:29:06 (1746127746) -rw-r--r-- 1 root root 0 May 1 15:29 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (3s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 15:29:09 (1746127749) -rw-r--r-- 1 root root 0 May 1 15:29 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (3s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 15:29:13 (1746127753) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 15:29:15 (1746127755) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (3s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 15:29:18 (1746127758) total 1 -rwxrwxrwx 1 root root 0 May 1 15:29 f2a -rwxrwxrwx 1 root root 0 May 1 15:29 f2b total 1 -rwxrwxrwx 1 root root 0 May 1 15:29 f2a -rwxrwxrwx 1 root root 0 May 1 15:29 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.0112137 s, 45.7 kB/s PASS 2e (3s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 15:29:21 (1746127761) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 15:29:22 (1746127762) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.215294 s, 9.7 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (3s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 15:29:25 (1746127765) PASS 3 (3s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 15:29:28 (1746127768) PASS 4 (4s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 15:29:33 (1746127773) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (4s) == sanityn test 6: remove of open file on other node ============================================================================ 15:29:36 (1746127776) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (2s) == sanityn test 7: remove of open directory on other node ======================================================================= 15:29:38 (1746127778) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (3s) == sanityn test 8: remove of open special file on other node ==================================================================== 15:29:41 (1746127781) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (3s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 15:29:44 (1746127784) PASS 9a (4s) == sanityn test 9b: append to striped sparse file ======== 15:29:48 (1746127788) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289619 s, 36.2 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0335988 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (3s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 15:29:52 (1746127792) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00542918 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00844306 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00595231 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00578389 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00494796 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00754045 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00630375 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00568501 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00474379 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00560843 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0105179 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0119265 s, 0.1 kB/s PASS 10a (4s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 15:29:56 (1746127796) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.0230169 s, 133 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0137298 s, 298 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000217455 s, 14.1 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 15:29:59 (1746127799) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (3s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 15:30:02 (1746127802) warning: '-runtime' deprecated, use '-t runtime' instead - link 831 (time 1746127813.02 total 10.01 last 83.04) - link 1525 (time 1746127823.02 total 20.01 last 69.37) - link 2302 (time 1746127833.04 total 30.03 last 77.58) - link 3069 (time 1746127843.04 total 40.03 last 76.66) - link 3927 (time 1746127853.06 total 50.05 last 85.64) - link 4734 (time 1746127863.08 total 60.07 last 80.54) - link 5604 (time 1746127873.09 total 70.08 last 86.91) - link 6546 (time 1746127883.09 total 80.08 last 94.19) - link 7345 (time 1746127893.10 total 90.09 last 79.86) total: 8244 link in 100.02 seconds: 82.42 ops/second using seed 946338834 running for 100 seconds - stat 10000 (time 1746127810 ; total 6 ; last 6) - stat 20000 (time 1746127817 ; total 13 ; last 7) - stat 30000 (time 1746127823 ; total 19 ; last 6) - stat 40000 (time 1746127830 ; total 26 ; last 7) - stat 50000 (time 1746127837 ; total 33 ; last 7) - stat 60000 (time 1746127844 ; total 40 ; last 7) - stat 70000 (time 1746127851 ; total 47 ; last 7) - stat 76638 (time 1746127862 ; total 58 ; last 11) - stat 80000 (time 1746127871 ; total 67 ; last 9) - stat 83511 (time 1746127882 ; total 78 ; last 11) - stat 86633 (time 1746127893 ; total 89 ; last 11) - stat 90000 (time 1746127902 ; total 98 ; last 9) total: 90520 stats in 100 seconds: 905.200012 stats/second - unlinked 0 (time 1746127854 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile8244) error: No such file or directory total: 8243 unlinks in 96 seconds: 85.864586 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (22065) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (22068) - No such process PASS 12 (150s) == sanityn test 13: test directory page revocation ======= 15:32:32 (1746127952) f13 f13 PASS 13 (5s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 15:32:37 (1746127957) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4880: 23469 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (4s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 15:32:41 (1746127961) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4880: 24105 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (3s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 15:32:45 (1746127965) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 24739 Terminated $DIR1/$tdir/sleep 60 PASS 14b (3s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 15:32:48 (1746127968) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 25375 Terminated $DIR1/$tdir/sleep 60 PASS 14c (4s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 15:32:52 (1746127972) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 26011 Terminated $DIR1/$tdir/sleep 60 PASS 14d (5s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 15:32:57 (1746127977) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7521280 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7521280kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (18s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 15:33:16 (1746127996) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.3698 s, 22.7 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.317456 s, 26.4 MB/s Chance of close/open is 1 in 50 Seed set to 7998 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[0] 1746127998.831738 mapwrite 0x8cd937 thru 0x8d1717 (0x3de1 bytes) 000002[0] 1746127998.970056 read 0x267da6 thru 0x268718 (0x973 bytes) 000003[0] 1746127998.977868 mapwrite 0x100215 thru 0x1050c2 (0x4eae bytes) truncating to largest ever: 0x66535c 000004[0] 1746127999.112447 trunc from 0x8d1718 to 0x66535b (0x26c3bc bytes) 000009[0] 1746127999.162800 mapread 0x48b953 thru 0x494b0b (0x91b9 bytes) 000010[1] 1746127999.191060 mapread 0x3d9ca3 thru 0x3dc010 (0x236e bytes) 000011[1] 1746127999.232824 trunc from 0x66535c to 0x1f7b20 (0x46d83b bytes) 000012[1] 1746127999.259602 trunc from 0x1f7b21 to 0x11e849 (0xd92d7 bytes) truncating to largest ever: 0x7b09fe 000014[0] 1746127999.286728 trunc from 0x11e84a to 0x7b09fd (0x6921b4 bytes) truncating to largest ever: 0x821657 000020[0] 1746127999.356794 trunc from 0x7b09fe to 0x821656 (0x70c59 bytes) 000022[0] 1746127999.388591 mapread 0x0e43e5 thru 0x0ed4a4 (0x90c0 bytes) 000024[1] 1746127999.416301 read 0x1cafb6 thru 0x1d1079 (0x60c4 bytes) 000025[1] 1746127999.438296 mapread 0x4a457b thru 0x4a99b5 (0x543b bytes) 000029[0] 1746127999.467025 write 0x5b5a9a thru 0x5b7c6b (0x21d2 bytes) 000030[0] 1746127999.482841 write 0x9d5c88 thru 0x9e24aa (0xc823 bytes) 000031[1] 1746127999.496622 mapwrite 0x11a674 thru 0x128c90 (0xe61d bytes) 000032[0] 1746127999.628002 mapread 0x317413 thru 0x324093 (0xcc81 bytes) 000035[0] 1746127999.707383 mapwrite 0x12ad38 thru 0x12cb4e (0x1e17 bytes) 000036[1] 1746127999.794441 write 0x921ddf thru 0x925804 (0x3a26 bytes) 000039[1] 1746127999.854656 mapwrite 0x658078 thru 0x665545 (0xd4ce bytes) 000042[0] 1746127999.977757 trunc from 0x9e24ab to 0x764330 (0x27e17a bytes) 000043[0] 1746128000.012538 write 0x814e6b thru 0x821026 (0xc1bc bytes) 000044[0] 1746128000.025120 mapread 0x1b10a9 thru 0x1bee5a (0xddb2 bytes) 000045[0] 1746128000.048155 trunc from 0x821027 to 0x765709 (0xbb91d bytes) 000046[1] 1746128000.068401 trunc from 0x76570a to 0x27084f (0x4f4eba bytes) 000047[0] 1746128000.115697 mapread 0x221aa8 thru 0x2303d0 (0xe929 bytes) 000048[1] 1746128000.172437 read 0x10076d thru 0x101a61 (0x12f5 bytes) 000050[1] 1746128000.252453 mapread 0x1c1bbe thru 0x1cefae (0xd3f1 bytes) 000052[0] 1746128000.297048 mapread 0x0b5767 thru 0x0b746b (0x1d05 bytes) 000053[1] 1746128000.334808 mapwrite 0x7ce984 thru 0x7d3341 (0x49be bytes) 000056[1] 1746128000.537434 read 0x6701dd thru 0x674c1d (0x4a41 bytes) 000059[1] 1746128000.558819 mapread 0x430290 thru 0x4323ce (0x213f bytes) 000061[1] 1746128000.560433 write 0x288e4a thru 0x2918d3 (0x8a8a bytes) 000062[1] 1746128000.573475 mapread 0x1fa19e thru 0x206656 (0xc4b9 bytes) 000065[1] 1746128000.604576 read 0x418fbb thru 0x41f680 (0x66c6 bytes) 000070[1] 1746128000.617513 read 0x34342f thru 0x34405b (0xc2d bytes) 000071[0] 1746128000.631851 trunc from 0x7d3342 to 0x55968a (0x279cb7 bytes) 000072[1] 1746128000.700316 mapread 0x54b2cd thru 0x5578ac (0xc5e0 bytes) truncating to largest ever: 0x837f8d 000073[0] 1746128000.735469 trunc from 0x55968b to 0x837f8c (0x2de902 bytes) 000077[0] 1746128000.784063 mapread 0x07d362 thru 0x0884c8 (0xb167 bytes) 000078[0] 1746128000.811596 write 0x742225 thru 0x74fe8f (0xdc6b bytes) 000080[1] 1746128000.842972 read 0x831ed8 thru 0x837f8c (0x60b5 bytes) 000082[0] 1746128000.878448 mapread 0x2491a3 thru 0x25103a (0x7e98 bytes) 000083[0] 1746128000.901902 mapwrite 0x352ca1 thru 0x3621be (0xf51e bytes) 000084[0] 1746128000.991590 trunc from 0x837f8d to 0x56353b (0x2d4a51 bytes) 000085[0] 1746128001.009437 mapread 0x35c4a4 thru 0x3612ed (0x4e4a bytes) 000086[1] 1746128001.031683 write 0x03f0be thru 0x044f57 (0x5e9a bytes) 000088[1] 1746128001.072541 read 0x5172f0 thru 0x5185ff (0x1310 bytes) 000090[0] 1746128001.099558 trunc from 0x56353c to 0x0c65ef (0x49cf4c bytes) 000094[1] 1746128001.188116 trunc from 0x0c65f0 to 0x7e94df (0x722ef0 bytes) 000095[0] 1746128001.225426 write 0x805d63 thru 0x80eddd (0x907b bytes) 000096[1] 1746128001.237620 write 0x47887a thru 0x47b0c9 (0x2850 bytes) 000097[1] 1746128001.271653 write 0x0fb06a thru 0x101456 (0x63ed bytes) 000098[1] 1746128001.296845 trunc from 0x80edde to 0x5b6ac4 (0x258319 bytes) 000099[0] 1746128001.315554 read 0x0236f1 thru 0x0252ce (0x1bde bytes) 000100[1] 1746128001.347838 write 0x21b3d8 thru 0x22374f (0x8378 bytes) 000103[0] 1746128001.379454 trunc from 0x5b6ac5 to 0x6083df (0x5191b bytes) 000105[0] 1746128001.426676 trunc from 0x6083e0 to 0x7bb880 (0x1b34a1 bytes) 000106[0] 1746128001.439700 mapread 0x30af75 thru 0x30eff6 (0x4082 bytes) 000107[1] 1746128001.452177 mapread 0x30e813 thru 0x310ab0 (0x229e bytes) 000108[0] 1746128001.468366 trunc from 0x7bb881 to 0x7ee035 (0x327b5 bytes) 000111[1] 1746128001.488410 trunc from 0x7ee036 to 0x78162b (0x6ca0a bytes) 000112[0] 1746128001.518548 mapwrite 0x956fa6 thru 0x95d015 (0x6070 bytes) 000113[1] 1746128001.598162 read 0x4de64f thru 0x4df711 (0x10c3 bytes) 000114[1] 1746128001.625365 mapwrite 0x194fd0 thru 0x1a498a (0xf9bb bytes) 000115[0] 1746128001.713063 trunc from 0x95d016 to 0x60853b (0x354ada bytes) 000117[0] 1746128001.768212 read 0x4c3c20 thru 0x4d0428 (0xc809 bytes) 000120[0] 1746128001.787955 trunc from 0x60853c to 0x256f49 (0x3b15f2 bytes) 000123[1] 1746128001.844259 mapwrite 0x4920ac thru 0x4958d7 (0x382c bytes) 000136[1] 1746128002.053699 trunc from 0x4958d8 to 0x23a85f (0x25b078 bytes) truncating to largest ever: 0x93e864 000137[1] 1746128002.079231 trunc from 0x23a860 to 0x93e863 (0x704004 bytes) 000140[1] 1746128002.139850 mapread 0x445f82 thru 0x44a1e0 (0x425f bytes) 000142[0] 1746128002.187065 read 0x325063 thru 0x32b527 (0x64c5 bytes) 000145[0] 1746128002.223431 mapread 0x5948b2 thru 0x59f1c6 (0xa915 bytes) 000146[0] 1746128002.249527 mapwrite 0x99e75c thru 0x9a3823 (0x50c8 bytes) 000147[1] 1746128002.332538 read 0x082dba thru 0x090679 (0xd8c0 bytes) 000150[1] 1746128002.387447 read 0x4f8941 thru 0x503975 (0xb035 bytes) 000151[0] 1746128002.407763 trunc from 0x9a3824 to 0x4d7929 (0x4cbefa bytes) 000152[1] 1746128002.470032 write 0x267840 thru 0x2699fe (0x21bf bytes) 000156[0] 1746128002.539224 write 0x974633 thru 0x981d3b (0xd709 bytes) 000160[0] 1746128002.566215 mapwrite 0x500c09 thru 0x50a789 (0x9b81 bytes) 000161[0] 1746128002.647618 mapwrite 0x739c6d thru 0x741085 (0x7419 bytes) 000162[0] 1746128002.722425 read 0x55384d thru 0x556513 (0x2cc7 bytes) 000164[1] 1746128002.771333 mapread 0x244b99 thru 0x249a81 (0x4ee9 bytes) 000165[0] 1746128002.825119 write 0x192ca0 thru 0x199063 (0x63c4 bytes) 000166[1] 1746128002.873125 mapread 0x61b4e0 thru 0x62231f (0x6e40 bytes) 000170[0] 1746128002.924373 trunc from 0x981d3c to 0x8045fb (0x17d740 bytes) 000172[0] 1746128002.974582 mapwrite 0x8e6be1 thru 0x8e7252 (0x672 bytes) 000174[1] 1746128003.046210 write 0x8a4645 thru 0x8b44c6 (0xfe82 bytes) 000176[0] 1746128003.076391 mapwrite 0x4181e6 thru 0x426705 (0xe520 bytes) 000177[1] 1746128003.156588 read 0x6fb9a2 thru 0x702803 (0x6e62 bytes) 000178[0] 1746128003.179874 trunc from 0x8e7253 to 0x81f5d5 (0xc7c7d bytes) 000181[1] 1746128003.237361 mapwrite 0x4b8792 thru 0x4c7408 (0xec77 bytes) 000183[0] 1746128003.403023 trunc from 0x81f5d6 to 0x8f3605 (0xd4030 bytes) 000184[0] 1746128003.428929 read 0x4d3e9b thru 0x4da31e (0x6484 bytes) 000185[0] 1746128003.438661 write 0x3a7325 thru 0x3b2082 (0xad5e bytes) 000187[1] 1746128003.465097 read 0x8775ab thru 0x886a94 (0xf4ea bytes) 000188[1] 1746128003.488996 read 0x509321 thru 0x5185d8 (0xf2b8 bytes) 000189[0] 1746128003.502986 read 0x2552f0 thru 0x25a4a0 (0x51b1 bytes) 000190[1] 1746128003.510311 mapwrite 0x24014d thru 0x247fb7 (0x7e6b bytes) 000193[1] 1746128003.611561 mapread 0x0410b5 thru 0x041dab (0xcf7 bytes) 000194[0] 1746128003.615130 trunc from 0x8f3606 to 0x791c08 (0x1619fd bytes) 000196[1] 1746128003.667869 write 0x3d8a23 thru 0x3e541f (0xc9fd bytes) 000197[1] 1746128003.709490 write 0x2282bb thru 0x229fbe (0x1d04 bytes) 000198[1] 1746128003.742275 read 0x58a780 thru 0x59178b (0x700c bytes) 000199[0] 1746128003.766254 read 0x2ff343 thru 0x3086c2 (0x9380 bytes) 000200[0] 1746128003.807680 read 0x111e20 thru 0x11b7a3 (0x9984 bytes) 000203[1] 1746128003.821794 read 0x67d557 thru 0x68b3de (0xde88 bytes) 000207[0] 1746128003.830358 trunc from 0x791c09 to 0x2e9259 (0x4a89af bytes) 000209[1] 1746128003.871918 write 0x0427bf thru 0x042886 (0xc8 bytes) 000210[0] 1746128003.901037 write 0x2ba79a thru 0x2c71ba (0xca21 bytes) 000211[1] 1746128003.927627 mapwrite 0x85e856 thru 0x86d927 (0xf0d2 bytes) 000212[0] 1746128004.080056 trunc from 0x86d928 to 0x4faa02 (0x372f25 bytes) 000221[1] 1746128004.197819 write 0x18834a thru 0x190303 (0x7fba bytes) 000223[0] 1746128004.245370 mapread 0x436a2a thru 0x4406b8 (0x9c8f bytes) 000224[0] 1746128004.281979 read 0x3ecb98 thru 0x3ef473 (0x28dc bytes) 000227[0] 1746128004.332710 mapread 0x4e1555 thru 0x4ee4c5 (0xcf71 bytes) 000228[1] 1746128004.345545 mapwrite 0x9a51f5 thru 0x9b0b94 (0xb9a0 bytes) 000229[1] 1746128004.489052 read 0x02b249 thru 0x03358e (0x8346 bytes) 000231[1] 1746128004.505648 mapwrite 0x16256c thru 0x16cfc2 (0xaa57 bytes) 000233[0] 1746128004.598244 read 0x7eda32 thru 0x7eefc5 (0x1594 bytes) 000235[1] 1746128004.659378 trunc from 0x9b0b95 to 0x255e50 (0x75ad44 bytes) 000237[0] 1746128004.723646 write 0x861c7b thru 0x871041 (0xf3c7 bytes) 000238[1] 1746128004.752838 trunc from 0x871042 to 0x4b00fe (0x3c0f43 bytes) 000240[0] 1746128004.805618 mapwrite 0x8e6bbf thru 0x8ed72c (0x6b6e bytes) 000241[1] 1746128004.930884 mapread 0x81fb82 thru 0x8297a2 (0x9c21 bytes) 000242[1] 1746128004.964556 read 0x53c643 thru 0x546cc5 (0xa683 bytes) 000246[1] 1746128004.984513 write 0x3af2c0 thru 0x3b504f (0x5d90 bytes) 000247[0] 1746128005.010203 write 0x3b7751 thru 0x3bf4da (0x7d8a bytes) 000249[0] 1746128005.057704 mapwrite 0x413eb4 thru 0x41d5bb (0x9708 bytes) 000252[1] 1746128005.194726 mapread 0x28e418 thru 0x290fc4 (0x2bad bytes) truncating to largest ever: 0x995927 000255[1] 1746128005.237838 trunc from 0x8ed72d to 0x995926 (0xa81fa bytes) 000257[0] 1746128005.315215 trunc from 0x995927 to 0x3b1983 (0x5e3fa3 bytes) 000259[1] 1746128005.383708 mapwrite 0x9e6917 thru 0x9f48ce (0xdfb8 bytes) 000260[0] 1746128005.471620 mapread 0x988eab thru 0x99392b (0xaa81 bytes) 000262[0] 1746128005.522438 read 0x872332 thru 0x879358 (0x7027 bytes) 000265[0] 1746128005.556859 mapread 0x1ad4bc thru 0x1b2ad5 (0x561a bytes) 000266[1] 1746128005.575478 trunc from 0x9f48cf to 0x71817f (0x2dc74f bytes) 000269[0] 1746128005.615211 read 0x6fbdc3 thru 0x7038fa (0x7b38 bytes) 000272[0] 1746128005.634880 read 0x27ce2b thru 0x280aaa (0x3c80 bytes) 000273[1] 1746128005.651464 trunc from 0x718180 to 0x70b4e9 (0xcc96 bytes) 000274[1] 1746128005.682721 trunc from 0x70b4ea to 0x5952dc (0x17620d bytes) 000275[0] 1746128005.693610 read 0x0b205b thru 0x0b84c0 (0x6466 bytes) 000276[0] 1746128005.721819 mapread 0x3f5d8a thru 0x4027d3 (0xca4a bytes) 000278[1] 1746128005.759731 mapwrite 0x69dce6 thru 0x6a8b1c (0xae37 bytes) 000281[1] 1746128005.875456 mapread 0x46bfb7 thru 0x47768e (0xb6d8 bytes) 000288[0] 1746128005.940279 trunc from 0x6a8b1d to 0x01b8fe (0x68d21e bytes) 000291[0] 1746128006.004562 write 0x472783 thru 0x47d87f (0xb0fd bytes) 000293[1] 1746128006.037432 read 0x06a353 thru 0x06b765 (0x1413 bytes) 000298[1] 1746128006.086578 mapwrite 0x0ee91e thru 0x0f17a0 (0x2e83 bytes) 000299[1] 1746128006.201909 mapread 0x292e0e thru 0x2a12bd (0xe4b0 bytes) 000303[1] 1746128006.357425 mapread 0x383e9e thru 0x38a523 (0x6686 bytes) 000308[0] 1746128006.468383 mapread 0x2d3d96 thru 0x2dee1b (0xb086 bytes) 000310[1] 1746128006.520066 write 0x18c18f thru 0x1994ba (0xd32c bytes) 000314[1] 1746128006.570963 mapwrite 0x3d3599 thru 0x3d92fb (0x5d63 bytes) 000315[1] 1746128006.727844 mapread 0x12fe99 thru 0x131c34 (0x1d9c bytes) 000317[1] 1746128006.788889 trunc from 0x47d880 to 0x65a5f4 (0x1dcd75 bytes) 000318[0] 1746128006.833084 mapread 0x462034 thru 0x471333 (0xf300 bytes) 000322[0] 1746128006.890807 mapwrite 0x48a72e thru 0x494fb8 (0xa88b bytes) 000323[1] 1746128006.984747 trunc from 0x65a5f5 to 0x54c366 (0x10e28e bytes) 000324[1] 1746128007.019149 trunc from 0x54c367 to 0x19e54e (0x3ade18 bytes) 000325[1] 1746128007.047539 mapwrite 0x42d5e3 thru 0x4362a9 (0x8cc7 bytes) 000326[0] 1746128007.132385 mapwrite 0x636375 thru 0x6405f0 (0xa27c bytes) 000327[0] 1746128007.260920 mapwrite 0x943aa9 thru 0x946b94 (0x30ec bytes) 000329[0] 1746128007.353459 write 0x711c34 thru 0x71f695 (0xda62 bytes) 000330[1] 1746128007.361694 mapwrite 0x39f24b thru 0x3a3eeb (0x4ca1 bytes) 000333[1] 1746128007.522322 read 0x68eade thru 0x6985ab (0x9ace bytes) 000336[1] 1746128007.554919 mapwrite 0x89b95f thru 0x8a5c31 (0xa2d3 bytes) 000339[1] 1746128007.659184 trunc from 0x946b95 to 0x09221d (0x8b4977 bytes) 000340[1] 1746128007.689453 trunc from 0x09221e to 0x9775f1 (0x8e53d4 bytes) 000343[1] 1746128007.752055 trunc from 0x9775f2 to 0x52ae47 (0x44c7aa bytes) 000345[1] 1746128007.782359 trunc from 0x52ae48 to 0x589436 (0x5e5ef bytes) 000346[0] 1746128007.797659 read 0x3b33d4 thru 0x3b4788 (0x13b5 bytes) 000353[0] 1746128007.830967 write 0x9b05bf thru 0x9b66d9 (0x611b bytes) 000355[1] 1746128007.858429 read 0x07874d thru 0x08020d (0x7ac1 bytes) 000358[1] 1746128007.902061 mapwrite 0x9694c6 thru 0x97902a (0xfb65 bytes) 000359[1] 1746128007.983689 mapwrite 0x5c3ef3 thru 0x5cd247 (0x9355 bytes) 000360[1] 1746128008.066436 trunc from 0x9b66da to 0x6326ef (0x383fea bytes) 000363[1] 1746128008.084069 trunc from 0x6326f0 to 0x7cb4fb (0x198e0c bytes) 000365[0] 1746128008.110158 write 0x449f9b thru 0x44c88b (0x28f1 bytes) 000366[1] 1746128008.137115 trunc from 0x7cb4fc to 0x988859 (0x1bd35e bytes) 000368[0] 1746128008.164432 mapwrite 0x920bd6 thru 0x92ad9b (0xa1c6 bytes) 000369[1] 1746128008.255582 trunc from 0x98885a to 0x60e4a4 (0x37a3b5 bytes) 000370[0] 1746128008.276531 read 0x38f4dd thru 0x393376 (0x3e9a bytes) 000373[0] 1746128008.312962 read 0x607d30 thru 0x609718 (0x19e9 bytes) 000377[1] 1746128008.330637 write 0x487db6 thru 0x48ee96 (0x70e1 bytes) 000378[1] 1746128008.348926 trunc from 0x60e4a5 to 0x849bef (0x23b74b bytes) 000380[1] 1746128008.382196 read 0x2b2851 thru 0x2b6d9f (0x454f bytes) 000381[0] 1746128008.388442 mapwrite 0x7a8827 thru 0x7b3304 (0xaade bytes) 000384[1] 1746128008.617570 mapwrite 0x504818 thru 0x507bf9 (0x33e2 bytes) 000385[0] 1746128008.706511 mapwrite 0x03459e thru 0x04065d (0xc0c0 bytes) 000387[0] 1746128008.927091 read 0x623458 thru 0x627f57 (0x4b00 bytes) 000390[1] 1746128008.973001 read 0x3b4423 thru 0x3bf460 (0xb03e bytes) 000391[0] 1746128008.992167 write 0x1004f4 thru 0x1008fb (0x408 bytes) 000395[1] 1746128009.062436 read 0x3fccc4 thru 0x407846 (0xab83 bytes) 000396[0] 1746128009.084474 read 0x7db13c thru 0x7e09ba (0x587f bytes) 000397[0] 1746128009.090479 mapread 0x5e6c0a thru 0x5f2798 (0xbb8f bytes) 000398[0] 1746128009.125173 write 0x310e7c thru 0x31b1be (0xa343 bytes) 000399[0] 1746128009.154577 trunc from 0x849bf0 to 0x13eb4e (0x70b0a1 bytes) 000400[1] 1746128009.195104 write 0x4dc705 thru 0x4e44dd (0x7dd9 bytes) 000404[1] 1746128009.282523 mapwrite 0x99ddd2 thru 0x9acd02 (0xef31 bytes) 000407[0] 1746128009.438473 read 0x8f0b7e thru 0x900936 (0xfdb9 bytes) 000408[0] 1746128009.607968 read 0x40f7c9 thru 0x419aaf (0xa2e7 bytes) 000411[0] 1746128009.632927 mapread 0x102965 thru 0x10f165 (0xc801 bytes) truncating to largest ever: 0x9e6c98 000412[0] 1746128009.634788 trunc from 0x9acd03 to 0x9e6c97 (0x39f95 bytes) 000413[1] 1746128009.708001 mapread 0x3ff6db thru 0x4099c3 (0xa2e9 bytes) 000417[1] 1746128009.767868 mapread 0x91849c thru 0x92295e (0xa4c3 bytes) 000419[1] 1746128009.785027 mapread 0x3d1b41 thru 0x3d6857 (0x4d17 bytes) 000422[0] 1746128009.798465 mapwrite 0x867210 thru 0x8673bf (0x1b0 bytes) 000425[1] 1746128009.877981 read 0x6f36ad thru 0x6fc420 (0x8d74 bytes) 000426[0] 1746128009.893888 write 0x00bb76 thru 0x010702 (0x4b8d bytes) 000431[1] 1746128009.942462 mapread 0x44fd92 thru 0x45502b (0x529a bytes) 000432[0] 1746128009.972143 read 0x225d2b thru 0x232cf7 (0xcfcd bytes) 000433[1] 1746128009.979879 write 0x8c050e thru 0x8cf826 (0xf319 bytes) 000434[1] 1746128010.017461 mapwrite 0x53e86e thru 0x5407d1 (0x1f64 bytes) 000439[1] 1746128010.122104 write 0x2e3491 thru 0x2ea1e7 (0x6d57 bytes) 000443[1] 1746128010.158891 read 0x5c5a4c thru 0x5cd4da (0x7a8f bytes) 000445[0] 1746128010.164254 trunc from 0x9e6c98 to 0x007230 (0x9dfa67 bytes) 000446[0] 1746128010.214020 mapread 0x0042c9 thru 0x007230 (0x2f68 bytes) 000448[0] 1746128010.246136 mapwrite 0x808fe7 thru 0x80a8e7 (0x1901 bytes) 000449[1] 1746128010.328930 read 0x4db482 thru 0x4dfbd4 (0x4753 bytes) 000454[1] 1746128010.375680 mapread 0x7f55e5 thru 0x7ff698 (0xa0b4 bytes) 000457[0] 1746128010.421887 mapread 0x09ae7a thru 0x0a70fa (0xc281 bytes) 000458[0] 1746128010.449311 mapread 0x076bc7 thru 0x086131 (0xf56b bytes) 000460[0] 1746128010.468049 read 0x681108 thru 0x689263 (0x815c bytes) 000461[1] 1746128010.481809 write 0x44f317 thru 0x45258c (0x3276 bytes) 000466[1] 1746128010.540362 write 0x009147 thru 0x00b271 (0x212b bytes) 000467[1] 1746128010.585823 mapwrite 0x6fd8d4 thru 0x70714a (0x9877 bytes) 000469[1] 1746128010.690980 write 0x99ce22 thru 0x9a0c1c (0x3dfb bytes) 000470[1] 1746128010.692071 read 0x22e6af thru 0x23bc4e (0xd5a0 bytes) 000471[0] 1746128010.698159 write 0x713278 thru 0x71690f (0x3698 bytes) 000472[0] 1746128010.723669 write 0x2183a7 thru 0x227d15 (0xf96f bytes) 000473[1] 1746128010.750222 mapwrite 0x553db6 thru 0x556a2b (0x2c76 bytes) 000475[1] 1746128010.858625 mapread 0x7b4a27 thru 0x7b733d (0x2917 bytes) 000476[0] 1746128010.884396 write 0x183f41 thru 0x188b99 (0x4c59 bytes) 000477[0] 1746128010.897880 mapread 0x243c66 thru 0x253a86 (0xfe21 bytes) 000479[1] 1746128010.930749 mapread 0x4834bd thru 0x48bddd (0x8921 bytes) 000481[0] 1746128010.970423 write 0x9f67ac thru 0x9ffafd (0x9352 bytes) 000482[1] 1746128010.981000 write 0x378181 thru 0x378672 (0x4f2 bytes) 000483[0] 1746128011.001599 mapread 0x3b98e4 thru 0x3bbefd (0x261a bytes) 000485[0] 1746128011.050754 write 0x2be265 thru 0x2c88fa (0xa696 bytes) 000486[1] 1746128011.128004 write 0x4dd832 thru 0x4e092c (0x30fb bytes) 000491[1] 1746128011.239788 write 0x992967 thru 0x992a34 (0xce bytes) 000493[0] 1746128011.288041 mapread 0x81630e thru 0x8219e7 (0xb6da bytes) 000496[0] 1746128011.374227 mapread 0x25b742 thru 0x26a5b8 (0xee77 bytes) 000497[1] 1746128011.407077 write 0x521fb1 thru 0x523d30 (0x1d80 bytes) 000498[1] 1746128011.413181 read 0x3504ef thru 0x3526dd (0x21ef bytes) 000499[0] 1746128011.428227 read 0x184c47 thru 0x194512 (0xf8cc bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 8011 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002[0] 1746128012.019057 mapwrite 0x707000 thru 0x70bc7b (0x4c7c bytes) 000004[1] 1746128012.138483 write 0x07e000 thru 0x0815be (0x35bf bytes) 000007[1] 1746128012.204926 read 0x122000 thru 0x125308 (0x3309 bytes) 000008[0] 1746128012.227359 write 0x856000 thru 0x85e16c (0x816d bytes) truncating to largest ever: 0x9f0ef6 000010[1] 1746128012.248676 trunc from 0x85e16d to 0x9f0ef5 (0x192d89 bytes) 000011[1] 1746128012.288474 mapwrite 0x86e000 thru 0x8768cf (0x88d0 bytes) 000013[0] 1746128012.407006 mapread 0x695000 thru 0x697a28 (0x2a29 bytes) 000014[0] 1746128012.438117 mapwrite 0x712000 thru 0x713cae (0x1caf bytes) 000016[0] 1746128012.568752 write 0x4f9000 thru 0x4fd27f (0x4280 bytes) 000017[1] 1746128012.582770 mapwrite 0x20b000 thru 0x215215 (0xa216 bytes) 000020[1] 1746128012.676304 trunc from 0x9f0ef6 to 0x2d130c (0x71fbe9 bytes) 000022[1] 1746128012.723014 read 0x291000 thru 0x295a2d (0x4a2e bytes) 000024[1] 1746128012.795290 read 0x273000 thru 0x281f3e (0xef3f bytes) 000025[0] 1746128012.803075 mapwrite 0x5c6000 thru 0x5c8ee5 (0x2ee6 bytes) 000028[0] 1746128012.969871 write 0x3aa000 thru 0x3b45f4 (0xa5f5 bytes) 000029[1] 1746128012.992400 mapwrite 0x2f9000 thru 0x2fc636 (0x3637 bytes) 000031[1] 1746128013.191382 write 0x09c000 thru 0x09dcc8 (0x1cc9 bytes) 000037[0] 1746128013.211820 mapread 0x557000 thru 0x55d9fd (0x69fe bytes) 000040[0] 1746128013.262901 mapread 0x35d000 thru 0x35e2d7 (0x12d8 bytes) 000043[1] 1746128013.270728 mapread 0x1e4000 thru 0x1e6971 (0x2972 bytes) 000044[0] 1746128013.279911 read 0x06e000 thru 0x075584 (0x7585 bytes) 000048[1] 1746128013.286022 mapwrite 0x0d1000 thru 0x0de8a7 (0xd8a8 bytes) 000052[0] 1746128013.437867 mapwrite 0x684000 thru 0x6903d1 (0xc3d2 bytes) 000053[0] 1746128013.605643 mapwrite 0x45f000 thru 0x4633aa (0x43ab bytes) 000057[0] 1746128013.688213 write 0x89f000 thru 0x8a759a (0x859b bytes) 000058[0] 1746128013.690210 mapread 0x36a000 thru 0x36f5c9 (0x55ca bytes) 000059[0] 1746128013.705390 write 0x52d000 thru 0x53b052 (0xe053 bytes) 000061[0] 1746128013.719481 mapwrite 0x4cd000 thru 0x4cf152 (0x2153 bytes) 000064[1] 1746128013.827528 trunc from 0x8a759b to 0x7f64f5 (0xb10a5 bytes) 000066[1] 1746128013.863833 write 0x842000 thru 0x84c37b (0xa37c bytes) 000067[1] 1746128013.885909 read 0x5d7000 thru 0x5dceb6 (0x5eb7 bytes) 000068[0] 1746128013.904712 read 0x753000 thru 0x75d6ea (0xa6eb bytes) 000070[0] 1746128013.930901 mapwrite 0x640000 thru 0x645c44 (0x5c45 bytes) 000071[1] 1746128014.014160 read 0x424000 thru 0x42f5cf (0xb5d0 bytes) 000072[1] 1746128014.027300 trunc from 0x84c37c to 0x2af12d (0x59d24e bytes) 000073[0] 1746128014.047250 write 0x596000 thru 0x5a5d98 (0xfd99 bytes) 000074[0] 1746128014.059182 mapwrite 0x7a0000 thru 0x7a1497 (0x1498 bytes) 000078[0] 1746128014.175727 mapread 0x036000 thru 0x03a17f (0x4180 bytes) 000083[1] 1746128014.187765 write 0x1b0000 thru 0x1beddc (0xeddd bytes) 000091[0] 1746128014.263438 read 0x39a000 thru 0x39bd8a (0x1d8b bytes) 000092[0] 1746128014.278850 mapread 0x2c7000 thru 0x2cf746 (0x8747 bytes) 000094[1] 1746128014.293102 mapwrite 0x106000 thru 0x10f3a2 (0x93a3 bytes) 000099[0] 1746128014.390979 mapread 0x011000 thru 0x01ffbe (0xefbf bytes) 000100[1] 1746128014.442465 mapread 0x13c000 thru 0x13ed03 (0x2d04 bytes) 000103[0] 1746128014.453422 mapwrite 0x552000 thru 0x55cf01 (0xaf02 bytes) 000104[1] 1746128014.524296 write 0x180000 thru 0x18652c (0x652d bytes) 000107[1] 1746128014.540862 write 0x70a000 thru 0x70d3e4 (0x33e5 bytes) 000110[1] 1746128014.566480 read 0x0d5000 thru 0x0dc240 (0x7241 bytes) 000111[1] 1746128014.583205 mapread 0x6f1000 thru 0x700824 (0xf825 bytes) 000113[0] 1746128014.618715 write 0x4ff000 thru 0x50b444 (0xc445 bytes) 000115[1] 1746128014.657277 mapwrite 0x841000 thru 0x84e58c (0xd58d bytes) 000119[1] 1746128014.794744 trunc from 0x84e58d to 0x825a80 (0x28b0c bytes) 000120[0] 1746128014.813923 write 0x395000 thru 0x3a09c8 (0xb9c9 bytes) 000123[1] 1746128014.843545 write_OD 0x600000 thru 0x60efff (0xf000 bytes) 000126[0] 1746128014.910462 write 0x733000 thru 0x73f528 (0xc529 bytes) 000127[0] 1746128014.921723 read 0x67b000 thru 0x688c5d (0xdc5e bytes) 000128[1] 1746128014.937468 read_OD 0x66c000 thru 0x66ffff (0x4000 bytes) 000129[0] 1746128014.967604 write 0x0e5000 thru 0x0e5762 (0x763 bytes) 000130[1] 1746128014.990341 mapread 0x72c000 thru 0x730aed (0x4aee bytes) 000137[0] 1746128015.038919 write 0x3e0000 thru 0x3e91f0 (0x91f1 bytes) 000138[1] 1746128015.057276 read_OD 0x38b000 thru 0x38dfff (0x3000 bytes) 000140[0] 1746128015.092335 write 0x37b000 thru 0x385fd9 (0xafda bytes) 000141[0] 1746128015.106928 trunc from 0x825a81 to 0x5be9b2 (0x2670ce bytes) 000143[1] 1746128015.133441 trunc from 0x5be9b3 to 0x4a8265 (0x11674d bytes) 000146[1] 1746128015.208505 read_OD 0x388000 thru 0x391fff (0xa000 bytes) 000148[0] 1746128015.229901 read 0x236000 thru 0x2386eb (0x26ec bytes) 000149[0] 1746128015.238376 write 0x4aa000 thru 0x4b717a (0xd17b bytes) 000150[0] 1746128015.265389 read 0x44b000 thru 0x4513ca (0x63cb bytes) 000151[1] 1746128015.272580 trunc from 0x4b717b to 0x640b5c (0x1899e2 bytes) 000152[0] 1746128015.309643 read 0x4d9000 thru 0x4e0ebd (0x7ebe bytes) 000153[1] 1746128015.327566 mapread 0x346000 thru 0x347505 (0x1506 bytes) 000154[0] 1746128015.332930 read 0x3fd000 thru 0x402936 (0x5937 bytes) 000156[1] 1746128015.339302 read_OD 0x2b4000 thru 0x2b9fff (0x6000 bytes) 000160[1] 1746128015.346056 trunc from 0x640b5d to 0x270595 (0x3d05c7 bytes) 000161[1] 1746128015.388474 trunc from 0x270596 to 0x8785ff (0x60806a bytes) 000162[1] 1746128015.417416 write_OD 0x1dd000 thru 0x1e5fff (0x9000 bytes) 000164[1] 1746128015.466356 trunc from 0x878600 to 0x749111 (0x12f4ee bytes) 000168[1] 1746128015.516535 write_OD 0x5c2000 thru 0x5c3fff (0x2000 bytes) 000169[0] 1746128015.579087 mapwrite 0x848000 thru 0x852e99 (0xae9a bytes) 000176[0] 1746128015.741783 mapread 0x498000 thru 0x49ff63 (0x7f64 bytes) 000177[1] 1746128015.798045 read_OD 0x32a000 thru 0x332fff (0x9000 bytes) 000178[1] 1746128015.830481 trunc from 0x852e9a to 0x7c8b62 (0x8a337 bytes) 000180[0] 1746128015.897761 read 0x1a3000 thru 0x1ae977 (0xb978 bytes) 000181[1] 1746128015.913317 mapwrite 0x7ef000 thru 0x7f0dd1 (0x1dd2 bytes) 000182[1] 1746128016.021605 trunc from 0x7f0dd2 to 0x248b8a (0x5a8247 bytes) 000184[0] 1746128016.069114 mapwrite 0x76d000 thru 0x7715e2 (0x45e3 bytes) 000185[0] 1746128016.183584 mapwrite 0x548000 thru 0x552c70 (0xac71 bytes) 000186[0] 1746128016.235289 mapread 0x66c000 thru 0x671a0f (0x5a10 bytes) 000187[0] 1746128016.247177 trunc from 0x7715e3 to 0x8eafb0 (0x1799ce bytes) 000189[0] 1746128016.267718 trunc from 0x8eafb1 to 0x53c787 (0x3ae829 bytes) 000190[0] 1746128016.294224 trunc from 0x53c788 to 0x98fe33 (0x4536ac bytes) 000192[0] 1746128016.334017 mapread 0x78a000 thru 0x796cd6 (0xccd7 bytes) 000193[1] 1746128016.383370 mapwrite 0x5f4000 thru 0x5f61d9 (0x21da bytes) 000194[1] 1746128016.463682 mapread 0x172000 thru 0x175cdb (0x3cdc bytes) 000197[0] 1746128016.495386 mapwrite 0x4e3000 thru 0x4e9794 (0x6795 bytes) 000198[0] 1746128016.571119 mapwrite 0x259000 thru 0x265bff (0xcc00 bytes) 000200[1] 1746128016.629693 trunc from 0x98fe34 to 0x4de71c (0x4b1717 bytes) 000201[1] 1746128016.659349 mapwrite 0x960000 thru 0x96f3bc (0xf3bd bytes) 000203[1] 1746128016.793722 trunc from 0x96f3bd to 0x9e1e8e (0x72ad2 bytes) 000205[1] 1746128016.837456 mapwrite 0x3ab000 thru 0x3b929a (0xe29b bytes) 000208[0] 1746128016.918185 read 0x1d3000 thru 0x1d43c8 (0x13c9 bytes) 000210[0] 1746128016.930461 trunc from 0x9e1e8f to 0x889c77 (0x158217 bytes) 000211[0] 1746128016.951671 read 0x472000 thru 0x47bdab (0x9dac bytes) 000215[0] 1746128016.988273 mapwrite 0x1b9000 thru 0x1c73de (0xe3df bytes) 000217[0] 1746128017.066088 trunc from 0x889c78 to 0x49b9fb (0x3ee27c bytes) 000220[1] 1746128017.136346 write_OD 0x8fc000 thru 0x907fff (0xc000 bytes) 000221[1] 1746128017.203233 write_OD 0x8c4000 thru 0x8cefff (0xb000 bytes) 000223[1] 1746128017.290039 read_OD 0x655000 thru 0x655fff (0x1000 bytes) 000226[1] 1746128017.299216 mapread 0x682000 thru 0x6842ae (0x22af bytes) 000231[0] 1746128017.314409 read 0x114000 thru 0x1188a3 (0x48a4 bytes) 000232[1] 1746128017.325726 read_OD 0x63e000 thru 0x643fff (0x6000 bytes) 000237[0] 1746128017.333489 write 0x91c000 thru 0x9203f3 (0x43f4 bytes) 000238[0] 1746128017.341351 read 0x44d000 thru 0x45ccc0 (0xfcc1 bytes) 000240[1] 1746128017.352255 read_OD 0x04b000 thru 0x04bfff (0x1000 bytes) 000250[0] 1746128017.375504 read 0x5a8000 thru 0x5b65c5 (0xe5c6 bytes) 000253[1] 1746128017.383904 trunc from 0x9203f4 to 0x9b7d1a (0x97927 bytes) 000256[0] 1746128017.442657 mapwrite 0x6bb000 thru 0x6bbf61 (0xf62 bytes) 000257[0] 1746128017.517474 write 0x4ea000 thru 0x4f3d94 (0x9d95 bytes) 000258[1] 1746128017.521708 mapread 0x73d000 thru 0x748e7a (0xbe7b bytes) 000259[0] 1746128017.584627 mapwrite 0x1a4000 thru 0x1a83ea (0x43eb bytes) 000261[0] 1746128017.703925 mapwrite 0x434000 thru 0x43798a (0x398b bytes) 000263[1] 1746128017.757611 write_OD 0x7f7000 thru 0x7fdfff (0x7000 bytes) 000264[0] 1746128017.805468 mapwrite 0x30a000 thru 0x31959a (0xf59b bytes) 000265[0] 1746128017.886404 mapwrite 0x618000 thru 0x626451 (0xe452 bytes) 000267[0] 1746128017.952538 mapread 0x168000 thru 0x16f7ea (0x77eb bytes) 000270[0] 1746128017.983524 trunc from 0x9b7d1b to 0x0eef04 (0x8c8e16 bytes) 000273[0] 1746128018.010668 mapwrite 0x0a8000 thru 0x0aebff (0x6c00 bytes) 000276[1] 1746128018.094999 trunc from 0x0eef05 to 0x172a47 (0x83b43 bytes) 000277[0] 1746128018.121997 trunc from 0x172a48 to 0x060d0e (0x111d39 bytes) 000278[0] 1746128018.143887 trunc from 0x060d0f to 0x028192 (0x38b7c bytes) 000279[0] 1746128018.171478 write 0x8c3000 thru 0x8d0d13 (0xdd14 bytes) 000280[0] 1746128018.182469 read 0x498000 thru 0x4a6904 (0xe905 bytes) 000285[1] 1746128018.238181 read_OD 0x420000 thru 0x424fff (0x5000 bytes) 000287[0] 1746128018.279001 mapwrite 0x94e000 thru 0x958c4c (0xac4d bytes) 000291[1] 1746128018.414809 read_OD 0x222000 thru 0x226fff (0x5000 bytes) 000293[1] 1746128018.437584 read_OD 0x895000 thru 0x89afff (0x6000 bytes) 000298[0] 1746128018.443605 trunc from 0x958c4d to 0x00252a (0x956722 bytes) 000299[0] 1746128018.480561 mapwrite 0x62e000 thru 0x632588 (0x4589 bytes) 000300[1] 1746128018.595054 mapwrite 0x22a000 thru 0x2398b0 (0xf8b1 bytes) 000303[1] 1746128018.741625 mapread 0x26f000 thru 0x275343 (0x6344 bytes) 000306[0] 1746128018.770530 mapwrite 0x7bd000 thru 0x7c664d (0x964e bytes) 000308[1] 1746128018.880394 trunc from 0x7c664e to 0x509f08 (0x2bc745 bytes) 000309[1] 1746128018.908759 mapwrite 0x123000 thru 0x131abe (0xeabf bytes) 000313[0] 1746128019.012738 trunc from 0x509f09 to 0x363312 (0x1a6bf6 bytes) 000314[0] 1746128019.034885 read 0x1ba000 thru 0x1bc8b7 (0x28b8 bytes) 000315[1] 1746128019.089876 write_OD 0x0f5000 thru 0x0fefff (0xa000 bytes) 000318[0] 1746128019.171265 mapread 0x217000 thru 0x21c1c9 (0x51ca bytes) 000319[1] 1746128019.198268 read_OD 0x1a6000 thru 0x1b3fff (0xe000 bytes) 000320[0] 1746128019.203612 mapwrite 0x547000 thru 0x55102d (0xa02e bytes) 000323[1] 1746128019.347232 read_OD 0x0ea000 thru 0x0f3fff (0xa000 bytes) 000330[0] 1746128019.394666 write 0x82d000 thru 0x82eee3 (0x1ee4 bytes) 000331[1] 1746128019.411800 trunc from 0x82eee4 to 0x36c21d (0x4c2cc6 bytes) 000332[1] 1746128019.455738 mapread 0x135000 thru 0x1430eb (0xe0ec bytes) 000334[1] 1746128019.493685 trunc from 0x36c21e to 0x5f717d (0x28af60 bytes) 000337[1] 1746128019.521588 mapread 0x316000 thru 0x321dca (0xbdcb bytes) 000338[1] 1746128019.531483 mapwrite 0x29a000 thru 0x29ad73 (0xd74 bytes) 000341[1] 1746128019.580554 mapread 0x1bf000 thru 0x1bf6f4 (0x6f5 bytes) 000342[1] 1746128019.597520 write_OD 0x801000 thru 0x806fff (0x6000 bytes) 000343[0] 1746128019.709794 mapread 0x26a000 thru 0x26a823 (0x824 bytes) 000350[1] 1746128019.719682 mapread 0x4e1000 thru 0x4e9bd0 (0x8bd1 bytes) 000351[1] 1746128019.739108 mapread 0x33e000 thru 0x3457e8 (0x77e9 bytes) 000353[0] 1746128019.758070 trunc from 0x807000 to 0x155ba0 (0x6b145f bytes) 000354[0] 1746128019.790700 mapwrite 0x823000 thru 0x8275a8 (0x45a9 bytes) 000356[1] 1746128019.939183 trunc from 0x8275a9 to 0x7f389e (0x33d0a bytes) 000358[1] 1746128019.967661 trunc from 0x7f389f to 0x346133 (0x4ad76b bytes) 000360[0] 1746128020.010540 write 0x125000 thru 0x128307 (0x3308 bytes) 000361[1] 1746128020.022207 mapwrite 0x550000 thru 0x55ed2a (0xed2b bytes) 000362[1] 1746128020.127186 write_OD 0x085000 thru 0x08dfff (0x9000 bytes) 000365[1] 1746128020.171373 trunc from 0x55ed2b to 0x1cd55d (0x3917cd bytes) 000366[1] 1746128020.190670 trunc from 0x1cd55e to 0x07c550 (0x15100d bytes) 000367[1] 1746128020.220064 write_OD 0x9e8000 thru 0x9f4fff (0xd000 bytes) 000369[1] 1746128020.307086 trunc from 0x9f5000 to 0x4097ba (0x5eb845 bytes) 000371[0] 1746128020.350874 write 0x88d000 thru 0x88d9df (0x9e0 bytes) 000374[1] 1746128020.387243 write_OD 0x7bf000 thru 0x7ccfff (0xe000 bytes) 000375[0] 1746128020.439096 read 0x257000 thru 0x264f60 (0xdf61 bytes) 000377[1] 1746128020.452306 write_OD 0x12f000 thru 0x134fff (0x6000 bytes) 000378[1] 1746128020.510533 mapwrite 0x5a7000 thru 0x5b5531 (0xe532 bytes) 000379[1] 1746128020.579536 read_OD 0x0e0000 thru 0x0ecfff (0xd000 bytes) 000380[1] 1746128020.592314 mapread 0x0a3000 thru 0x0acaa2 (0x9aa3 bytes) 000383[1] 1746128020.613532 write_OD 0x4f2000 thru 0x500fff (0xf000 bytes) 000386[0] 1746128020.663581 read 0x41f000 thru 0x421f07 (0x2f08 bytes) 000387[0] 1746128020.673220 mapwrite 0x716000 thru 0x7223eb (0xc3ec bytes) 000388[0] 1746128020.728843 trunc from 0x88d9e0 to 0x88850c (0x54d3 bytes) 000389[1] 1746128020.756447 trunc from 0x88850d to 0x4de503 (0x3aa009 bytes) 000390[1] 1746128020.793501 write_OD 0x250000 thru 0x25afff (0xb000 bytes) 000391[0] 1746128020.846917 mapwrite 0x646000 thru 0x64d343 (0x7344 bytes) 000393[1] 1746128020.956312 write_OD 0x941000 thru 0x944fff (0x4000 bytes) 000394[0] 1746128021.011314 trunc from 0x945000 to 0x97508f (0x30090 bytes) 000395[0] 1746128021.040905 read 0x20b000 thru 0x215922 (0xa923 bytes) 000402[1] 1746128021.091343 mapwrite 0x6e5000 thru 0x6e89d2 (0x39d3 bytes) 000403[1] 1746128021.161953 write_OD 0x6e1000 thru 0x6effff (0xf000 bytes) 000404[1] 1746128021.203807 trunc from 0x975090 to 0x4cd1fa (0x4a7e95 bytes) 000411[1] 1746128021.260189 trunc from 0x4cd1fb to 0x4e75ff (0x1a405 bytes) 000413[0] 1746128021.286281 trunc from 0x4e7600 to 0x80759b (0x31ff9c bytes) 000415[1] 1746128021.328534 trunc from 0x80759c to 0x664f0e (0x1a268d bytes) 000417[1] 1746128021.365040 mapwrite 0x73c000 thru 0x73f08e (0x308f bytes) 000420[0] 1746128021.456282 read 0x31d000 thru 0x329a01 (0xca02 bytes) 000421[1] 1746128021.479116 write_OD 0x1d0000 thru 0x1d6fff (0x7000 bytes) 000423[1] 1746128021.551145 read_OD 0x56a000 thru 0x575fff (0xc000 bytes) 000424[1] 1746128021.555726 mapread 0x07a000 thru 0x088a95 (0xea96 bytes) 000426[0] 1746128021.591359 read 0x395000 thru 0x39dac7 (0x8ac8 bytes) 000430[1] 1746128021.599465 read_OD 0x690000 thru 0x692fff (0x3000 bytes) 000434[1] 1746128021.607591 mapread 0x5e6000 thru 0x5ed01b (0x701c bytes) 000435[0] 1746128021.638192 read 0x668000 thru 0x67422d (0xc22e bytes) 000436[1] 1746128021.644038 mapread 0x2b2000 thru 0x2b581b (0x381c bytes) 000437[1] 1746128021.654304 trunc from 0x73f08f to 0x707cf5 (0x37399 bytes) 000442[0] 1746128021.714015 read 0x02c000 thru 0x0321b8 (0x61b9 bytes) 000443[0] 1746128021.726239 write 0x341000 thru 0x347ac0 (0x6ac1 bytes) 000447[0] 1746128021.762773 mapread 0x569000 thru 0x577ae9 (0xeaea bytes) 000449[0] 1746128021.807442 write 0x7c5000 thru 0x7cbe10 (0x6e11 bytes) 000450[1] 1746128021.808325 mapread 0x40b000 thru 0x41365d (0x865e bytes) 000451[0] 1746128021.843898 mapwrite 0x400000 thru 0x404274 (0x4275 bytes) 000457[0] 1746128022.000076 mapwrite 0x9b6000 thru 0x9bc1bc (0x61bd bytes) 000460[1] 1746128022.094774 mapwrite 0x3c6000 thru 0x3cd190 (0x7191 bytes) 000462[0] 1746128022.196518 mapwrite 0x7b4000 thru 0x7b96fd (0x56fe bytes) 000463[0] 1746128022.281668 trunc from 0x9bc1bd to 0x5a83b9 (0x413e03 bytes) 000465[0] 1746128022.303068 mapread 0x015000 thru 0x0245ae (0xf5af bytes) 000466[0] 1746128022.323915 mapread 0x1f0000 thru 0x1feefd (0xeefe bytes) 000467[1] 1746128022.346694 trunc from 0x5a83ba to 0x876f82 (0x2cebc9 bytes) 000470[1] 1746128022.380851 read_OD 0x091000 thru 0x092fff (0x2000 bytes) 000471[0] 1746128022.389799 mapread 0x61d000 thru 0x625708 (0x8709 bytes) 000472[1] 1746128022.429605 read_OD 0x838000 thru 0x845fff (0xe000 bytes) 000473[1] 1746128022.441456 mapread 0x5ee000 thru 0x5f82d7 (0xa2d8 bytes) 000474[1] 1746128022.462648 trunc from 0x876f83 to 0x0bbe55 (0x7bb12d bytes) 000476[0] 1746128022.492217 mapread 0x070000 thru 0x070ee9 (0xeea bytes) 000477[1] 1746128022.507214 write_OD 0x861000 thru 0x869fff (0x9000 bytes) 000478[1] 1746128022.558086 read_OD 0x35e000 thru 0x360fff (0x3000 bytes) 000480[1] 1746128022.562272 trunc from 0x86a000 to 0x45553f (0x414ac0 bytes) 000481[0] 1746128022.581586 read 0x037000 thru 0x03e621 (0x7622 bytes) 000482[1] 1746128022.639429 write_OD 0x432000 thru 0x43cfff (0xb000 bytes) 000484[1] 1746128022.697320 write_OD 0x33d000 thru 0x34bfff (0xf000 bytes) 000486[1] 1746128022.746204 mapwrite 0x47f000 thru 0x486f90 (0x7f91 bytes) 000487[0] 1746128022.837927 trunc from 0x486f91 to 0x4ef382 (0x683f2 bytes) 000489[0] 1746128022.879530 read 0x034000 thru 0x042a5f (0xea60 bytes) 000490[1] 1746128022.887727 write_OD 0x721000 thru 0x72ffff (0xf000 bytes) 000493[0] 1746128022.934857 trunc from 0x730000 to 0x93ea19 (0x20ea1a bytes) 000497[1] 1746128022.981970 write_OD 0x815000 thru 0x815fff (0x1000 bytes) 000498[1] 1746128023.014459 write_OD 0x1a0000 thru 0x1a8fff (0x9000 bytes) 000499[1] 1746128023.063713 write_OD 0x586000 thru 0x588fff (0x3000 bytes) 000500[1] 1746128023.121597 mapwrite 0x1ab000 thru 0x1b8cba (0xdcbb bytes) All operations completed A-OK! PASS 16a (29s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 15:33:45 (1746128025) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.279004 s, 30.1 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.212751 s, 39.4 MB/s Chance of close/open is 1 in 50 Seed set to 8026 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x992284 000002[1] 1746128027.255586 trunc from 00000000 to 0x992283 (0x992284 bytes) 000004[0] 1746128027.292477 mapread 0x8bd876 thru 0x8bf5f6 (0x1d81 bytes) 000006[0] 1746128027.328184 mapread 0x73a1be thru 0x73aba7 (0x9ea bytes) 000007[1] 1746128027.352155 mapread 0x8ac521 thru 0x8ade17 (0x18f7 bytes) 000014[0] 1746128027.366043 read 0x01bf24 thru 0x01c3cf (0x4ac bytes) 000015[0] 1746128027.369626 write 0x64b838 thru 0x64d72c (0x1ef5 bytes) 000016[1] 1746128027.392042 trunc from 0x992284 to 0x54966f (0x448c14 bytes) 000019[1] 1746128027.460008 mapread 0x318d5a thru 0x319da4 (0x104b bytes) 000020[1] 1746128027.477448 mapread 0x062910 thru 0x062d5c (0x44d bytes) 000023[0] 1746128027.490864 mapread 0x317008 thru 0x3179f2 (0x9eb bytes) 000025[1] 1746128027.500332 mapread 0x10a20e thru 0x10b965 (0x1758 bytes) 000026[1] 1746128027.506239 write 0x974ba6 thru 0x974cd2 (0x12d bytes) 000027[0] 1746128027.529228 write 0x49f749 thru 0x4a01ce (0xa86 bytes) 000031[1] 1746128027.584822 trunc from 0x974cd3 to 0x783368 (0x1f196a bytes) 000032[1] 1746128027.626041 mapread 0x0f8999 thru 0x0fa095 (0x16fd bytes) 000034[0] 1746128027.660777 write 0x344bdd thru 0x345cc7 (0x10eb bytes) 000038[0] 1746128027.716019 trunc from 0x783369 to 0x2f2a99 (0x4908cf bytes) 000039[1] 1746128027.746299 mapwrite 0x26d3bb thru 0x26e1a3 (0xde9 bytes) 000040[1] 1746128027.842379 trunc from 0x2f2a9a to 0x10d2f4 (0x1e57a5 bytes) 000041[1] 1746128027.866165 mapwrite 0x19cf6a thru 0x19d7ac (0x843 bytes) 000043[1] 1746128027.981664 trunc from 0x19d7ad to 0x365171 (0x1c79c5 bytes) 000045[0] 1746128028.013066 mapread 0x2b3e8a thru 0x2b4a9c (0xc13 bytes) 000046[1] 1746128028.031329 read 0x1ad47b thru 0x1aeddd (0x1963 bytes) 000048[1] 1746128028.034770 mapread 0x3026d3 thru 0x3028c2 (0x1f0 bytes) 000049[1] 1746128028.048885 mapwrite 0x8335ba thru 0x833796 (0x1dd bytes) 000052[0] 1746128028.155294 trunc from 0x833797 to 0x49f1c2 (0x3945d4 bytes) 000053[1] 1746128028.203294 read 0x2e2735 thru 0x2e3ba4 (0x1470 bytes) 000055[1] 1746128028.240801 read 0x3a6bd4 thru 0x3a73ae (0x7db bytes) 000056[1] 1746128028.246573 trunc from 0x49f1c3 to 0x392ea2 (0x10c320 bytes) 000059[0] 1746128028.318695 read 0x1951a7 thru 0x19692b (0x1785 bytes) 000061[0] 1746128028.398223 read 0x34b5f9 thru 0x34d300 (0x1d08 bytes) 000066[1] 1746128028.456731 mapread 0x2ebbd0 thru 0x2ecd5d (0x118e bytes) 000067[1] 1746128028.464165 mapwrite 0x762b54 thru 0x76414e (0x15fb bytes) 000068[1] 1746128028.531383 trunc from 0x76414f to 0x58a8ac (0x1d98a2 bytes) 000070[0] 1746128028.565385 mapwrite 0x5c347a thru 0x5c4302 (0xe89 bytes) 000071[0] 1746128028.706357 write 0x736c40 thru 0x738369 (0x172a bytes) 000073[1] 1746128028.720648 write 0x6a9646 thru 0x6a9f2f (0x8ea bytes) 000075[0] 1746128028.756554 write 0x9c1286 thru 0x9c1763 (0x4de bytes) truncating to largest ever: 0x9e7a4c 000077[1] 1746128028.784584 trunc from 0x9c1764 to 0x9e7a4b (0x262e8 bytes) 000079[1] 1746128028.836341 mapwrite 0x2498c5 thru 0x24a77d (0xeb9 bytes) 000081[1] 1746128028.888748 read 0x60ce83 thru 0x60d181 (0x2ff bytes) 000082[0] 1746128028.893300 read 0x3eef05 thru 0x3f07a4 (0x18a0 bytes) 000083[0] 1746128028.918958 mapread 0x36f0b9 thru 0x36f818 (0x760 bytes) 000084[0] 1746128028.932760 write 0x93337d thru 0x933d7b (0x9ff bytes) 000085[0] 1746128028.959190 write 0x575ec0 thru 0x577a00 (0x1b41 bytes) 000086[1] 1746128028.978696 mapwrite 0x1a2c1a thru 0x1a3972 (0xd59 bytes) 000087[1] 1746128029.095690 read 0x861847 thru 0x862f84 (0x173e bytes) 000088[0] 1746128029.110660 trunc from 0x9e7a4c to 0x66f044 (0x378a07 bytes) 000090[1] 1746128029.161700 mapwrite 0x49a819 thru 0x49be52 (0x163a bytes) 000093[0] 1746128029.286816 trunc from 0x66f045 to 0x2cd3ca (0x3a1c7a bytes) 000096[0] 1746128029.309788 read 0x1c342b thru 0x1c44f6 (0x10cc bytes) 000098[0] 1746128029.363006 mapread 0x07eff9 thru 0x08009f (0x10a7 bytes) 000100[1] 1746128029.383495 mapread 0x0ae32d thru 0x0ae51d (0x1f1 bytes) 000102[1] 1746128029.418710 trunc from 0x2cd3cb to 0x770fe8 (0x4a3c1e bytes) 000106[1] 1746128029.473533 write 0x622255 thru 0x6223e3 (0x18f bytes) 000110[0] 1746128029.568887 read 0x202d92 thru 0x203827 (0xa96 bytes) 000112[1] 1746128029.589076 write 0x64a950 thru 0x64c65f (0x1d10 bytes) 000113[1] 1746128029.599388 read 0x18cdcb thru 0x18e9d6 (0x1c0c bytes) 000114[1] 1746128029.622969 mapwrite 0x7a5277 thru 0x7a54f9 (0x283 bytes) 000115[1] 1746128029.701353 trunc from 0x7a54fa to 0x4c653c (0x2defbd bytes) 000117[0] 1746128029.715450 mapread 0x0fe7da thru 0x0ffac3 (0x12ea bytes) 000118[0] 1746128029.729705 read 0x2b8d48 thru 0x2ba38e (0x1647 bytes) 000120[0] 1746128029.745660 read 0x01f604 thru 0x02115c (0x1b59 bytes) 000121[0] 1746128029.770179 mapread 0x4397b9 thru 0x43a66c (0xeb4 bytes) 000122[1] 1746128029.790120 mapread 0x0fb9f6 thru 0x0fd4fd (0x1b08 bytes) 000124[1] 1746128029.802055 read 0x161ce5 thru 0x1623b1 (0x6cd bytes) 000125[0] 1746128029.805089 read 0x351c7c thru 0x353037 (0x13bc bytes) 000132[1] 1746128029.810560 mapread 0x34daa1 thru 0x34f228 (0x1788 bytes) 000134[1] 1746128029.824566 read 0x2bd494 thru 0x2bea0f (0x157c bytes) 000136[0] 1746128029.830424 write 0x0c15c7 thru 0x0c204a (0xa84 bytes) 000137[0] 1746128029.844712 read 0x24e22d thru 0x24ebe1 (0x9b5 bytes) 000138[0] 1746128029.854910 mapwrite 0x81b05f thru 0x81b312 (0x2b4 bytes) 000145[0] 1746128030.006671 write 0x2a0a69 thru 0x2a22e7 (0x187f bytes) 000147[0] 1746128030.026537 mapwrite 0x4620b3 thru 0x462720 (0x66e bytes) 000149[1] 1746128030.091350 mapread 0x5e803a thru 0x5e85c2 (0x589 bytes) 000152[0] 1746128030.120960 mapwrite 0x6c41a3 thru 0x6c4350 (0x1ae bytes) 000155[0] 1746128030.202445 mapwrite 0x105728 thru 0x106084 (0x95d bytes) 000156[0] 1746128030.254601 read 0x426476 thru 0x427648 (0x11d3 bytes) 000157[1] 1746128030.260181 mapread 0x7374bf thru 0x73900c (0x1b4e bytes) 000158[0] 1746128030.306157 trunc from 0x81b313 to 0x9dfcf8 (0x1c49e6 bytes) 000160[1] 1746128030.353168 trunc from 0x9dfcf9 to 0x1df9db (0x80031d bytes) 000162[0] 1746128030.409080 mapread 0x1140ba thru 0x114d90 (0xcd7 bytes) 000163[1] 1746128030.431815 mapread 0x1a4b52 thru 0x1a56b2 (0xb61 bytes) 000166[1] 1746128030.453379 write 0x400afa thru 0x401fb2 (0x14b9 bytes) 000167[1] 1746128030.467919 write 0x28830e thru 0x289bfc (0x18ef bytes) 000170[0] 1746128030.486193 trunc from 0x401fb3 to 0x15d7c4 (0x2a47ee bytes) 000171[1] 1746128030.542623 trunc from 0x15d7c5 to 0x2ce6e4 (0x170f20 bytes) 000175[1] 1746128030.591564 trunc from 0x2ce6e5 to 0x0e6d88 (0x1e795c bytes) 000176[0] 1746128030.603091 write 0x120bf8 thru 0x122840 (0x1c49 bytes) 000177[1] 1746128030.622656 mapwrite 0x7c7e00 thru 0x7c90dc (0x12dd bytes) 000178[0] 1746128030.722621 read 0x52d9ca thru 0x52ed29 (0x1360 bytes) 000180[0] 1746128030.759511 mapread 0x025528 thru 0x02573f (0x218 bytes) 000183[0] 1746128030.776854 write 0x888503 thru 0x88a14a (0x1c48 bytes) 000184[0] 1746128030.795330 write 0x3d0fd3 thru 0x3d23d5 (0x1403 bytes) 000185[0] 1746128030.809907 read 0x5cedd5 thru 0x5cfc3e (0xe6a bytes) 000187[0] 1746128030.813650 write 0x672b98 thru 0x673225 (0x68e bytes) 000189[1] 1746128030.840041 write 0x1a0260 thru 0x1a055a (0x2fb bytes) 000191[1] 1746128030.872494 mapwrite 0x7fc5c5 thru 0x7fd45b (0xe97 bytes) 000194[1] 1746128030.984552 trunc from 0x88a14b to 0x1584f5 (0x731c55 bytes) 000196[0] 1746128031.022296 mapread 0x0fa98b thru 0x0fc013 (0x1689 bytes) 000198[0] 1746128031.062440 trunc from 0x1584f6 to 0x4d46aa (0x37c1b5 bytes) 000199[0] 1746128031.100921 trunc from 0x4d46ab to 0x9a6355 (0x4d1cab bytes) 000200[1] 1746128031.122554 write 0x9979c1 thru 0x9988f9 (0xf39 bytes) 000202[0] 1746128031.162705 read 0x6fae80 thru 0x6fb032 (0x1b3 bytes) 000203[1] 1746128031.176710 mapwrite 0x1e6076 thru 0x1e71db (0x1166 bytes) 000204[0] 1746128031.252434 read 0x7a8f45 thru 0x7a9508 (0x5c4 bytes) 000207[1] 1746128031.291331 mapwrite 0x007a39 thru 0x0081fe (0x7c6 bytes) 000208[1] 1746128031.364324 write 0x8a8821 thru 0x8a8b94 (0x374 bytes) 000210[0] 1746128031.388799 trunc from 0x9a6356 to 0x6a7272 (0x2ff0e3 bytes) 000212[0] 1746128031.416502 trunc from 0x6a7273 to 0x962475 (0x2bb203 bytes) 000213[0] 1746128031.434612 mapwrite 0x8773e2 thru 0x877582 (0x1a1 bytes) 000216[1] 1746128031.520132 mapwrite 0x0211f7 thru 0x021220 (0x2a bytes) 000218[1] 1746128031.615972 trunc from 0x962476 to 0x9b6132 (0x53cbd bytes) 000220[0] 1746128031.663484 mapwrite 0x2d0c04 thru 0x2d19ed (0xdea bytes) 000221[0] 1746128031.763527 read 0x9963df thru 0x996b6e (0x790 bytes) 000222[0] 1746128031.780393 mapwrite 0x57259b thru 0x572649 (0xaf bytes) 000224[0] 1746128031.855670 write 0x3cf5d6 thru 0x3d0e3c (0x1867 bytes) 000227[0] 1746128031.874980 write 0x32fe87 thru 0x330a33 (0xbad bytes) 000229[0] 1746128031.914544 write 0x2f0b50 thru 0x2f0e19 (0x2ca bytes) 000230[1] 1746128031.933712 trunc from 0x9b6133 to 0x43a804 (0x57b92e bytes) 000231[1] 1746128031.970221 read 0x27224d thru 0x274068 (0x1e1c bytes) 000232[0] 1746128032.006808 trunc from 0x43a805 to 0x286dc3 (0x1b3a41 bytes) 000233[0] 1746128032.057275 mapread 0x26cff8 thru 0x26d5c7 (0x5d0 bytes) 000234[1] 1746128032.098062 write 0x2149a8 thru 0x214de9 (0x442 bytes) 000235[0] 1746128032.138730 write 0x5ee9b2 thru 0x5ef738 (0xd87 bytes) 000238[1] 1746128032.171335 write 0x31a88c thru 0x31c61f (0x1d94 bytes) 000241[0] 1746128032.199527 mapread 0x5b776d thru 0x5b887a (0x110e bytes) 000242[0] 1746128032.222283 mapwrite 0x891e63 thru 0x893538 (0x16d6 bytes) 000243[0] 1746128032.329010 trunc from 0x893539 to 0x1c4e84 (0x6ce6b4 bytes) 000244[0] 1746128032.364856 trunc from 0x1c4e85 to 0x5f43ee (0x42f56a bytes) 000245[1] 1746128032.394746 mapwrite 0x22b520 thru 0x22d0c9 (0x1baa bytes) 000246[1] 1746128032.491991 trunc from 0x5f43ef to 0x73d3f0 (0x149002 bytes) 000248[1] 1746128032.542574 trunc from 0x73d3f1 to 0x06ca45 (0x6d09ab bytes) 000249[0] 1746128032.592284 write 0x86f713 thru 0x8703a9 (0xc97 bytes) 000253[1] 1746128032.645352 mapread 0x7dc464 thru 0x7dcc19 (0x7b6 bytes) 000259[0] 1746128032.730503 trunc from 0x8703aa to 0x4c2ccf (0x3ad6da bytes) 000260[0] 1746128032.756050 read 0x03d93a thru 0x03de24 (0x4eb bytes) 000264[1] 1746128032.826215 trunc from 0x4c2cd0 to 0x1773ea (0x34b8e5 bytes) 000265[1] 1746128032.863429 write 0x08962a thru 0x089ff8 (0x9cf bytes) 000266[0] 1746128032.868268 mapwrite 0x1ab809 thru 0x1ac85b (0x1053 bytes) 000270[1] 1746128033.010714 read 0x0ddc8a thru 0x0de909 (0xc80 bytes) 000273[1] 1746128033.070437 read 0x16bb66 thru 0x16d16f (0x160a bytes) 000274[1] 1746128033.082031 trunc from 0x1ac85c to 0x537917 (0x38b0bc bytes) 000276[1] 1746128033.121422 read 0x0f5f91 thru 0x0f642b (0x49b bytes) 000277[0] 1746128033.138271 trunc from 0x537918 to 0x3eb9f2 (0x14bf25 bytes) 000280[0] 1746128033.187995 mapwrite 0x429ea0 thru 0x42b904 (0x1a65 bytes) 000281[1] 1746128033.314464 trunc from 0x42b905 to 0x747658 (0x31bd54 bytes) 000287[0] 1746128033.375834 trunc from 0x747659 to 0x011ca5 (0x7359b3 bytes) 000290[0] 1746128033.429497 mapwrite 0x9c7cd8 thru 0x9c939d (0x16c6 bytes) 000291[0] 1746128033.494399 mapread 0x2a5009 thru 0x2a5bfc (0xbf4 bytes) 000296[1] 1746128033.514455 read 0x664907 thru 0x6651b7 (0x8b1 bytes) 000299[0] 1746128033.527143 read 0x8bc58b thru 0x8bd165 (0xbdb bytes) 000300[1] 1746128033.533528 write 0x0bd356 thru 0x0bf28f (0x1f3a bytes) 000301[0] 1746128033.564742 mapread 0x74be95 thru 0x74cb7f (0xceb bytes) 000302[0] 1746128033.576755 write 0x66ff4d thru 0x67011b (0x1cf bytes) 000303[1] 1746128033.599321 read 0x2e97db thru 0x2eab17 (0x133d bytes) 000305[0] 1746128033.626511 write 0x558320 thru 0x558e7d (0xb5e bytes) 000309[1] 1746128033.684286 mapread 0x3f21fe thru 0x3f270b (0x50e bytes) 000310[1] 1746128033.723534 trunc from 0x9c939e to 0x98e31a (0x3b083 bytes) 000311[1] 1746128033.762145 write 0x89f8cf thru 0x8a0bee (0x1320 bytes) 000313[0] 1746128033.793665 mapread 0x4321af thru 0x433f6c (0x1dbe bytes) 000314[1] 1746128033.814405 trunc from 0x98e31b to 0x2b8430 (0x6d5eea bytes) 000315[0] 1746128033.838897 trunc from 0x2b8431 to 0x138edf (0x17f551 bytes) 000321[0] 1746128033.897720 read 0x0810cb thru 0x081764 (0x69a bytes) 000323[1] 1746128033.946401 write 0x72bd12 thru 0x72c44c (0x73b bytes) 000328[0] 1746128034.019306 trunc from 0x72c44d to 0x73ba1e (0xf5d2 bytes) 000330[1] 1746128034.064528 read 0x65618e thru 0x6564c2 (0x335 bytes) 000331[0] 1746128034.081408 mapread 0x43296e thru 0x4329c3 (0x56 bytes) 000334[1] 1746128034.119387 mapread 0x658eb0 thru 0x6598d4 (0xa25 bytes) 000337[0] 1746128034.163632 mapread 0x5ea30c thru 0x5ebaaf (0x17a4 bytes) 000345[0] 1746128034.259808 trunc from 0x73ba1f to 0x9997a1 (0x25dd83 bytes) 000346[1] 1746128034.296481 read 0x15bdae thru 0x15d09b (0x12ee bytes) 000348[1] 1746128034.323445 mapwrite 0x51dfa6 thru 0x51f3c7 (0x1422 bytes) 000349[0] 1746128034.421200 read 0x3fdbd7 thru 0x3ff6e7 (0x1b11 bytes) 000350[0] 1746128034.431436 mapread 0x2da6b9 thru 0x2dab2e (0x476 bytes) 000352[1] 1746128034.464391 mapwrite 0x5477b7 thru 0x5486b6 (0xf00 bytes) 000355[1] 1746128034.564379 mapread 0x30721e thru 0x307fcb (0xdae bytes) 000356[0] 1746128034.568441 read 0x15eee7 thru 0x15f101 (0x21b bytes) 000357[0] 1746128034.572161 trunc from 0x9997a2 to 0x55eeb1 (0x43a8f0 bytes) 000359[0] 1746128034.636266 trunc from 0x55eeb2 to 0x34194c (0x21d565 bytes) 000360[1] 1746128034.663462 write 0x879cb0 thru 0x87af5a (0x12ab bytes) 000361[0] 1746128034.692605 read 0x6c9a13 thru 0x6caa9f (0x108d bytes) 000362[0] 1746128034.713284 mapwrite 0x606c3d thru 0x607e8d (0x1251 bytes) 000364[0] 1746128034.826261 read 0x232086 thru 0x232dc1 (0xd3c bytes) 000365[0] 1746128034.839624 mapread 0x346e8d thru 0x347b2f (0xca3 bytes) 000366[0] 1746128034.853960 write 0x520474 thru 0x521de0 (0x196d bytes) 000367[0] 1746128034.865256 write 0x6868c9 thru 0x687ea5 (0x15dd bytes) 000369[0] 1746128034.870787 write 0x5cedb4 thru 0x5cf678 (0x8c5 bytes) 000371[0] 1746128034.876686 read 0x35bf5f thru 0x35c4f5 (0x597 bytes) 000374[1] 1746128034.898692 trunc from 0x87af5b to 0x2e8874 (0x5926e6 bytes) 000375[1] 1746128034.947415 write 0x677306 thru 0x678e7a (0x1b75 bytes) 000378[1] 1746128034.953519 mapread 0x062765 thru 0x063a18 (0x12b4 bytes) 000379[0] 1746128034.990125 mapwrite 0x2b879a thru 0x2b9880 (0x10e7 bytes) 000380[0] 1746128035.075564 mapwrite 0x1cde13 thru 0x1ce80e (0x9fc bytes) 000381[1] 1746128035.174370 write 0x2f8b65 thru 0x2f9d1d (0x11b9 bytes) 000382[1] 1746128035.189985 write 0x93128b thru 0x932b54 (0x18ca bytes) 000388[0] 1746128035.277465 write 0x58ea76 thru 0x59053a (0x1ac5 bytes) 000389[1] 1746128035.304303 mapread 0x26ff64 thru 0x270d07 (0xda4 bytes) 000392[0] 1746128035.340686 read 0x363abb thru 0x364146 (0x68c bytes) 000393[1] 1746128035.356851 trunc from 0x932b55 to 0x68ba54 (0x2a7100 bytes) 000394[1] 1746128035.408701 write 0x87f790 thru 0x881714 (0x1f85 bytes) 000395[0] 1746128035.412037 trunc from 0x881715 to 0x493e58 (0x3ed8bc bytes) 000398[0] 1746128035.463710 mapwrite 0x8ab10d thru 0x8abcb7 (0xbab bytes) 000399[0] 1746128035.533283 mapwrite 0x0cd025 thru 0x0ce096 (0x1072 bytes) 000400[0] 1746128035.636998 mapread 0x1572de thru 0x158539 (0x125c bytes) 000401[1] 1746128035.649773 write 0x591305 thru 0x59160b (0x307 bytes) 000404[0] 1746128035.711136 read 0x27fa7d thru 0x280496 (0xa1a bytes) 000406[1] 1746128035.733498 read 0x10af1e thru 0x10bb43 (0xc26 bytes) 000408[1] 1746128035.763236 read 0x75e8e6 thru 0x75ee0f (0x52a bytes) 000411[1] 1746128035.780082 mapread 0x7cc647 thru 0x7ccdbb (0x775 bytes) 000412[1] 1746128035.804658 write 0x8aa893 thru 0x8ac406 (0x1b74 bytes) 000415[1] 1746128035.827454 mapread 0x28407c thru 0x285f57 (0x1edc bytes) 000416[0] 1746128035.852881 trunc from 0x8ac407 to 0x933515 (0x8710f bytes) 000420[1] 1746128035.898750 mapread 0x7148c6 thru 0x7148d5 (0x10 bytes) 000421[0] 1746128035.924361 read 0x7f582b thru 0x7f6e35 (0x160b bytes) 000426[1] 1746128035.971203 write 0x5ef116 thru 0x5f018a (0x1075 bytes) 000429[0] 1746128036.007570 read 0x5b4bfa thru 0x5b6011 (0x1418 bytes) 000430[0] 1746128036.022188 read 0x425c73 thru 0x426ac0 (0xe4e bytes) 000432[1] 1746128036.026687 mapwrite 0x9fd105 thru 0x9fde58 (0xd54 bytes) 000436[0] 1746128036.145639 trunc from 0x9fde59 to 0x35a455 (0x6a3a03 bytes) 000437[0] 1746128036.182137 write 0x5972de thru 0x597a66 (0x789 bytes) 000439[0] 1746128036.224618 trunc from 0x597a67 to 0x852b3e (0x2bb0d8 bytes) 000440[0] 1746128036.252722 trunc from 0x852b3f to 0x561982 (0x2f11bc bytes) 000442[1] 1746128036.277508 read 0x02ef38 thru 0x030beb (0x1cb4 bytes) 000447[1] 1746128036.323596 write 0x382f1b thru 0x383f79 (0x105f bytes) 000448[0] 1746128036.348093 trunc from 0x561983 to 0x3023c0 (0x25f5c2 bytes) 000449[0] 1746128036.374101 mapread 0x0e138a thru 0x0e2db1 (0x1a28 bytes) 000450[1] 1746128036.392620 write 0x8a9070 thru 0x8a9bb7 (0xb48 bytes) 000452[1] 1746128036.448674 trunc from 0x8a9bb8 to 0x81ce5d (0x8cd5a bytes) 000453[0] 1746128036.493442 mapwrite 0x7991ab thru 0x79a96b (0x17c1 bytes) 000454[0] 1746128036.586165 mapwrite 0x89cb81 thru 0x89d63f (0xabf bytes) 000455[0] 1746128036.720547 trunc from 0x89d640 to 0x95866b (0xbb02c bytes) 000457[1] 1746128036.754147 read 0x08579e thru 0x0868d9 (0x113c bytes) 000462[1] 1746128036.814263 mapwrite 0x62f217 thru 0x62f96b (0x755 bytes) 000466[0] 1746128036.920811 trunc from 0x95866c to 0x67a700 (0x2ddf6b bytes) 000467[0] 1746128036.964475 mapwrite 0x09c675 thru 0x09dbc1 (0x154d bytes) 000468[1] 1746128037.025448 mapwrite 0x805ff0 thru 0x806f3e (0xf4f bytes) 000471[1] 1746128037.114154 mapread 0x1da514 thru 0x1db656 (0x1143 bytes) 000472[1] 1746128037.137631 mapwrite 0x90976e thru 0x90aaad (0x1340 bytes) 000474[1] 1746128037.220676 write 0x1b18af thru 0x1b3361 (0x1ab3 bytes) 000475[0] 1746128037.245809 read 0x08cf4c thru 0x08d376 (0x42b bytes) 000476[1] 1746128037.262680 mapread 0x7e3519 thru 0x7e4d1b (0x1803 bytes) 000477[0] 1746128037.276881 trunc from 0x90aaae to 0x3fd569 (0x50d544 bytes) 000478[1] 1746128037.306923 mapread 0x297943 thru 0x297d3c (0x3fa bytes) 000479[0] 1746128037.335467 write 0x3c68e1 thru 0x3c82c0 (0x19e0 bytes) 000480[0] 1746128037.349462 mapwrite 0x8e611c thru 0x8e7a18 (0x18fd bytes) 000482[0] 1746128037.433429 mapread 0x325ad3 thru 0x325e27 (0x355 bytes) 000484[0] 1746128037.452998 read 0x3e2633 thru 0x3e322c (0xbfa bytes) 000486[0] 1746128037.456589 read 0x72f072 thru 0x72fb58 (0xae7 bytes) 000490[0] 1746128037.525709 write 0x78d74e thru 0x78ead2 (0x1385 bytes) 000492[0] 1746128037.549922 mapread 0x8e48d7 thru 0x8e63cb (0x1af5 bytes) 000495[1] 1746128037.571534 mapread 0x5066d0 thru 0x506782 (0xb3 bytes) 000496[0] 1746128037.619400 read 0x15acb4 thru 0x15c2a3 (0x15f0 bytes) 000497[1] 1746128037.624578 mapwrite 0x2f0381 thru 0x2f223e (0x1ebe bytes) 000498[0] 1746128037.682555 write 0x4241a1 thru 0x425c27 (0x1a87 bytes) All operations completed A-OK! PASS 16b (15s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 15:34:00 (1746128040) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (2s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 15:34:03 (1746128043) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.387559 s, 21.6 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.248553 s, 33.7 MB/s ldlm.namespaces.MGC192.168.203.128@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b5c14000.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff88012d012800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b5c14000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff88012d012800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b5c14000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff88012d012800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 7.45963 s, 14.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.0006 s, 52.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.15254 s, 91.0 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 3.28312 s, 31.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.20916 s, 16.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.67091 s, 62.8 MB/s PASS 16d (28s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 15:34:31 (1746128071) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.177828 s, 59.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.076032 s, 13.8 MB/s PASS 16e (5s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 15:34:36 (1746128076) TIMEOUT PASS 16f (24s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 15:35:00 (1746128100) TIMEOUT PASS 16g (25s) == sanityn test 16h: mmap read after truncate file ======= 15:35:25 (1746128125) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (4s) == sanityn test 16i: read after truncate file ============ 15:35:29 (1746128129) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (4s) == sanityn test 16j: race dio with buffered i/o ========== 15:35:33 (1746128133) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.83862 s, 31.3 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.930472 s, 28.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.37408 s, 11.0 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.450354 s, 58.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.94749 s, 13.5 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 dd: error reading '/mnt/lustre/f16j.sanityn.1': Invalid argument 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.163137 s, 0.0 kB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.38122 s, 68.8 MB/s sanityn test_16j: @@@@@@ FAIL: dio copy 1 w/bsize 1049600 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanityn.sh:760:test_16j() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanityn.sh:830:main() Dumping lctl log to /tmp/testlogs//sanityn.test_16j.*.1746128144.log rsync: chown "/tmp/testlogs/.sanityn.test_16j.debug_log.oleg328-server.1746128144.log.h58ziv" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanityn.test_16j.dmesg.oleg328-server.1746128144.log.VW7Snz" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 16j (15s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 15:35:52 (1746128152) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! + fsx 1 done: rc=0 Thu May 1 15:36:22 EDT 2025 All operations completed A-OK! + fsx 2 done: rc=0 Thu May 1 15:36:23 EDT 2025 All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 3 done: rc=0 Thu May 1 15:36:23 EDT 2025 + fsx 4 done: rc=0 Thu May 1 15:36:23 EDT 2025 + fsx 5 done: rc=0 Thu May 1 15:36:23 EDT 2025 PASS 16k (35s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 15:36:27 (1746128187) fail_loc=0x8000030a PASS 17 (7s) == sanityn test 18: mmap sanity check =========================================================================================== 15:36:35 (1746128195) mmap test1: basic mmap operation (PASS, 0.1075s) mmap test2: MAP_PRIVATE not write back (PASS, 0.04226s) mmap test3: concurrent mmap ops on two nodes (PASS, 11.519s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.296s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.10632s) mmap test6: check mmap write/read content on two nodes (PASS, 0.1661s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.67565s) mmap test11: multi-thread shared mmap (PASS, 0.73629s) mmap test10: mtime not change for readonly mmap access (PASS, 1.088s) PASS 18 (23s) == sanityn test 19: test concurrent uncached read races ========================================================================= 15:36:59 (1746128219) oleg328-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg328-client: oleg328-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (3s) == sanityn test 20: test extra readahead page left in cache ============================================================== 15:37:02 (1746128222) PASS 20 (4s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 15:37:07 (1746128227) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (4s) == sanityn test 23: others should see updated atime while another read============================================================== 15:37:11 (1746128231) now is 1746128233 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 new atime is 1746128294 PASS 23 (66s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 15:38:17 (1746128297) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre2[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 114.9K 406 114.5K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 114.1K 403 113.7K 1% /mnt/lustre[OST:1] filesystem_summary: 228.6K 387 228.2K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 114.9K 406 114.5K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.1K 403 113.7K 1% /mnt/lustre2[OST:1] filesystem_summary: 228.6K 387 228.2K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 19.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 44.0M 3.6G 2% /mnt/lustre[OST:1] filesystem_summary: 7.2G 63.0M 7.1G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 117654 406 117248 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 116851 403 116448 1% /mnt/lustre2[OST:1] filesystem_summary: 234083 387 233696 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 114.9K 406 114.5K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.1K 403 113.7K 1% /mnt/lustre2[OST:1] filesystem_summary: 228.6K 387 228.2K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre[MDT:0] filesystem_summary: 502378 387 501991 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 117654 406 117248 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 116851 403 116448 1% /mnt/lustre2[OST:1] filesystem_summary: 234083 387 233696 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre2[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre2 PASS 24a (4s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 15:38:21 (1746128301) PASS 24b (4s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 15:38:25 (1746128305) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (4s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 15:38:30 (1746128310) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (2s) == sanityn test 26a: allow mtime to get older ============ 15:38:32 (1746128312) utime: good mknod times 1746128311 <= 1746128312 <= 1746128312 for /mnt/lustre/f26a utime: good mknod times 1746128311 <= 1746128312 <= 1746128312 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (5s) == sanityn test 26b: sync mtime between ost and mds ====== 15:38:36 (1746128316) PASS 26b (6s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 15:38:42 (1746128322) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502391 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-05-01 15:38:44.000000000 -0400 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502391 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-05-01 15:38:44.000000000 -0400 Birth: - PASS 26c (6s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 15:38:50 (1746128330) 0 PASS 30 (6s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 15:38:56 (1746128336) fail_loc=0x314 PASS 31a (5s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 15:39:01 (1746128341) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg328-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.203.128@tcp:/lustre 7542784 64512 7470080 1% /mnt/lustre2 PASS 31b (14s) == sanityn test 31r: open-rename(replace) race =========== 15:39:16 (1746128356) -rw-r--r-- 1 root root 0 May 1 15:39 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (8s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 15:39:23 (1746128363) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1213: 13628 Terminated tail -f $tfile PASS 31s (5s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 15:39:28 (1746128368) PASS 31t (5s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 15:39:34 (1746128374) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (2s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 15:39:36 (1746128376) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (2s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 15:39:38 (1746128378) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (2s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 15:39:40 (1746128380) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (2s) == sanityn test 34: no lock timeout under IO ============= 15:39:42 (1746128382) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg328-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b5c14000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b5c14000.ost_server_uuid in IDLE state after 0 sec oleg328-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b5c14000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b5c14000.ost_server_uuid in FULL state after 0 sec oleg328-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b5c14000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b5c14000.ost_server_uuid in IDLE state after 0 sec oleg328-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b5c14000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b5c14000.ost_server_uuid in IDLE state after 0 sec oleg328-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b5c14000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b5c14000.ost_server_uuid in IDLE state after 0 sec oleg328-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b5c14000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b5c14000.ost_server_uuid in IDLE state after 0 sec PASS 34 (102s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 15:41:24 (1746128484) fail_loc=0x80000317 Race attempt 0 Wait for 20288 20394 for 60 sec... - open/close 1276 (time 1746128498.84 total 10.01 last 127.51) - open/close 2598 (time 1746128508.84 total 20.01 last 132.19) - open/close 3906 (time 1746128518.85 total 30.01 last 130.77) total: 4000 open/close in 30.83 seconds: 129.73 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.203.128@tcp:/lustre 7.2G 64M 7.2G 1% /mnt/lustre 192.168.203.128@tcp:/lustre 7.2G 64M 7.2G 1% /mnt/lustre2 PASS 35 (68s) == sanityn test 36: handle ESTALE/open-unlink correctly == 15:42:32 (1746128552) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg328-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.837234 s, 62.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS Waiting for MDT destroys to complete *** cycle(0) *** before(7473152) after_dd(7415808) after(7467008) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.641338 s, 81.7 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7467008) after_dd(7414784) after(7465984) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.608873 s, 86.1 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7465984) after_dd(7414784) after(7465984) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.643165 s, 81.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS Waiting for MDT destroys to complete *** cycle(3) *** before(7465984) after_dd(7417856) after(7469056) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.82437 s, 63.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7469056) after_dd(7417856) after(7469056) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.711178 s, 73.7 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7469056) after_dd(7412736) after(7463936) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.607334 s, 86.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7463936) after_dd(7417856) after(7469056) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.455497 s, 115 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7469056) after_dd(7415808) after(7467008) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.50647 s, 104 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS Waiting for MDT destroys to complete *** cycle(8) *** before(7467008) after_dd(7415808) after(7467008) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.47838 s, 110 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7467008) after_dd(7395328) after(7446528) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.705293 s, 74.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7446528) after_dd(7417856) after(7469056) PASS 36 (215s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 15:46:07 (1746128767) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 - create 2528 (time 1746128779.96 total 10.01 last 252.64) - create 4472 (time 1746128789.96 total 20.01 last 194.40) - create 6833 (time 1746128799.97 total 30.01 last 236.01) - create 9181 (time 1746128809.97 total 40.01 last 234.77) total: 10000 create in 43.30 seconds: 230.95 ops/second PASS 37 (50s) == sanityn test 39a: file mtime does not change after rename ========================================================== 15:46:57 (1746128817) repeat after cancel_lru_locks PASS 39a (4s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 15:47:01 (1746128821) repeat after cancel_lru_locks PASS 39b (5s) == sanityn test 39c: check truncate mtime update ================================================================================ 15:47:06 (1746128826) repeat after cancel_lru_locks PASS 39c (5s) == sanityn test 39d: sync write should update mtime ====== 15:47:11 (1746128831) fail_loc=0x411 fail_loc=0 PASS 39d (5s) == sanityn test 40a: pdirops: create vs others ======================================================================== 15:47:16 (1746128836) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (13s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 15:47:29 (1746128849) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (12s) == sanityn test 40c: pdirops: link and others ======================================================================== 15:47:41 (1746128861) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (12s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 15:47:53 (1746128873) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (13s) == sanityn test 40e: pdirops: rename and others ======================================================================== 15:48:06 (1746128886) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (12s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 15:48:18 (1746128898) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (9s) == sanityn test 41b: pdirops: create vs create ======================================================================== 15:48:27 (1746128907) open: File exists Conflict PASS 41b (9s) == sanityn test 41c: pdirops: create vs link ======================================================================== 15:48:37 (1746128917) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (10s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 15:48:46 (1746128926) Conflict PASS 41d (10s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 15:48:56 (1746128936) Conflict PASS 41e (9s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 15:49:05 (1746128945) Conflict PASS 41f (10s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 15:49:15 (1746128955) Conflict PASS 41g (9s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 15:49:24 (1746128964) Conflict PASS 41h (10s) == sanityn test 41i: reint_open: create vs create ======== 15:49:34 (1746128974) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (803s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 16:02:57 (1746129777) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (8s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 16:03:05 (1746129785) open: File exists Conflict PASS 42b (7s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 16:03:12 (1746129792) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (7s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 16:03:19 (1746129799) Conflict PASS 42d (8s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 16:03:27 (1746129807) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (6s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 16:03:33 (1746129813) Conflict PASS 42f (7s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 16:03:40 (1746129820) Conflict PASS 42g (6s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 16:03:46 (1746129826) Conflict PASS 42h (7s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 16:03:53 (1746129833) PASS 43a (33s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 16:04:26 (1746129866) Conflict PASS 43b (7s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 16:04:33 (1746129873) Conflict PASS 43c (7s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 16:04:41 (1746129881) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (8s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 16:04:49 (1746129889) Conflict PASS 43e (8s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 16:04:57 (1746129897) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (9s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 16:05:06 (1746129906) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (7s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 16:05:14 (1746129914) Conflict PASS 43h (7s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 16:05:21 (1746129921) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (2s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 16:05:23 (1746129923) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (67s) == sanityn test 43k: unlink vs create ==================== 16:06:30 (1746129990) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (591s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 16:16:21 (1746130581) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Thu May 1 16:16:25 EDT 2025 PASS 44a (5s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 16:16:26 (1746130586) open: File exists Conflict PASS 44b (6s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 16:16:32 (1746130592) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (6s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 16:16:38 (1746130598) Conflict PASS 44d (6s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 16:16:44 (1746130604) Conflict PASS 44e (6s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 16:16:50 (1746130610) Conflict PASS 44f (6s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 16:16:56 (1746130616) Conflict PASS 44g (6s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 16:17:02 (1746130622) Conflict PASS 44h (6s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 16:17:08 (1746130628) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 16:17:09 (1746130629) PASS 45a (54s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 16:18:03 (1746130683) Conflict PASS 45b (7s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 16:18:10 (1746130690) Conflict PASS 45c (8s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 16:18:18 (1746130698) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (6s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 16:18:24 (1746130704) Conflict PASS 45e (6s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 16:18:30 (1746130710) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (7s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 16:18:37 (1746130717) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (7s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 16:18:44 (1746130724) Conflict PASS 45h (6s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 16:18:51 (1746130731) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 16:18:52 (1746130732) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (641s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 16:29:33 (1746131373) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (8s) == sanityn test 46b: pdirops: link vs create ======================================================================== 16:29:41 (1746131381) open: File exists Conflict PASS 46b (7s) == sanityn test 46c: pdirops: link vs link ======================================================================== 16:29:49 (1746131389) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (9s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 16:29:57 (1746131397) Conflict PASS 46d (8s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 16:30:05 (1746131405) Conflict PASS 46e (7s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 16:30:12 (1746131412) Conflict PASS 46f (10s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 16:30:22 (1746131422) Conflict PASS 46g (8s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 16:30:31 (1746131431) Conflict PASS 46h (8s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 16:30:39 (1746131439) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (2s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 16:30:41 (1746131441) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (2s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 16:30:43 (1746131443) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 16:30:45 (1746131445) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (2s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 16:30:46 (1746131446) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (2s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 16:30:48 (1746131448) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (2s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 16:30:50 (1746131450) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (2s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 16:30:52 (1746131452) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 16:30:54 (1746131454) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.137024 s, 74.7 kB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (9s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 16:31:03 (1746131463) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.01209 s, 13.2 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3519: kill: (10530) - No such process PASS 51a (5s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 16:31:08 (1746131468) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00691105 s, 148 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232062 s, 45.2 MB/s 3145728 PASS 51b (15s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 16:31:23 (1746131483) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0188812 s, 54.2 kB/s PASS 51c (8s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 16:31:31 (1746131491) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017728 s, 59.1 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (4s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 16:31:35 (1746131495) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2445 0x98d 0x280000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2445 0x98d 0x280000400 read lease(1) has applied. PASS 51e (5s) == sanityn test 54: rename locking ======================= 16:31:40 (1746131500) llite.lustre-ffff8800b5c14000.xattr_cache=1 llite.lustre-ffff88012d012800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505005 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 16:31:41.000000000 -0400 Modify: 2025-05-01 16:31:41.000000000 -0400 Change: 2025-05-01 16:31:41.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505008 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 16:31:47.000000000 -0400 Modify: 2025-05-01 16:31:47.000000000 -0400 Change: 2025-05-01 16:31:47.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505011 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 16:31:53.000000000 -0400 Modify: 2025-05-01 16:31:53.000000000 -0400 Change: 2025-05-01 16:31:53.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505010 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 16:31:52.000000000 -0400 Modify: 2025-05-01 16:31:53.000000000 -0400 Change: 2025-05-01 16:31:53.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505014 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 16:31:58.000000000 -0400 Modify: 2025-05-01 16:31:59.000000000 -0400 Change: 2025-05-01 16:31:59.000000000 -0400 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505013 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 16:31:58.000000000 -0400 Modify: 2025-05-01 16:31:59.000000000 -0400 Change: 2025-05-01 16:31:59.000000000 -0400 Birth: - PASS 54 (26s) == sanityn test 55a: rename vs unlink target dir ========= 16:32:06 (1746131526) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (9s) == sanityn test 55b: rename vs unlink source dir ========= 16:32:15 (1746131535) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (9s) == sanityn test 55c: rename vs unlink orphan target dir == 16:32:24 (1746131544) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (14s) == sanityn test 55d: rename file vs link ================= 16:32:38 (1746131558) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (11s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 16:32:49 (1746131569) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1746131570 chunksize: 4096 size: 16777216000000 write offset: 16384000000kB 1.15168 MB/s read offset: 16384000000kB inf MB/s llverdev: data verified successfully PASS 56a (57s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 16:33:46 (1746131626) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1746131629 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 2.03457 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (68s) == sanityn test 60: Verify data_version behaviour ======== 16:34:54 (1746131694) PASS 60 (4s) == sanityn test 70a: cd directory && rm directory ======== 16:34:58 (1746131698) PASS 70a (4s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 16:35:02 (1746131702) PASS 70b (4s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 16:35:07 (1746131707) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.0158167 s, 4.1 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (2s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 16:35:09 (1746131709) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.0160812 s, 4.1 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (2s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 16:35:11 (1746131711) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (2s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 16:35:13 (1746131713) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.0149448 s, 4.4 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (2s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 16:35:15 (1746131715) llite.lustre-ffff8800b5c14000.xattr_cache=1 llite.lustre-ffff88012d012800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (3s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 16:35:18 (1746131718) llite.lustre-ffff8800b5c14000.xattr_cache=1 llite.lustre-ffff88012d012800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (4s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 16:35:22 (1746131722) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0217017 s, 47.2 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00695014 s, 147 kB/s 23031: get lock2 23032: get lock1 23032: done 23032: get lock2 23031: done 23031: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 23031: cannot get lock1: Resource deadlock avoided 23032: done 23032: exit rc=0 23031: done 23031: exit rc=0 PASS 74 (8s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 16:35:30 (1746131730) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0331934 s, 63.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193801 s, 54.1 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4108: 23674 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (9s) == sanityn test 76: Verify MDT open_files listing ======== 16:35:39 (1746131739) opening files: ........ closing files: ........ PASS 76 (35s) == sanityn test 77a: check FIFO NRS policy =============== 16:36:14 (1746131774) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.172933 s, 97.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285296 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315022 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174675 s, 60.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250885 s, 41.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0696913 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0439759 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0668256 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0687036 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0777978 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0767401 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0836061 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.087381 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0869569 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0938868 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0924873 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110591 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345082 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0321242 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343389 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331183 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0087032 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353744 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0376631 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0356225 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0394885 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0367959 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0437581 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0319767 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286805 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407315 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345876 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0428224 s, 24.5 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (5s) == sanityn test 77b: check CRR-N NRS policy ============== 16:36:19 (1746131779) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.241373 s, 69.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204682 s, 51.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371386 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0796916 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0799495 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0733957 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0981129 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.09303 s, 11.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0939696 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0918325 s, 11.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105345 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0898408 s, 11.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0973601 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0960253 s, 10.9 MB/s 1048576 bytes (1.0 MB) copied, 0.106959 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112351 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118174 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283105 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238361 s, 44.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315561 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302931 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236683 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236598 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029655 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283668 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307512 s, 34.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0303131 s, 34.6 MB/s , 0.0291477 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418603 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330089 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0334274 s, 31.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.036365 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413583 s, 25.4 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.216285 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0383978 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178115 s, 58.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0471059 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0199998 s, 52.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149309 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132835 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151161 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151268 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145183 s, 7.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147911 s, 7.1 MB/s 1048576 bytes (1.0 MB) copied, 0.142717 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.14561 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146901 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113571 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149992 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133228 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145723 s, 72.0 MB/s , 0.0218617 s, 48.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137138 s, 76.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0154461 s, 67.9 MB/s , 0.0155445 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171895 s, 61.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180837 s, 58.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175867 s, 59.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183258 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216461 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243825 s, 43.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249779 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252788 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261045 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275737 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0321085 s, 32.7 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (7s) == sanityn test 77c: check ORR NRS policy ================ 16:36:26 (1746131786) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.288092 s, 58.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301867 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0434887 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377226 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0579316 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0889402 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112536 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110611 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115767 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113463 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146339 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149042 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152201 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178651 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.164839 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.194104 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.258228 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229087 s, 45.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00265102 s, 396 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00182835 s, 574 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0708675 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0774543 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0660999 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0544474 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0400233 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0535992 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0534743 s, 19.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0496082 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00788751 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292522 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241442 s, 43.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0380247 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022726 s, 46.1 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.172888 s, 97.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0490785 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0534973 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118792 s, 8.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128873 s, 8.1 MB/s 1048576 bytes (1.0 MB) copied, 0.12621 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131825 s, 8.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146802 s, 7.1 MB/s 1048576 bytes (1.0 MB) copied, 0.142067 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.138697 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154922 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146228 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15035 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148675 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146209 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155889 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1811 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283979 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288722 s, 36.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026045 s, 40.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0327916 s, 32.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331451 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028169 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303154 s, 34.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035023 s, 29.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0411414 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371992 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0379282 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0390103 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427935 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0441073 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0457846 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0484553 s, 21.6 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.234072 s, 71.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351355 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384172 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0537181 s, 19.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130164 s, 8.1 MB/s 1048576 bytes (1.0 MB) copied, 0.138946 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144597 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144067 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.167633 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.157719 s, 6.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17734 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.192749 s, 5.4 MB/s 1048576 bytes (1.0 MB) copied, 0.186053 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.195086 s, 5.4 MB/s , 0.199279 s, 5.3 MB/s 1048576 bytes (1.0 MB) copied, 0.193343 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.245941 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035973 s, 29.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405187 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.049713 s, 21.1 MB/s , 0.0406949 s, 25.8 MB/s , 0.0325499 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0394629 s, 26.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345132 s, 30.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0298326 s, 35.1 MB/s , 0.0290719 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288936 s, 36.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317103 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358674 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388535 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404482 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0438097 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0457086 s, 22.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (10s) == sanityn test 77d: check TRR nrs policy ================ 16:36:36 (1746131796) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.228675 s, 73.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146288 s, 71.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0293342 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249495 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229228 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401489 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242419 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.093721 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0970995 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111338 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105518 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11583 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125701 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128471 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132591 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130586 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136253 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336914 s, 31.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0537705 s, 19.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0543054 s, 19.3 MB/s , 0.0613147 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0616396 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0566021 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0593712 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0571968 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0630179 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0647749 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395132 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481656 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0655404 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341013 s, 30.7 MB/s , 0.0367094 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0717189 s, 14.6 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.245859 s, 68.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506619 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325965 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294598 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0785801 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363303 s, 28.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.19136 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.201479 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.174897 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.172786 s, 6.1 MB/s 1048576 bytes (1.0 MB) copied, 0.206889 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.170547 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.218827 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.219434 s, 4.8 MB/s 1048576 bytes (1.0 MB) copied, 0.197037 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.21646 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.225742 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00183225 s, 572 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279522 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00495329 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00522703 s, 201 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416904 s, 25.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.110343 s, 9.5 MB/s , 0.0820359 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0972005 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0847245 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0055948 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0394278 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279904 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222027 s, 47.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0829018 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0838873 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0739595 s, 14.2 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.218298 s, 76.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317807 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359614 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0890076 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110421 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112286 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113513 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109842 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126609 s, 8.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.135472 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.135287 s, 7.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149271 s, 7.0 MB/s 1048576 bytes (1.0 MB) copied, 0.144014 s, 7.3 MB/s 1048576 bytes (1.0 MB) copied, 0.154043 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153012 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150527 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.170381 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00190885 s, 549 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00177065 s, 592 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481842 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.043188 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.036719 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035032 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427801 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295571 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0654308 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273482 s, 38.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241173 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225995 s, 46.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206956 s, 50.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196585 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163036 s, 64.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145998 s, 71.8 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (8s) == sanityn test 77e: check TBF NID nrs policy ============ 16:36:44 (1746131804) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.203.28@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.177296 s, 94.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02987 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395972 s, 26.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100042 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0951793 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0982444 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102509 s, 10.2 MB/s 1048576 bytes (1.0 MB) copied, 0.10413 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.116398 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125868 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128414 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134862 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137863 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145006 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144232 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152488 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154998 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0422405 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116933 s, 89.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00218953 s, 479 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0357186 s, 29.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0361596 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0538765 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.054479 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0553141 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436553 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00164307 s, 638 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385571 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313278 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426299 s, 24.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0383522 s, 27.3 MB/s , 0.0382179 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385295 s, 27.2 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.241312 s, 69.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315948 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0512728 s, 20.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0680532 s, 15.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0870667 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.087182 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0966194 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132327 s, 7.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137989 s, 7.6 MB/s 1048576 bytes (1.0 MB) copied, 0.130735 s, 8.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.140669 s, 7.5 MB/s , 0.136678 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.140347 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143528 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.158354 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154586 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.16373 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00180494 s, 581 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365582 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449017 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294808 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289267 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289762 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0616602 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0556451 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041255 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0429745 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0438899 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0433346 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0453384 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0571224 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044883 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481015 s, 21.8 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.226398 s, 74.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358026 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369676 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0688009 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0656038 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0771376 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0741939 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.07953 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0783199 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.083998 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11608 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134369 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.14663 s, 7.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.139639 s, 7.5 MB/s , 0.149478 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146038 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.176206 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192159 s, 54.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0591473 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198574 s, 52.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0622671 s, 16.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00590457 s, 178 MB/s , 0.00537296 s, 195 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0863617 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285215 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0580513 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0483902 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.087145 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0498252 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432672 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0523992 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296395 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254138 s, 41.3 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.168359 s, 99.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023183 s, 45.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271251 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186101 s, 56.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0322833 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224763 s, 46.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0700189 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0864253 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0752198 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0957398 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119702 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.095884 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130998 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147162 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150153 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131768 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169146 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237267 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015527 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00639454 s, 164 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00196771 s, 533 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228039 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369685 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0391102 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148903 s, 70.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00163331 s, 642 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245011 s, 42.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029029 s, 36.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302517 s, 34.7 MB/s , 0.0310264 s, 33.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0342138 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352811 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404697 s, 25.9 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (13s) == sanityn test 77f: check TBF JobID nrs policy ========== 16:36:57 (1746131817) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.210394 s, 79.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0378445 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0597926 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0797681 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0820997 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0556096 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15689 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15651 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.157845 s, 6.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.129365 s, 8.1 MB/s , 0.128371 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131827 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.139857 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12566 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169602 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.168899 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.170276 s, 6.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b5c14000.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff8800b5c14000.lock_unused_count=3 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17283 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.173071 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.173156 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188886 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.173002 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.183264 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.179636 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.172916 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.174603 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.174963 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169382 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.176902 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.163906 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.164703 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.181527 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.185739 s, 5.6 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.193106 s, 86.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382884 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371908 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227136 s, 46.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0822084 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0872676 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10724 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0996031 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.114787 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124957 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.116742 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130842 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144999 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128469 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.14094 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130012 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.139934 s, 7.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00416123 s, 252 MB/s , 0.00394382 s, 266 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142985 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202402 s, 51.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00153429 s, 683 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304899 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00791928 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00158266 s, 663 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0568117 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00835109 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.050063 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0513302 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0535523 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0549383 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357649 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426632 s, 24.6 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.278481 s, 60.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184869 s, 56.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0575935 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0603973 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303896 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022232 s, 47.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147591 s, 71.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324404 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.186311 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15008 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.159998 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.216223 s, 4.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.234417 s, 4.5 MB/s 1048576 bytes (1.0 MB) copied, 0.222805 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.217482 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.324431 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.34782 s, 3.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0442834 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.051757 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.051761 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.054001 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0544342 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0442187 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0584536 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427792 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0454564 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0450223 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0448351 s, 23.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0491794 s, 21.3 MB/s , 0.0493993 s, 21.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0509332 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0509799 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0630674 s, 16.6 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.233409 s, 71.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265743 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363423 s, 28.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0627951 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.061855 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0686013 s, 15.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0634326 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0643426 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0686913 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0797321 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.096486 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106056 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0993215 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111437 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1039 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107965 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125133 s, 8.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035639 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0328538 s, 31.9 MB/s 1048576 bytes (1.0 MB) copied, 0.019898 s, 52.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0337727 s, 31.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294414 s, 35.6 MB/s , 0.0295797 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0318491 s, 32.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0398908 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388487 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416871 s, 25.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0502708 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0507455 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0517197 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0527671 s, 19.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0576274 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0614797 s, 17.1 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (14s) == sanityn test 77g: Change TBF type directly ============ 16:37:11 (1746131831) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (7s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 16:37:18 (1746131838) oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg328-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg328-client: oleg328-server: ssh exited with exit code 2 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg328-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg328-client: oleg328-server: ssh exited with exit code 12 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg328-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg328-client: oleg328-server: ssh exited with exit code 12 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg328-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg328-client: oleg328-server: ssh exited with exit code 12 PASS 77h (6s) == sanityn test 77i: Change rank of TBF rule ============= 16:37:24 (1746131844) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (14s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 16:37:38 (1746131858) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.381383 s, 44.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427652 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0521166 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134216 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146951 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103046 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.14325 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100543 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146169 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1541 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125969 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141383 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148913 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.19943 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.202101 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188225 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.218671 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272328 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0555081 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0575032 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0487549 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313675 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351984 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.053175 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261735 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029212 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404934 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259862 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280013 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301683 s, 34.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0394897 s, 26.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0414604 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415449 s, 25.2 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.11099 s, 17.2 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.51 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (53s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 16:38:31 (1746131911) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg328-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg328-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg328-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg328-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.26408 s, 13.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.050895 s, 20.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0407322 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0665908 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0812417 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0841599 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0832241 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102413 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117247 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129123 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152179 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171122 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.166261 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17851 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.190471 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.217149 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.229597 s, 4.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171952 s, 61.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211784 s, 49.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185871 s, 56.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213659 s, 49.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310639 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341793 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.038112 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407815 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388148 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287919 s, 36.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0373998 s, 28.0 MB/s , 0.0384989 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432398 s, 24.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.049434 s, 21.2 MB/s , 0.0506719 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.056141 s, 18.7 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8489 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9557 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg328-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg328-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg328-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg328-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.2506 s, 13.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253462 s, 41.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0376572 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0731982 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0952666 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104175 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11806 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127948 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127915 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12619 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137373 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.208209 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.197846 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.20522 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.206558 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.22463 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.233948 s, 4.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0334051 s, 31.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341727 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279723 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0381112 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336413 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034648 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0347413 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0375204 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401854 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0435034 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418578 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506029 s, 20.7 MB/s , 0.0395362 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04364 s, 24.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0474432 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567645 s, 18.5 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8175 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9325 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (137s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 16:40:48 (1746132048) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg328-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg328-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg328-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg328-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.26436 s, 13.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395037 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0635803 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0624409 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0732936 s, 14.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.109243 s, 9.6 MB/s , 0.0973592 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118951 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115999 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106608 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117859 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.177111 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.180653 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.179019 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178058 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.180892 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.195529 s, 5.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348916 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366272 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387865 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412716 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0411339 s, 25.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418418 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449034 s, 23.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.047793 s, 21.9 MB/s , 0.0434158 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.050121 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0520033 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0510596 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0522403 s, 20.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0497024 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0525471 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0658363 s, 15.9 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.782 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.966 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg328-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg328-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg328-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg328-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.24941 s, 13.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0525284 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041282 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0770751 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0899811 s, 11.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.080023 s, 13.1 MB/s , 0.0852182 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123532 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128258 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147565 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.161773 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.1721 s, 6.1 MB/s 1048576 bytes (1.0 MB) copied, 0.172912 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.179676 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178856 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191386 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.208781 s, 5.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307473 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267663 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291633 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295113 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316704 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330695 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336213 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415718 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369956 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384964 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382803 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412429 s, 25.4 MB/s , 0.0401066 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426937 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0474416 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0549232 s, 19.1 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7794 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9374 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (139s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 16:43:07 (1746132187) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.303781 s, 55.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189141 s, 55.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217315 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0442909 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0589937 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540247 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0743467 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101243 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102486 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0730291 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101604 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.093195 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10304 s, 10.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131424 s, 8.0 MB/s 1048576 bytes (1.0 MB) copied, 0.130097 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132938 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.158943 s, 6.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00177524 s, 591 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00248403 s, 422 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00340458 s, 308 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00300228 s, 349 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00332936 s, 315 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0854238 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0762461 s, 13.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0613632 s, 17.1 MB/s , 0.0705219 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0862585 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0550732 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393658 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00634639 s, 165 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258478 s, 40.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233698 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176119 s, 59.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.41382 s, 19.4 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81155 s, 10.7 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.203.28@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.203.28@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.275275 s, 60.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252813 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175022 s, 59.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432432 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389183 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.050837 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0434266 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0681479 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0602917 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0854489 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0953746 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0924219 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112093 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102253 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11875 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128735 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11252 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362872 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361359 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361351 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0346026 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254567 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352189 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0376604 s, 27.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0398494 s, 26.3 MB/s , 0.0400173 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258923 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395875 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0456973 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276576 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301346 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252933 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243631 s, 43.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.71979 s, 18.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.811 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.203.28@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.354275 s, 47.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123678 s, 84.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329712 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350318 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0602165 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0554051 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0733456 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104175 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.114064 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.098394 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11981 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112712 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113885 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131581 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.163139 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.163448 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17588 s, 6.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368663 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0333201 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0477275 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0346787 s, 30.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0399767 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353803 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371223 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0528297 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567811 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405765 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041552 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0417973 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0411356 s, 25.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0429512 s, 24.4 MB/s , 0.0412397 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0477481 s, 22.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.61913 s, 18.7 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.93471 s, 21.2 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.497938 s, 33.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142906 s, 73.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0478245 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0569228 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.052622 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0646842 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0939796 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0926255 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0963532 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129368 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131667 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.139068 s, 7.5 MB/s , 0.138921 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.198097 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.202286 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.249932 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.263034 s, 4.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127011 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156396 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00474911 s, 221 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192064 s, 54.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00260648 s, 402 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out , 0.013258 s, 79.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233375 s, 44.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0140164 s, 74.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0093835 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160053 s, 65.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0103541 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00589493 s, 178 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162745 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205689 s, 51.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183889 s, 57.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017354 s, 60.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.94578 s, 10.5 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.7908 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.29686 s, 19.8 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.78179 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.904239 s, 18.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0397454 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0825929 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0633544 s, 16.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0915757 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102742 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0679986 s, 15.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0821387 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0725011 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143583 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.161952 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.196812 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.209492 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.186721 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.22056 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.236636 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.213895 s, 4.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170136 s, 61.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289255 s, 36.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224178 s, 46.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147979 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020202 s, 51.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239492 s, 43.8 MB/s , 0.01947 s, 53.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200928 s, 52.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252609 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219118 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288128 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205543 s, 51.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207058 s, 50.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284118 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280284 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305431 s, 34.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.6872 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.5303 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.294905 s, 56.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190033 s, 55.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0191948 s, 54.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177621 s, 59.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444534 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0406276 s, 25.8 MB/s , 0.0354299 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0828551 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0702719 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0696922 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0843429 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0790654 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0834605 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0841071 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0976739 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0835209 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0891368 s, 11.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00263197 s, 398 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00180413 s, 581 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0428942 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0490979 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368078 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00178159 s, 589 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359131 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407582 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332798 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323694 s, 32.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0273643 s, 38.3 MB/s , 0.0314668 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209742 s, 50.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302683 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251581 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00946478 s, 111 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.0309 s, 17.4 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81548 s, 10.7 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.530985 s, 31.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179274 s, 58.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041065 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0420477 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100498 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130757 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143768 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134955 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149136 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132232 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118693 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.142037 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144169 s, 7.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.172737 s, 6.1 MB/s , 0.149621 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178489 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191397 s, 5.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00391728 s, 268 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00304928 s, 344 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00185919 s, 564 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00205164 s, 511 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0969321 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108176 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0863734 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11023 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0935696 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0834632 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0587591 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.053298 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0475194 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424698 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0347246 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0782886 s, 13.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 10.1168 s, 10.4 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80194 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.94198 s, 10.5 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.79568 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (377s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 16:49:24 (1746132564) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (5s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 16:49:30 (1746132570) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg328-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 4.00909 s, 262 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg328-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0447 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (53s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 16:50:22 (1746132622) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.171789 s, 97.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00829696 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041089 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0456108 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.038799 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447214 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.090821 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0473884 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0991998 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0701459 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13005 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136171 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144535 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122092 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106156 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148075 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160857 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0019542 s, 537 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0544643 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00422812 s, 248 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.002752 s, 381 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04922 s, 21.3 MB/s , 0.0684641 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316494 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0586808 s, 17.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041303 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027662 s, 37.9 MB/s 1048576 bytes (1.0 MB) copied, 0.045791 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0521945 s, 20.1 MB/s , 0.0270822 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0731971 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242899 s, 43.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190911 s, 54.9 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.3512 s, 19.6 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97528 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.208152 s, 80.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267917 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393885 s, 26.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540636 s, 19.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0625685 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0684242 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0662024 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0708772 s, 14.8 MB/s , 0.0575079 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0733941 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0617792 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0814987 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0855017 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120741 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117769 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.177354 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178055 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234051 s, 44.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0276732 s, 37.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0187899 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265607 s, 39.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222381 s, 47.2 MB/s , 0.0218013 s, 48.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0299592 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022365 s, 46.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232738 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209847 s, 50.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249625 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229173 s, 45.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246381 s, 42.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261056 s, 40.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0258974 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260993 s, 40.2 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg328-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg328-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.95911 s, 17.6 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.99741 s, 21.0 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (77s) == sanityn test 77o: Changing rank should not panic ====== 16:51:39 (1746132699) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (7s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 16:51:46 (1746132706) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_policies=fifo PASS 77q (53s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 16:52:39 (1746132759) mds.MDS.mdt.nrs_policies=tbf oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg328-client: oleg328-server: ssh exited with exit code 36 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 oleg328-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg328-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg328-client: oleg328-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (18s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 16:52:57 (1746132777) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 20866 kill md_thread xargs PASS 77r (40s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 16:53:37 (1746132817) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_policies=fifo PASS 78 (4s) == sanityn test 79: xattr: intent error ================== 16:53:41 (1746132821) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505783 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 16:53:42.000000000 -0400 Modify: 2025-05-01 16:53:42.000000000 -0400 Change: 2025-05-01 16:53:43.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (14s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 16:53:56 (1746132836) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (2s) == sanityn test 80b: Accessing directory during migration ========================================================== 16:53:57 (1746132837) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 16:53:58 (1746132838) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (2s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 16:54:00 (1746132840) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (2s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 16:54:02 (1746132842) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 16:54:03 (1746132843) - open/close 1423 (time 1746132856.17 total 10.00 last 142.24) total: 2500 open/close in 17.51 seconds: 142.75 ops/second snapshot_time 1746132903.573103456 secs.nsecs start_time 1746132844.491759351 secs.nsecs elapsed_time 59.081344105 secs.nsecs open 2505 samples [usecs] 84 12475 1535384 1491278998 close 2504 samples [usecs] 72 3645 572477 262061825 mknod 2501 samples [usecs] 247 4147 1293284 925309900 unlink 2500 samples [usecs] 372 16216 2358617 4471375409 mkdir 2 samples [usecs] 631 872 1503 1158545 rmdir 2 samples [usecs] 7887 13547 21434 245725978 rename 2500 samples [usecs] 306 22288 7142707 37001495775 getattr 3760 samples [usecs] 5 2723 119164 32886846 parallel_rename_file 2500 samples [usecs] 306 22288 7142707 37001495775 crossdir_rename 2500 samples [usecs] 306 22288 7142707 37001495775 PASS 81d (62s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 16:55:06 (1746132906) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7024 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7024 PASS 82 (2s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 16:55:08 (1746132908) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 16:55:10 (1746132910) fail_loc=0x8000060b PASS 84 (9s) == sanityn test 85: Lustre API root cache race =========== 16:55:18 (1746132918) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1746132918 Finishing test test1 at 1746132920 PASS 85 (4s) == sanityn test 90: open/create and unlink striped directory ========================================================== 16:55:22 (1746132922) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 16:55:23 (1746132923) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 16:55:24 (1746132924) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (2s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 16:55:26 (1746132926) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5171 0x1433 0x240000400 1 5152 0x1420 0x280000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5153 0x1421 0x280000400 0 5172 0x1434 0x240000400 rc1=0 and rc2=0 PASS 93 (9s) == sanityn test 94: signal vs CP callback race =========== 16:55:35 (1746132935) osc.lustre-OST0000-osc-ffff8800b5c14000.idle_timeout=0 osc.lustre-OST0000-osc-ffff88012d012800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b5c14000.idle_timeout=0 osc.lustre-OST0001-osc-ffff88012d012800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.113027 s, 72.5 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.00738 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5764: 3774 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0397393 s, 103 kB/s osc.lustre-OST0000-osc-ffff8800b5c14000.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012d012800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c14000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012d012800.idle_timeout=debug PASS 94 (12s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 16:55:47 (1746132947) llite.lustre-ffff8800b5c14000.fast_read=0 llite.lustre-ffff88012d012800.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0190946 s, 110 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff8800b5c14000.fast_read=1 llite.lustre-ffff88012d012800.fast_read=1 PASS 95a (20s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 16:56:07 (1746132967) llite.lustre-ffff8800b5c14000.fast_read=0 llite.lustre-ffff88012d012800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00338676 s, 3.6 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800b5c14000.fast_read=1 llite.lustre-ffff88012d012800.fast_read=1 PASS 95b (9s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 16:56:16 (1746132976) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 16:56:17 (1746132977) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0033916 s, 1.2 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (3s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 16:56:21 (1746132981) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0787794 s, 26.6 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (3s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 16:56:24 (1746132984) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0366933 s, 57.2 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (4s) == sanityn test 100e: DoM: read on open and file size ==== 16:56:28 (1746132988) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00555769 s, 2.2 MB/s PASS 100e (2s) == sanityn test 101a: Discard DoM data on unlink ========= 16:56:30 (1746132990) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00103921 s, 3.9 MB/s PASS 101a (3s) == sanityn test 101b: Discard DoM data on rename ========= 16:56:33 (1746132993) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000726496 s, 5.6 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 16:56:36 (1746132996) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000886883 s, 4.6 MB/s PASS 101c (4s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 16:56:41 (1746133001) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1746133002 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1746133004 Finishing test test23 at 1746133005 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 16:56:49 (1746133009) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 16:56:50 (1746133010) fail_loc=0x416 PASS 105 (29s) == sanityn test 106a: Verify the btime via statx() ======= 16:57:19 (1746133039) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 16:57:20 (1746133040) SKIP: sanityn test_106b statx() only test SKIP 106b (2s) == sanityn test 106c: Verify statx attributes mask ======= 16:57:22 (1746133042) SKIP: sanityn test_106c statx() only test SKIP 106c (1s) == sanityn test 107a: Basic grouplock conflict =========== 16:57:23 (1746133043) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.135061 s, 77.6 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5179 0x143b 0x240000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 16:57:28 (1746133048) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.103884 s, 101 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5159 0x1427 0x280000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7024 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) == sanityn test 108a: lseek: parallel updates ============ 16:57:37 (1746133057) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00362569 s, 2.8 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.42395 s, 1.9 MB/s PASS 108a (8s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 16:57:45 (1746133065) 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 8 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 10 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 11 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 13 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg328-server: libkmod: kmod_module_get_refcnt: could not read integer from '/sys/module/intel_rapl/refcnt': 'No such device' oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 15 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 16 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 19 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 21 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 22 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 23 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 26 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_size: failed to read coresize from /sys/module/intel_rapl libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 34 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 35 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 41 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 42 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 43 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 47 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 48 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions oleg328-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 49 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 192.168.203.128@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.128@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg328-server' oleg328-server: oleg328-server.virtnet: executing load_modules_local oleg328-server: Loading modules from /home/green/git/lustre-release/lustre oleg328-server: detected 4 online CPUs by sysfs oleg328-server: MODOPTS_LIBCFS= oleg328-server: Force libcfs to create 2 CPU partitions Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre Starting client: oleg328-client.virtnet: -o user_xattr,flock 192.168.203.128@tcp:/lustre /mnt/lustre2 PASS 109 (576s) == sanityn test 110: do not grant another lock on resend ========================================================== 17:07:21 (1746133641) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 17:07:22.000000000 -0400 Modify: 2025-05-01 17:07:22.000000000 -0400 Change: 2025-05-01 17:07:22.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg328-client.virtnet oleg328-client.virtnet PASS 110 (66s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 17:08:27 (1746133707) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (2s) == sanityn test 112: update max-inherit in default LMV === 17:08:29 (1746133709) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (2s) == sanityn test 113: check servers of specified fs ======= 17:08:31 (1746133711) lustre-OST0000-osc-ffff88012a486000 active. lustre-OST0001-osc-ffff88012a486000 active. lustre-OST0000-osc-ffff88012a486000 active. lustre-OST0001-osc-ffff88012a486000 active. MGC192.168.203.128@tcp active. PASS 113 (4s) == sanityn test 114: implicit default LMV inherit ======== 17:08:35 (1746133715) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (1s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 17:08:36 (1746133716) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (2s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 17:08:38 (1746133718) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (1s) == sanityn test 200: service remains healthy while able to process request ========================================================== 17:08:39 (1746133719) at_max=10 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=20 fail_loc=0x1e1 fail_val=20 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0782 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0948 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1045 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1209 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1276 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1034 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.115 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0946 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0893 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1108 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1462 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1293 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1522 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2039 s, 0.1 kB/s , 40.1751 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1884 s, 0.1 kB/s , 40.1992 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1206 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.1783 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.1713 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2929 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied1+0 records in 1+0 records out , 60.251 s, 0.1 kB/s , 60.2904 s, 0.1 kB/s 4096 bytes (4.1 kB) copied, 60.2563 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3014 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2315 s, 0.1 kB/s , 60.2434 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.2326 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.285 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3568 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3185 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3227 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3346 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3148 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3938 s, 0.1 kB/s , 80.3695 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.409 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.526 s, 0.0 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 100.51 s, 0.0 kB/s , 100.532 s, 0.0 kB/s at_max=600 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=116 oleg328-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6318000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b6318000.ost_server_uuid in IDLE state after 0 sec PASS 200 (111s) cleanup: ====================================================== == sanityn test complete, duration 6116 sec ============== 17:10:31 (1746133831) sanityn: FAIL: test_16j dio copy 1 w/bsize 1049600 failed: 1 === sanityn: start cleanup 17:10:32 (1746133832) === Stopping clients: oleg328-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg328-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 17:12:41 (1746133961) ===