-----============= acceptance-small: sanityn ============----- Tue Jun 3 16:58:48 EDT 2025 oleg253-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Started clients oleg253-client.virtnet: 192.168.202.153@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt) oleg253-client.virtnet: executing check_config_client /mnt/lustre oleg253-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg253-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b58e3000.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012a4d1800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b58e3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a4d1800.idle_timeout=debug disable quota as required oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018026 s, 58.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6850] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 16:58:59 (1748984339) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 16:59:01 (1748984341) -rw-r--r-- 1 root root 0 Jun 3 16:59 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 16:59:03 (1748984343) -rw-r--r-- 1 root root 0 Jun 3 16:59 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 16:59:05 (1748984345) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 16:59:07 (1748984347) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 16:59:09 (1748984349) total 1 -rwxrwxrwx 1 root root 0 Jun 3 16:59 f2a -rwxrwxrwx 1 root root 0 Jun 3 16:59 f2b total 1 -rwxrwxrwx 1 root root 0 Jun 3 16:59 f2a -rwxrwxrwx 1 root root 0 Jun 3 16:59 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00394534 s, 130 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 16:59:11 (1748984351) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 16:59:12 (1748984352) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0805823 s, 26.0 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (2s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 16:59:14 (1748984354) PASS 3 (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 16:59:16 (1748984356) PASS 4 (3s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 16:59:19 (1748984359) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 16:59:21 (1748984361) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (2s) == sanityn test 7: remove of open directory on other node ======================================================================= 16:59:23 (1748984363) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 16:59:25 (1748984365) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 16:59:27 (1748984367) PASS 9a (2s) == sanityn test 9b: append to striped sparse file ======== 16:59:29 (1748984369) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014536 s, 72.1 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0141895 s, 0.2 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 16:59:31 (1748984371) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00179897 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00256343 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0019775 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00251043 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0023149 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00248967 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00255437 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00259367 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00247404 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00226192 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00264193 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00240071 s, 0.4 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 16:59:33 (1748984373) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00444001 s, 692 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0108353 s, 378 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000333563 s, 9.2 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 16:59:35 (1748984375) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (2s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 16:59:37 (1748984377) warning: '-runtime' deprecated, use '-t runtime' instead - link 2740 (time 1748984388.63 total 10.00 last 273.99) - link 5136 (time 1748984398.63 total 20.00 last 239.59) - link 7303 (time 1748984408.63 total 30.00 last 216.63) - link 9066 (time 1748984418.63 total 40.00 last 176.29) - link 10000 (time 1748984422.88 total 44.26 last 219.60) - link 12706 (time 1748984432.89 total 54.26 last 270.49) - link 14779 (time 1748984442.89 total 64.26 last 207.26) - link 16326 (time 1748984452.89 total 74.26 last 154.69) - link 17803 (time 1748984462.90 total 84.27 last 147.59) - link 19352 (time 1748984472.90 total 94.28 last 154.85) - link 20000 (time 1748984476.98 total 98.35 last 159.00) total: 20234 link in 100.00 seconds: 202.34 ops/second using seed 623992854 running for 100 seconds - stat 10000 (time 1748984383 ; total 4 ; last 4) - stat 20000 (time 1748984385 ; total 6 ; last 2) - stat 30000 (time 1748984388 ; total 9 ; last 3) - stat 40000 (time 1748984390 ; total 11 ; last 2) - stat 50000 (time 1748984393 ; total 14 ; last 3) - stat 60000 (time 1748984395 ; total 16 ; last 2) - stat 70000 (time 1748984398 ; total 19 ; last 3) - stat 80000 (time 1748984401 ; total 22 ; last 3) - stat 90000 (time 1748984404 ; total 25 ; last 3) - stat 100000 (time 1748984408 ; total 29 ; last 4) - stat 110000 (time 1748984412 ; total 33 ; last 4) - stat 120000 (time 1748984416 ; total 37 ; last 4) - stat 130000 (time 1748984418 ; total 39 ; last 2) - stat 140000 (time 1748984421 ; total 42 ; last 3) - stat 150000 (time 1748984424 ; total 45 ; last 3) - stat 160000 (time 1748984427 ; total 48 ; last 3) - stat 170000 (time 1748984429 ; total 50 ; last 2) - stat 180000 (time 1748984436 ; total 57 ; last 7) - stat 189977 (time 1748984447 ; total 68 ; last 11) - stat 190000 (time 1748984447 ; total 68 ; last 0) - stat 199818 (time 1748984458 ; total 79 ; last 11) - stat 200000 (time 1748984458 ; total 79 ; last 0) - stat 210000 (time 1748984467 ; total 88 ; last 9) - stat 220000 (time 1748984477 ; total 98 ; last 10) total: 221334 stats in 100 seconds: 2213.340088 stats/second - unlinked 0 (time 1748984429 ; total 0 ; last 0) - unlinked 10000 (time 1748984500 ; total 71 ; last 71) - unlinked 20000 (time 1748984546 ; total 117 ; last 46) unlink(/mnt/lustre2/lockdir/lockfile20234) error: No such file or directory total: 20233 unlinks in 118 seconds: 171.466095 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (20548) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (20550) - No such process PASS 12 (172s) == sanityn test 13: test directory page revocation ======= 17:02:29 (1748984549) f13 f13 PASS 13 (3s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 17:02:32 (1748984552) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4298: 21951 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 17:02:34 (1748984554) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4298: 22579 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 17:02:36 (1748984556) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 23206 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 17:02:38 (1748984558) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 23835 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 17:02:40 (1748984560) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 24464 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 17:02:43 (1748984563) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7525376 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7525376kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (12s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 17:02:55 (1748984575) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.119549 s, 17.5 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0903917 s, 23.2 MB/s Chance of close/open is 1 in 50 Seed set to 4576 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x5c985e 000002[0] 1748984576.912677 trunc from 00000000 to 0x5c985d (0x5c985e bytes) 000003[1] 1748984576.923118 read 0x4d2dbb thru 0x4d7818 (0x4a5e bytes) 000004[1] 1748984576.940727 write 0x5f774c thru 0x600f3a (0x97ef bytes) 000005[0] 1748984576.957215 trunc from 0x600f3b to 0x0c2962 (0x53e5d8 bytes) 000006[1] 1748984576.980308 read 0x0421b4 thru 0x04dfde (0xbe2b bytes) 000007[0] 1748984577.005315 mapwrite 0x850686 thru 0x8605a8 (0xff23 bytes) 000008[0] 1748984577.074607 mapwrite 0x173f8b thru 0x17a148 (0x61be bytes) 000010[1] 1748984577.117338 read 0x57f6d6 thru 0x57fcc5 (0x5f0 bytes) 000011[0] 1748984577.134146 write 0x48a976 thru 0x48dfef (0x367a bytes) 000013[0] 1748984577.154483 mapwrite 0x89aa75 thru 0x8a9a4a (0xefd6 bytes) 000014[1] 1748984577.215839 mapread 0x04f8a2 thru 0x05b17a (0xb8d9 bytes) 000016[0] 1748984577.275184 read 0x70a651 thru 0x7166db (0xc08b bytes) 000017[1] 1748984577.287916 mapwrite 0x1c708e thru 0x1c91cd (0x2140 bytes) 000019[0] 1748984577.350891 mapread 0x101161 thru 0x107b4c (0x69ec bytes) 000023[1] 1748984577.372344 write 0x2d8c36 thru 0x2e5319 (0xc6e4 bytes) 000024[0] 1748984577.384428 write 0x1efa52 thru 0x1fd03d (0xd5ec bytes) 000025[1] 1748984577.403291 write 0x47ff0e thru 0x4812da (0x13cd bytes) 000026[1] 1748984577.416269 write 0x856f6f thru 0x85ae2a (0x3ebc bytes) 000027[1] 1748984577.429142 mapread 0x19f483 thru 0x1a2a83 (0x3601 bytes) truncating to largest ever: 0x8acd62 000028[0] 1748984577.450643 trunc from 0x8a9a4b to 0x8acd61 (0x3317 bytes) 000030[0] 1748984577.471395 read 0x41bc91 thru 0x41f1db (0x354b bytes) 000032[0] 1748984577.504222 mapwrite 0x081cec thru 0x08e570 (0xc885 bytes) 000034[0] 1748984577.578915 read 0x5a5895 thru 0x5aac43 (0x53af bytes) 000035[0] 1748984577.579473 write 0x98c3ac thru 0x990ccc (0x4921 bytes) 000036[1] 1748984577.580520 read 0x332bdd thru 0x33944d (0x6871 bytes) 000041[0] 1748984577.630528 read 0x554a6f thru 0x563200 (0xe792 bytes) 000044[0] 1748984577.667547 read 0x291eee thru 0x29f047 (0xd15a bytes) 000046[1] 1748984577.690868 mapwrite 0x7e6284 thru 0x7eb30d (0x508a bytes) 000047[1] 1748984577.747812 write 0x9cb874 thru 0x9d3f81 (0x870e bytes) 000049[1] 1748984577.764548 read 0x9553cb thru 0x956676 (0x12ac bytes) 000051[0] 1748984577.788340 read 0x129bcc thru 0x129eaa (0x2df bytes) 000052[0] 1748984577.838276 write 0x9276c5 thru 0x934351 (0xcc8d bytes) 000053[0] 1748984577.862082 trunc from 0x9d3f82 to 0x5923dc (0x441ba5 bytes) 000054[0] 1748984577.874745 trunc from 0x5923dd to 0x7a915c (0x216d80 bytes) 000055[0] 1748984577.882236 mapwrite 0x17235f thru 0x17c1ec (0x9e8e bytes) 000057[0] 1748984577.943197 write 0x0517b4 thru 0x056d5b (0x55a8 bytes) 000058[0] 1748984577.955328 write 0x33ceb4 thru 0x33d256 (0x3a3 bytes) 000059[0] 1748984577.960670 trunc from 0x7a915d to 0x5d173d (0x1d7a1f bytes) 000061[0] 1748984577.979086 mapwrite 0x17a8a9 thru 0x185186 (0xa8de bytes) 000062[0] 1748984578.030279 mapwrite 0x1e6521 thru 0x1ec754 (0x6234 bytes) 000064[0] 1748984578.075974 write 0x64dc0f thru 0x651a2f (0x3e21 bytes) 000067[0] 1748984578.099428 trunc from 0x651a30 to 0x534af6 (0x11cf39 bytes) 000070[1] 1748984578.117544 mapread 0x3fe603 thru 0x407fae (0x99ac bytes) 000072[1] 1748984578.161728 write 0x8b11fa thru 0x8b4af9 (0x3900 bytes) 000073[0] 1748984578.174591 read 0x00605c thru 0x013667 (0xd60c bytes) 000074[1] 1748984578.230533 trunc from 0x8b4afa to 0x1e3754 (0x6d13a5 bytes) 000075[1] 1748984578.259842 mapwrite 0x72f956 thru 0x737dcf (0x847a bytes) 000076[0] 1748984578.320495 read 0x228861 thru 0x22de6d (0x560d bytes) 000077[1] 1748984578.342687 mapread 0x356434 thru 0x36402f (0xdbfc bytes) 000078[0] 1748984578.378392 read 0x46fe14 thru 0x477cc0 (0x7ead bytes) 000079[1] 1748984578.388443 trunc from 0x737dd0 to 0x5ec096 (0x14bd39 bytes) 000082[0] 1748984578.420658 write 0x8d34b4 thru 0x8dba09 (0x8556 bytes) 000083[1] 1748984578.433639 mapwrite 0x952dce thru 0x95fd42 (0xcf75 bytes) 000084[0] 1748984578.508604 mapread 0x470ae7 thru 0x478501 (0x7a1b bytes) 000085[1] 1748984578.539423 read 0x4290b4 thru 0x42de47 (0x4d94 bytes) 000087[1] 1748984578.588112 mapwrite 0x97cf6d thru 0x98bc59 (0xeced bytes) 000089[0] 1748984578.635157 trunc from 0x98bc5a to 0x6ae6c5 (0x2dd594 bytes) 000091[1] 1748984578.657158 trunc from 0x6ae6c6 to 0x5f52fa (0xb93cb bytes) 000092[1] 1748984578.673674 read 0x58c7de thru 0x58ddf8 (0x161b bytes) 000094[0] 1748984578.692832 mapwrite 0x2b90dd thru 0x2bf6da (0x65fe bytes) 000095[0] 1748984578.750603 read 0x2cf7a8 thru 0x2d9c3e (0xa497 bytes) 000096[1] 1748984578.763972 mapwrite 0x290d82 thru 0x29e90f (0xdb8e bytes) 000097[0] 1748984578.831080 mapread 0x0c38b3 thru 0x0d2589 (0xecd7 bytes) 000100[0] 1748984578.878257 trunc from 0x5f52fb to 0x15e4e5 (0x496e15 bytes) 000101[1] 1748984578.903330 read 0x081506 thru 0x08d5e9 (0xc0e4 bytes) 000102[0] 1748984578.920815 write 0x2157c0 thru 0x2191d9 (0x3a1a bytes) 000103[1] 1748984578.927243 read 0x07fbfd thru 0x08e1b6 (0xe5ba bytes) 000104[0] 1748984578.946702 mapread 0x1615a2 thru 0x1679ec (0x644b bytes) 000105[0] 1748984578.971139 mapwrite 0x7fc4b7 thru 0x7fd409 (0xf53 bytes) 000106[1] 1748984579.050684 write 0x8cb8d6 thru 0x8d8f9d (0xd6c8 bytes) 000108[1] 1748984579.077348 write 0x53aa09 thru 0x53eef4 (0x44ec bytes) 000109[0] 1748984579.139554 mapread 0x732875 thru 0x73f7cb (0xcf57 bytes) 000110[0] 1748984579.192510 read 0x4b1375 thru 0x4bc8c7 (0xb553 bytes) 000111[0] 1748984579.241906 mapread 0x31d3df thru 0x325b59 (0x877b bytes) 000112[1] 1748984579.264157 mapwrite 0x4d8349 thru 0x4e6f04 (0xebbc bytes) 000113[1] 1748984579.341494 write 0x65fe92 thru 0x667344 (0x74b3 bytes) 000114[0] 1748984579.346631 mapread 0x2ec189 thru 0x2f553b (0x93b3 bytes) 000117[0] 1748984579.383616 write 0x9637f3 thru 0x96587e (0x208c bytes) 000120[1] 1748984579.414722 read 0x55f9e2 thru 0x567e7c (0x849b bytes) 000121[1] 1748984579.452396 mapwrite 0x1e8277 thru 0x1ed7a3 (0x552d bytes) 000123[1] 1748984579.503367 read 0x2facc4 thru 0x3076e9 (0xca26 bytes) 000127[1] 1748984579.546951 read 0x7eaa16 thru 0x7f53a0 (0xa98b bytes) 000130[1] 1748984579.556212 read 0x68c3bf thru 0x6914b0 (0x50f2 bytes) 000132[1] 1748984579.556918 mapwrite 0x8597da thru 0x85a247 (0xa6e bytes) 000134[0] 1748984579.609892 write 0x5fe73b thru 0x60ceea (0xe7b0 bytes) 000137[0] 1748984579.641577 trunc from 0x96587f to 0x80e47d (0x157401 bytes) 000138[1] 1748984579.658611 mapwrite 0x33aa6f thru 0x34a223 (0xf7b5 bytes) 000139[0] 1748984579.741306 mapwrite 0x7223bb thru 0x726493 (0x40d9 bytes) 000145[1] 1748984579.786897 mapread 0x5e35ac thru 0x5eea72 (0xb4c7 bytes) 000150[0] 1748984579.857466 read 0x524182 thru 0x52e379 (0xa1f8 bytes) 000151[1] 1748984579.888828 trunc from 0x80e47e to 0x5c7126 (0x247357 bytes) 000154[0] 1748984579.924688 mapread 0x557835 thru 0x55c922 (0x50ee bytes) 000155[1] 1748984579.954369 read 0x13eab9 thru 0x145022 (0x656a bytes) 000156[1] 1748984579.986843 mapread 0x3871ae thru 0x3942d8 (0xd12b bytes) 000157[1] 1748984579.987606 write 0x415ba4 thru 0x4250e0 (0xf53d bytes) 000158[1] 1748984579.996334 read 0x2a57d2 thru 0x2aac23 (0x5452 bytes) 000160[0] 1748984579.997211 read 0x2437a6 thru 0x249fa4 (0x67ff bytes) 000161[0] 1748984580.035835 read 0x08cc72 thru 0x097054 (0xa3e3 bytes) 000162[1] 1748984580.050432 mapread 0x1076a1 thru 0x11713c (0xfa9c bytes) 000165[0] 1748984580.089552 mapwrite 0x025144 thru 0x02898f (0x384c bytes) 000169[0] 1748984580.153383 read 0x3a9222 thru 0x3b304d (0x9e2c bytes) 000170[0] 1748984580.153795 mapwrite 0x41e8aa thru 0x421a09 (0x3160 bytes) 000171[1] 1748984580.187452 trunc from 0x5c7127 to 0x4575f7 (0x16fb2f bytes) 000173[1] 1748984580.219730 write 0x8a983a thru 0x8ac5b3 (0x2d7a bytes) 000174[0] 1748984580.228886 read 0x0584fa thru 0x05dcb7 (0x57be bytes) 000176[0] 1748984580.249575 write 0x52309b thru 0x529704 (0x666a bytes) 000179[0] 1748984580.302755 write 0x31980c thru 0x323284 (0x9a79 bytes) 000180[1] 1748984580.303844 trunc from 0x8ac5b4 to 0x3ee1cd (0x4be3e6 bytes) 000184[0] 1748984580.347177 mapwrite 0x7694f5 thru 0x7697ce (0x2da bytes) 000185[1] 1748984580.388788 write 0x44d6a6 thru 0x456ab2 (0x940d bytes) 000187[0] 1748984580.414314 write 0x980163 thru 0x98611e (0x5fbc bytes) 000188[0] 1748984580.423464 read 0x37e105 thru 0x3807d4 (0x26d0 bytes) 000192[1] 1748984580.464350 trunc from 0x98611f to 0x3a67eb (0x5df933 bytes) 000194[0] 1748984580.482132 read 0x29d59c thru 0x2a3c5f (0x66c4 bytes) 000195[1] 1748984580.504858 write 0x28a055 thru 0x28c9af (0x295b bytes) 000197[1] 1748984580.521757 trunc from 0x3a67ec to 0x810755 (0x469f6a bytes) 000198[0] 1748984580.531659 write 0x962df2 thru 0x9670fc (0x430b bytes) 000201[1] 1748984580.561512 trunc from 0x9670fd to 0x521f41 (0x4451bb bytes) truncating to largest ever: 0x92aa83 000202[0] 1748984580.577809 trunc from 0x521f42 to 0x92aa82 (0x408b41 bytes) 000205[1] 1748984580.606317 write 0x85e324 thru 0x863426 (0x5103 bytes) 000207[0] 1748984580.630916 trunc from 0x92aa83 to 0x6f50c5 (0x2359bd bytes) 000208[1] 1748984580.654193 trunc from 0x6f50c6 to 0x1b6f74 (0x53e151 bytes) 000211[1] 1748984580.689629 mapread 0x10270f thru 0x10cea4 (0xa796 bytes) 000212[0] 1748984580.717735 trunc from 0x1b6f75 to 0x1d1d9a (0x1ae26 bytes) 000213[1] 1748984580.733901 mapread 0x14ae06 thru 0x14d0dd (0x22d8 bytes) 000215[1] 1748984580.761398 trunc from 0x1d1d9b to 0x0dc5ce (0xf57cc bytes) 000216[1] 1748984580.776756 trunc from 0x0dc5cf to 0x83eb19 (0x76254b bytes) 000219[0] 1748984580.807133 trunc from 0x83eb1a to 0x2cfcad (0x56ee6c bytes) 000221[1] 1748984580.831582 mapwrite 0x05b431 thru 0x069a56 (0xe626 bytes) 000224[1] 1748984580.919689 trunc from 0x2cfcae to 0x3fe0eb (0x12e43e bytes) 000225[1] 1748984580.932639 mapwrite 0x44fe5a thru 0x45e24d (0xe3f4 bytes) 000228[0] 1748984581.012816 write 0x6e90f8 thru 0x6f7a5f (0xe968 bytes) 000232[0] 1748984581.051342 read 0x4772dc thru 0x47e4dd (0x7202 bytes) 000235[1] 1748984581.082683 write 0x222bfe thru 0x22fc45 (0xd048 bytes) 000236[0] 1748984581.105243 read 0x268a12 thru 0x269aba (0x10a9 bytes) 000239[1] 1748984581.147574 mapwrite 0x65aa0d thru 0x66a80c (0xfe00 bytes) 000241[1] 1748984581.222184 write 0x58f318 thru 0x5961c8 (0x6eb1 bytes) 000244[1] 1748984581.242721 mapwrite 0x5592b1 thru 0x55f2a5 (0x5ff5 bytes) 000245[0] 1748984581.289785 mapread 0x5a1045 thru 0x5a5721 (0x46dd bytes) 000247[1] 1748984581.356389 read 0x622104 thru 0x62c439 (0xa336 bytes) 000251[0] 1748984581.386898 mapwrite 0x8bedca thru 0x8c97c0 (0xa9f7 bytes) 000252[1] 1748984581.463678 mapread 0x3a2dcf thru 0x3b1af1 (0xed23 bytes) 000253[0] 1748984581.521848 mapread 0x314b8b thru 0x31e5bb (0x9a31 bytes) 000255[0] 1748984581.558609 read 0x4fd3d3 thru 0x508590 (0xb1be bytes) 000257[0] 1748984581.579900 mapread 0x3f00e1 thru 0x3fb77c (0xb69c bytes) 000258[1] 1748984581.608394 trunc from 0x8c97c1 to 0x76d0e5 (0x15c6db bytes) 000259[1] 1748984581.633298 mapwrite 0x1f01cf thru 0x1f30fc (0x2f2e bytes) 000263[1] 1748984581.694207 mapread 0x2866e4 thru 0x28870b (0x2028 bytes) 000264[1] 1748984581.701670 mapread 0x6cf5c3 thru 0x6d9018 (0x9a56 bytes) 000266[1] 1748984581.725802 write 0x67272c thru 0x67f8ef (0xd1c4 bytes) 000267[0] 1748984581.731148 mapread 0x71aeea thru 0x721829 (0x6940 bytes) 000271[1] 1748984581.785091 write 0x6ff123 thru 0x706017 (0x6ef5 bytes) 000272[0] 1748984581.791909 write 0x2e2488 thru 0x2ef591 (0xd10a bytes) truncating to largest ever: 0x963762 000273[1] 1748984581.811904 trunc from 0x76d0e6 to 0x963761 (0x1f667c bytes) 000274[0] 1748984581.828853 read 0x3ab4f8 thru 0x3b1045 (0x5b4e bytes) 000275[1] 1748984581.846558 mapread 0x649b4c thru 0x64e6d6 (0x4b8b bytes) 000277[0] 1748984581.883716 trunc from 0x963762 to 0x63daf6 (0x325c6b bytes) 000278[1] 1748984581.902438 mapread 0x26c7e7 thru 0x2741ab (0x79c5 bytes) 000286[0] 1748984581.945688 mapread 0x5b3399 thru 0x5b3aec (0x754 bytes) 000289[0] 1748984581.979298 read 0x555d93 thru 0x558414 (0x2682 bytes) truncating to largest ever: 0x9b81e5 000290[0] 1748984581.987606 trunc from 0x63daf7 to 0x9b81e4 (0x37a6ee bytes) 000291[1] 1748984582.011661 write 0x469de6 thru 0x478788 (0xe9a3 bytes) 000294[1] 1748984582.046275 write 0x2de846 thru 0x2e2d3e (0x44f9 bytes) 000295[1] 1748984582.058106 read 0x2edcd8 thru 0x2f5eb4 (0x81dd bytes) 000297[0] 1748984582.077975 mapread 0x53f545 thru 0x544307 (0x4dc3 bytes) 000300[1] 1748984582.105957 mapwrite 0x6521aa thru 0x654626 (0x247d bytes) 000303[0] 1748984582.167055 mapwrite 0x5d7c59 thru 0x5e3fcc (0xc374 bytes) 000304[0] 1748984582.205361 mapread 0x4c109d thru 0x4c1822 (0x786 bytes) 000310[1] 1748984582.247907 mapwrite 0x0455e2 thru 0x046613 (0x1032 bytes) 000311[1] 1748984582.290388 trunc from 0x9b81e5 to 0x8b83ff (0xffde5 bytes) 000313[1] 1748984582.313768 mapwrite 0x8880ab thru 0x88bb06 (0x3a5c bytes) 000316[0] 1748984582.385916 mapread 0x2cc789 thru 0x2d941a (0xcc92 bytes) 000317[1] 1748984582.434941 mapread 0x3751a0 thru 0x37ae37 (0x5c98 bytes) 000318[0] 1748984582.437582 write 0x1981e2 thru 0x19d2f1 (0x5110 bytes) 000321[0] 1748984582.466356 read 0x5bc045 thru 0x5c5153 (0x910f bytes) 000322[0] 1748984582.488744 read 0x686887 thru 0x69540c (0xeb86 bytes) 000326[1] 1748984582.512890 trunc from 0x8b8400 to 0x69a925 (0x21dada bytes) 000327[0] 1748984582.538343 mapread 0x62ab2f thru 0x62df94 (0x3466 bytes) 000329[0] 1748984582.567513 trunc from 0x69a926 to 0x8e5b6e (0x24b249 bytes) 000331[0] 1748984582.598436 mapwrite 0x571c07 thru 0x579b73 (0x7f6d bytes) 000332[1] 1748984582.647783 write 0x0064e1 thru 0x00aa42 (0x4562 bytes) 000334[0] 1748984582.674575 read 0x831831 thru 0x83b6d5 (0x9ea5 bytes) 000337[0] 1748984582.722095 mapread 0x18adab thru 0x1911c9 (0x641f bytes) 000342[1] 1748984582.757424 read 0x80bd36 thru 0x813e64 (0x812f bytes) 000343[0] 1748984582.778450 mapread 0x6fdf14 thru 0x70656f (0x865c bytes) 000346[1] 1748984582.818422 read 0x4e718d thru 0x4f4012 (0xce86 bytes) 000347[1] 1748984582.831395 write 0x0556cf thru 0x0623e9 (0xcd1b bytes) 000348[1] 1748984582.850251 mapwrite 0x72e1c1 thru 0x738c8d (0xaacd bytes) 000349[0] 1748984582.921014 mapread 0x419316 thru 0x427143 (0xde2e bytes) 000351[1] 1748984582.985922 read 0x1bd08b thru 0x1bf5aa (0x2520 bytes) 000356[1] 1748984583.011366 trunc from 0x8e5b6f to 0x8c5317 (0x20857 bytes) 000358[1] 1748984583.039726 mapwrite 0x2fd2a7 thru 0x2fdae1 (0x83b bytes) 000359[0] 1748984583.098500 read 0x42b56d thru 0x42e12b (0x2bbf bytes) 000361[1] 1748984583.122825 write 0x7bcce8 thru 0x7c3d14 (0x702d bytes) 000363[0] 1748984583.131467 read 0x8afb13 thru 0x8bc02e (0xc51c bytes) 000367[1] 1748984583.145543 write 0x5f539a thru 0x5f6d3c (0x19a3 bytes) 000369[0] 1748984583.162133 write 0x8c0d3f thru 0x8c1dbc (0x107e bytes) 000372[0] 1748984583.206779 trunc from 0x8c5318 to 0x47d7b5 (0x447b62 bytes) 000373[0] 1748984583.237757 read 0x3ee723 thru 0x3f6c26 (0x8504 bytes) 000379[0] 1748984583.275758 read 0x45cb8e thru 0x465130 (0x85a3 bytes) 000381[1] 1748984583.296800 write 0x7e9936 thru 0x7ea0c2 (0x78d bytes) 000383[1] 1748984583.317788 trunc from 0x7ea0c3 to 0x11555a (0x6d4b68 bytes) 000384[1] 1748984583.337762 mapread 0x0dca87 thru 0x0dedf8 (0x2372 bytes) 000385[0] 1748984583.353255 write 0x747be5 thru 0x7561eb (0xe607 bytes) 000386[1] 1748984583.367434 trunc from 0x7561ec to 0x990849 (0x23a65e bytes) 000390[1] 1748984583.403123 mapwrite 0x3076bb thru 0x30f699 (0x7fdf bytes) 000391[1] 1748984583.455638 read 0x8f8768 thru 0x9001c7 (0x7a60 bytes) 000393[1] 1748984583.464209 read 0x03e946 thru 0x044868 (0x5f23 bytes) 000394[1] 1748984583.514462 mapwrite 0x686594 thru 0x694b97 (0xe604 bytes) 000395[0] 1748984583.548834 write 0x202ef0 thru 0x20b7f2 (0x8903 bytes) 000396[1] 1748984583.581213 write 0x6a73c4 thru 0x6ae42a (0x7067 bytes) 000399[1] 1748984583.617838 mapwrite 0x38e735 thru 0x39152c (0x2df8 bytes) 000401[0] 1748984583.646566 write 0x97a0f5 thru 0x984720 (0xa62c bytes) 000404[0] 1748984583.698413 trunc from 0x99084a to 0x68c1ac (0x30469d bytes) 000405[0] 1748984583.715611 read 0x3fca4c thru 0x405cb2 (0x9267 bytes) 000407[1] 1748984583.751128 trunc from 0x68c1ad to 0x15e2d5 (0x52ded7 bytes) 000410[1] 1748984583.781294 read 0x02a7dc thru 0x030f76 (0x679b bytes) 000412[0] 1748984583.802631 read 0x043cbe thru 0x0517a8 (0xdaeb bytes) 000416[0] 1748984583.837503 trunc from 0x15e2d6 to 0x0e39d7 (0x7a8fe bytes) 000419[1] 1748984583.856491 mapwrite 0x579f6b thru 0x580544 (0x65da bytes) 000420[1] 1748984583.933719 trunc from 0x580545 to 0x7a3717 (0x2231d3 bytes) 000421[1] 1748984583.942865 read 0x33598d thru 0x33b5a2 (0x5c16 bytes) 000422[1] 1748984583.953414 read 0x32383c thru 0x32f842 (0xc007 bytes) 000423[0] 1748984583.953888 mapread 0x00646c thru 0x01592f (0xf4c4 bytes) 000424[0] 1748984584.005901 write 0x0eea06 thru 0x0f7fa2 (0x959d bytes) 000425[1] 1748984584.021551 trunc from 0x7a3718 to 0x4df12e (0x2c45e9 bytes) 000428[0] 1748984584.050687 write 0x1b46c1 thru 0x1c350c (0xee4c bytes) 000429[1] 1748984584.080691 write 0x59138f thru 0x5920ae (0xd20 bytes) 000430[1] 1748984584.098556 write 0x3de2d9 thru 0x3e9e56 (0xbb7e bytes) 000433[0] 1748984584.128293 mapwrite 0x4088c5 thru 0x412535 (0x9c71 bytes) 000436[0] 1748984584.228611 read 0x4834d5 thru 0x48d72d (0xa259 bytes) 000439[1] 1748984584.258646 write 0x6c61fd thru 0x6c74e4 (0x12e8 bytes) 000441[0] 1748984584.273259 read 0x333d09 thru 0x3407f2 (0xcaea bytes) 000442[0] 1748984584.303283 write 0x5f9a54 thru 0x5fd973 (0x3f20 bytes) 000443[1] 1748984584.316807 write 0x1caf24 thru 0x1d6e4b (0xbf28 bytes) 000445[1] 1748984584.338556 write 0x8f3868 thru 0x8febd5 (0xb36e bytes) 000446[1] 1748984584.341014 mapwrite 0x2a740b thru 0x2b54ec (0xe0e2 bytes) 000447[0] 1748984584.418564 mapread 0x8c1d77 thru 0x8c9adb (0x7d65 bytes) 000450[0] 1748984584.473495 write 0x61c09c thru 0x620326 (0x428b bytes) 000451[1] 1748984584.491081 write 0x5a5811 thru 0x5ad605 (0x7df5 bytes) 000453[1] 1748984584.507201 trunc from 0x8febd6 to 0x1ee4e5 (0x7106f0 bytes) 000455[1] 1748984584.542113 mapread 0x0cca50 thru 0x0d6508 (0x9ab9 bytes) 000456[1] 1748984584.570665 trunc from 0x1ee4e6 to 0x7d0d0d (0x5e2828 bytes) 000460[1] 1748984584.598788 trunc from 0x7d0d0e to 0x886975 (0xb5c68 bytes) 000461[1] 1748984584.615713 mapread 0x46c6f4 thru 0x46c7d5 (0xe2 bytes) 000464[0] 1748984584.621458 mapread 0x858ef8 thru 0x8664a3 (0xd5ac bytes) 000469[0] 1748984584.688514 mapread 0x06599c thru 0x06d42b (0x7a90 bytes) truncating to largest ever: 0x9f35c3 000470[1] 1748984584.720407 trunc from 0x886976 to 0x9f35c2 (0x16cc4d bytes) 000471[1] 1748984584.733425 trunc from 0x9f35c3 to 0x0e65dc (0x90cfe6 bytes) 000472[1] 1748984584.740510 mapwrite 0x66d8eb thru 0x66f919 (0x202f bytes) 000474[0] 1748984584.777682 read 0x21bbe6 thru 0x22680a (0xac25 bytes) 000477[1] 1748984584.808420 read 0x2d0946 thru 0x2d490b (0x3fc6 bytes) 000478[0] 1748984584.833503 trunc from 0x66f91a to 0x4859b9 (0x1e9f60 bytes) 000481[0] 1748984584.864873 read 0x0b6606 thru 0x0bebf1 (0x85ec bytes) 000482[0] 1748984584.895999 trunc from 0x4859ba to 0x2af65f (0x1d635a bytes) 000483[0] 1748984584.908485 trunc from 0x2af660 to 0x170c85 (0x13e9da bytes) 000485[0] 1748984584.932348 read 0x0a287d thru 0x0a53cd (0x2b51 bytes) 000486[0] 1748984584.943701 trunc from 0x170c86 to 0x61ca0f (0x4abd8a bytes) 000487[0] 1748984584.957829 mapwrite 0x40a5b2 thru 0x4117f6 (0x7245 bytes) 000489[1] 1748984585.023173 write 0x93f5e7 thru 0x947cb4 (0x86ce bytes) 000490[1] 1748984585.041569 read 0x73a1b8 thru 0x74a088 (0xfed1 bytes) 000492[1] 1748984585.068830 mapwrite 0x87526e thru 0x87c21c (0x6faf bytes) 000495[1] 1748984585.130387 mapread 0x4f753b thru 0x505748 (0xe20e bytes) 000496[0] 1748984585.171276 mapread 0x8d3e6e thru 0x8e0ba9 (0xcd3c bytes) 000499[1] 1748984585.275288 mapread 0x79a4cd thru 0x7a984e (0xf382 bytes) 000500[0] 1748984585.283680 write 0x7a0dbc thru 0x7ac397 (0xb5dc bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 4585 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002[1] 1748984585.560915 mapwrite 0x3fb000 thru 0x4066d2 (0xb6d3 bytes) 000003[1] 1748984585.632178 mapread 0x1ba000 thru 0x1c3936 (0x9937 bytes) 000007[1] 1748984585.652860 write 0x5f7000 thru 0x5fb94c (0x494d bytes) 000008[0] 1748984585.654057 write_OD 0x341000 thru 0x341fff (0x1000 bytes) 000009[1] 1748984585.680093 mapread 0x12f000 thru 0x139e66 (0xae67 bytes) 000010[1] 1748984585.691270 read 0x558000 thru 0x5652c0 (0xd2c1 bytes) 000012[0] 1748984585.696429 write_OD 0x9b4000 thru 0x9b8fff (0x5000 bytes) 000013[1] 1748984585.719892 write 0x235000 thru 0x241920 (0xc921 bytes) truncating to largest ever: 0x97dfa0 000014[0] 1748984585.735174 trunc from 0x9b9000 to 0x97df9f (0x3b060 bytes) 000015[0] 1748984585.751355 read_OD 0x2b4000 thru 0x2bcfff (0x9000 bytes) 000016[0] 1748984585.759861 read_OD 0x483000 thru 0x487fff (0x5000 bytes) 000018[0] 1748984585.767984 mapread 0x1ac000 thru 0x1b0f41 (0x4f42 bytes) 000019[0] 1748984585.812332 write_OD 0x9ae000 thru 0x9bbfff (0xe000 bytes) 000021[0] 1748984585.842856 trunc from 0x9bc000 to 0x1b0271 (0x80bd8e bytes) 000022[0] 1748984585.855574 read_OD 0x049000 thru 0x04efff (0x6000 bytes) 000023[1] 1748984585.863686 trunc from 0x1b0272 to 0x0008df (0x1af992 bytes) 000024[1] 1748984585.882903 trunc from 0x0008e0 to 0x958508 (0x957c29 bytes) 000025[1] 1748984585.894441 read 0x253000 thru 0x25a55e (0x755f bytes) 000027[1] 1748984585.938794 write 0x448000 thru 0x456701 (0xe702 bytes) 000028[0] 1748984585.951490 trunc from 0x958509 to 0x88220e (0xd62fa bytes) 000029[0] 1748984585.977614 write_OD 0x72a000 thru 0x738fff (0xf000 bytes) 000030[1] 1748984586.006239 read 0x55a000 thru 0x56169b (0x769c bytes) 000032[1] 1748984586.038658 write 0x8b6000 thru 0x8b7dc3 (0x1dc4 bytes) 000034[0] 1748984586.048849 read_OD 0x0d1000 thru 0x0dbfff (0xb000 bytes) 000036[0] 1748984586.074210 write_OD 0x34c000 thru 0x353fff (0x8000 bytes) 000038[1] 1748984586.097896 trunc from 0x8b7dc4 to 0x671939 (0x24648a bytes) 000040[1] 1748984586.117807 mapwrite 0x11f000 thru 0x123490 (0x4491 bytes) 000041[1] 1748984586.157638 mapwrite 0x574000 thru 0x577f81 (0x3f82 bytes) 000042[1] 1748984586.189200 trunc from 0x67193a to 0x5a4537 (0xcd402 bytes) 000043[1] 1748984586.198635 mapread 0x434000 thru 0x4377fd (0x37fe bytes) 000044[0] 1748984586.208184 write_OD 0x013000 thru 0x01cfff (0xa000 bytes) 000046[0] 1748984586.233570 write_OD 0x109000 thru 0x112fff (0xa000 bytes) 000047[0] 1748984586.256349 write_OD 0x5de000 thru 0x5e7fff (0xa000 bytes) 000048[0] 1748984586.281338 mapread 0x341000 thru 0x34fcb9 (0xecba bytes) 000049[0] 1748984586.298124 write_OD 0x563000 thru 0x56cfff (0xa000 bytes) 000050[0] 1748984586.323016 write_OD 0x21d000 thru 0x227fff (0xb000 bytes) 000051[1] 1748984586.345944 mapwrite 0x3be000 thru 0x3c53b4 (0x73b5 bytes) 000054[0] 1748984586.408722 mapwrite 0x504000 thru 0x50b3c7 (0x73c8 bytes) 000056[1] 1748984586.460480 mapread 0x440000 thru 0x4474c2 (0x74c3 bytes) 000057[1] 1748984586.486078 mapwrite 0x421000 thru 0x4307f1 (0xf7f2 bytes) 000058[0] 1748984586.557740 mapwrite 0x8c5000 thru 0x8cf3ca (0xa3cb bytes) 000062[0] 1748984586.625521 write_OD 0x029000 thru 0x031fff (0x9000 bytes) 000064[0] 1748984586.650612 mapread 0x5e5000 thru 0x5f1896 (0xc897 bytes) 000065[1] 1748984586.666306 mapwrite 0x398000 thru 0x39b5fa (0x35fb bytes) 000067[0] 1748984586.721245 trunc from 0x8cf3cb to 0x52a1d2 (0x3a51f8 bytes) 000068[0] 1748984586.735152 mapread 0x139000 thru 0x13c990 (0x3991 bytes) 000069[1] 1748984586.754198 read 0x042000 thru 0x048404 (0x6405 bytes) 000072[1] 1748984586.794287 mapread 0x352000 thru 0x35e420 (0xc421 bytes) 000075[1] 1748984586.797551 mapwrite 0x52b000 thru 0x53a4e4 (0xf4e5 bytes) 000077[0] 1748984586.892106 trunc from 0x53a4e5 to 0x41afc9 (0x11f51b bytes) 000078[0] 1748984586.905836 write_OD 0x83b000 thru 0x83cfff (0x2000 bytes) 000080[1] 1748984586.934295 mapwrite 0x274000 thru 0x276198 (0x2199 bytes) 000082[0] 1748984586.975202 mapwrite 0x76c000 thru 0x76e72c (0x272d bytes) 000083[1] 1748984587.012385 write 0x51f000 thru 0x520853 (0x1854 bytes) 000084[0] 1748984587.027092 mapread 0x627000 thru 0x629786 (0x2787 bytes) 000085[0] 1748984587.046454 trunc from 0x83d000 to 0x41adce (0x422231 bytes) 000091[0] 1748984587.092135 mapwrite 0x86e000 thru 0x877444 (0x9445 bytes) 000093[0] 1748984587.153667 write_OD 0x01d000 thru 0x02bfff (0xf000 bytes) 000094[1] 1748984587.181353 read 0x4b0000 thru 0x4b1b58 (0x1b59 bytes) 000096[0] 1748984587.209201 mapread 0x7b5000 thru 0x7b6f5e (0x1f5f bytes) 000097[1] 1748984587.213926 mapwrite 0x244000 thru 0x24fd56 (0xbd57 bytes) 000098[1] 1748984587.282286 mapread 0x842000 thru 0x846c9f (0x4ca0 bytes) 000100[0] 1748984587.294289 trunc from 0x877445 to 0x96eb32 (0xf76ee bytes) 000102[1] 1748984587.315913 read 0x419000 thru 0x424503 (0xb504 bytes) 000105[0] 1748984587.357253 trunc from 0x96eb33 to 0x5812ad (0x3ed885 bytes) 000106[0] 1748984587.378461 mapwrite 0x0be000 thru 0x0c7f62 (0x9f63 bytes) 000107[0] 1748984587.420476 trunc from 0x5812ae to 0x50c7f0 (0x74abd bytes) 000108[1] 1748984587.435014 read 0x0fc000 thru 0x101812 (0x5813 bytes) 000110[1] 1748984587.470739 read 0x251000 thru 0x253e18 (0x2e19 bytes) 000111[0] 1748984587.471174 read_OD 0x2a8000 thru 0x2aafff (0x3000 bytes) 000112[0] 1748984587.474138 mapwrite 0x8a8000 thru 0x8b7e61 (0xfe62 bytes) 000113[0] 1748984587.529068 mapread 0x373000 thru 0x3789d8 (0x59d9 bytes) 000116[1] 1748984587.538189 read 0x191000 thru 0x19d589 (0xc58a bytes) 000119[0] 1748984587.605477 mapread 0x3a9000 thru 0x3abd4f (0x2d50 bytes) 000120[1] 1748984587.610020 write 0x9c9000 thru 0x9cc231 (0x3232 bytes) 000122[1] 1748984587.639456 read 0x9a9000 thru 0x9b41e1 (0xb1e2 bytes) 000123[1] 1748984587.651709 write 0x550000 thru 0x552a07 (0x2a08 bytes) 000124[1] 1748984587.654996 mapread 0x0f9000 thru 0x0fa009 (0x100a bytes) 000125[1] 1748984587.667555 mapwrite 0x37f000 thru 0x38e143 (0xf144 bytes) 000127[0] 1748984587.743115 read_OD 0x2ce000 thru 0x2d9fff (0xc000 bytes) 000128[0] 1748984587.755286 write_OD 0x413000 thru 0x41efff (0xc000 bytes) 000129[1] 1748984587.778677 mapread 0x4b0000 thru 0x4b3f3c (0x3f3d bytes) 000130[1] 1748984587.789867 read 0x436000 thru 0x44107b (0xb07c bytes) 000132[0] 1748984587.827255 write_OD 0x932000 thru 0x938fff (0x7000 bytes) 000134[1] 1748984587.858913 mapwrite 0x01f000 thru 0x02114f (0x2150 bytes) 000135[0] 1748984587.897996 write_OD 0x13a000 thru 0x148fff (0xf000 bytes) 000136[1] 1748984587.923621 trunc from 0x9cc232 to 0x7831e4 (0x24904d bytes) 000139[1] 1748984587.957293 trunc from 0x7831e5 to 0x689f9a (0xf924a bytes) 000141[1] 1748984587.978201 read 0x621000 thru 0x62edb7 (0xddb8 bytes) 000145[1] 1748984588.011873 read 0x208000 thru 0x209230 (0x1231 bytes) 000147[1] 1748984588.042023 read 0x605000 thru 0x607492 (0x2493 bytes) 000148[1] 1748984588.042469 mapwrite 0x36f000 thru 0x37afed (0xbfee bytes) 000150[1] 1748984588.080890 trunc from 0x689f9b to 0x69afcc (0x11032 bytes) 000152[1] 1748984588.099072 read 0x345000 thru 0x34dd23 (0x8d24 bytes) 000156[0] 1748984588.099888 write_OD 0x0e7000 thru 0x0f2fff (0xc000 bytes) 000157[0] 1748984588.131423 write_OD 0x5ff000 thru 0x608fff (0xa000 bytes) 000158[1] 1748984588.154963 mapwrite 0x14f000 thru 0x155e57 (0x6e58 bytes) 000160[0] 1748984588.214492 write_OD 0x72b000 thru 0x730fff (0x6000 bytes) 000162[1] 1748984588.241544 mapwrite 0x94a000 thru 0x955e8d (0xbe8e bytes) 000163[0] 1748984588.316657 write_OD 0x181000 thru 0x18afff (0xa000 bytes) 000167[1] 1748984588.346819 read 0x4d3000 thru 0x4d8c28 (0x5c29 bytes) 000169[0] 1748984588.374358 read_OD 0x915000 thru 0x922fff (0xe000 bytes) 000172[0] 1748984588.379125 mapread 0x196000 thru 0x19ab9a (0x4b9b bytes) 000174[1] 1748984588.394970 read 0x742000 thru 0x74cd90 (0xad91 bytes) 000175[1] 1748984588.395403 write 0x2b1000 thru 0x2b5797 (0x4798 bytes) 000176[0] 1748984588.408489 read_OD 0x6ee000 thru 0x6f5fff (0x8000 bytes) 000177[0] 1748984588.424894 mapwrite 0x2d5000 thru 0x2da45d (0x545e bytes) 000178[1] 1748984588.485201 mapwrite 0x918000 thru 0x91a949 (0x294a bytes) 000179[0] 1748984588.524201 read_OD 0x5ca000 thru 0x5cafff (0x1000 bytes) 000180[0] 1748984588.534516 mapwrite 0x0ae000 thru 0x0b952e (0xb52f bytes) 000183[1] 1748984588.623439 mapread 0x737000 thru 0x73701f (0x20 bytes) 000184[1] 1748984588.639498 write 0x808000 thru 0x81120d (0x920e bytes) 000185[0] 1748984588.653861 read_OD 0x3de000 thru 0x3e2fff (0x5000 bytes) 000186[1] 1748984588.669354 write 0x1c6000 thru 0x1cc7e6 (0x67e7 bytes) 000188[0] 1748984588.690126 mapwrite 0x6b5000 thru 0x6b7156 (0x2157 bytes) 000191[1] 1748984588.772422 write 0x0e6000 thru 0x0ed86e (0x786f bytes) 000193[0] 1748984588.795100 mapwrite 0x12e000 thru 0x132c49 (0x4c4a bytes) 000194[1] 1748984588.844139 write 0x550000 thru 0x557faf (0x7fb0 bytes) 000195[1] 1748984588.858331 mapwrite 0x614000 thru 0x617bed (0x3bee bytes) 000196[0] 1748984588.901959 mapwrite 0x6db000 thru 0x6db592 (0x593 bytes) 000197[1] 1748984588.939323 read 0x32f000 thru 0x332222 (0x3223 bytes) 000198[0] 1748984588.986725 mapread 0x4fa000 thru 0x50144d (0x744e bytes) 000199[0] 1748984589.006684 read_OD 0x39a000 thru 0x3a0fff (0x7000 bytes) 000201[0] 1748984589.010901 mapwrite 0x9af000 thru 0x9b36d0 (0x46d1 bytes) 000204[0] 1748984589.116208 read_OD 0x16c000 thru 0x179fff (0xe000 bytes) 000205[0] 1748984589.133066 trunc from 0x9b36d1 to 0x15743b (0x85c295 bytes) 000207[0] 1748984589.156275 trunc from 0x15743c to 0x26b5fe (0x1141c3 bytes) 000209[0] 1748984589.180088 mapread 0x083000 thru 0x08ca78 (0x9a79 bytes) 000210[1] 1748984589.217767 mapwrite 0x558000 thru 0x561008 (0x9009 bytes) 000211[1] 1748984589.295844 write 0x274000 thru 0x27dbde (0x9bdf bytes) 000212[0] 1748984589.301615 write_OD 0x09b000 thru 0x09ffff (0x5000 bytes) 000213[1] 1748984589.334281 mapwrite 0x852000 thru 0x859d26 (0x7d27 bytes) 000214[1] 1748984589.393505 trunc from 0x859d27 to 0x81dd02 (0x3c024 bytes) 000215[0] 1748984589.400380 trunc from 0x81dd03 to 0x852f40 (0x3523e bytes) 000218[0] 1748984589.435846 write_OD 0x947000 thru 0x954fff (0xe000 bytes) 000219[1] 1748984589.463396 write 0x0f2000 thru 0x0f20b1 (0xb2 bytes) 000221[1] 1748984589.484711 write 0x51a000 thru 0x526a5f (0xca60 bytes) 000222[0] 1748984589.495266 read_OD 0x1f4000 thru 0x1f4fff (0x1000 bytes) 000224[0] 1748984589.510471 write_OD 0x4c8000 thru 0x4c8fff (0x1000 bytes) 000226[0] 1748984589.536994 write_OD 0x79e000 thru 0x7a6fff (0x9000 bytes) 000227[0] 1748984589.562729 trunc from 0x955000 to 0x699992 (0x2bb66d bytes) 000228[1] 1748984589.583194 mapread 0x210000 thru 0x215ce5 (0x5ce6 bytes) 000232[0] 1748984589.609413 trunc from 0x699993 to 0x597705 (0x10228d bytes) 000233[0] 1748984589.629213 write_OD 0x863000 thru 0x863fff (0x1000 bytes) 000235[0] 1748984589.658463 mapwrite 0x4b4000 thru 0x4c1aa9 (0xdaaa bytes) 000238[0] 1748984589.753147 read_OD 0x68a000 thru 0x698fff (0xf000 bytes) 000240[0] 1748984589.771133 read_OD 0x32e000 thru 0x339fff (0xc000 bytes) 000241[1] 1748984589.775621 write 0x79a000 thru 0x79acc7 (0xcc8 bytes) 000246[0] 1748984589.791284 trunc from 0x864000 to 0x0e1473 (0x782b8c bytes) 000247[0] 1748984589.813900 trunc from 0x0e1474 to 0x704b44 (0x6236d1 bytes) 000249[0] 1748984589.834578 trunc from 0x704b45 to 0x063c34 (0x6a0f10 bytes) 000251[0] 1748984589.853504 write_OD 0x253000 thru 0x25afff (0x8000 bytes) 000253[1] 1748984589.882437 mapwrite 0x950000 thru 0x954ab4 (0x4ab5 bytes) 000254[0] 1748984589.933263 mapwrite 0x0e3000 thru 0x0e372a (0x72b bytes) 000257[1] 1748984590.009784 write 0x623000 thru 0x62a605 (0x7606 bytes) 000259[1] 1748984590.033279 write 0x307000 thru 0x309fd1 (0x2fd2 bytes) 000264[1] 1748984590.051196 mapwrite 0x549000 thru 0x54e1b2 (0x51b3 bytes) 000265[1] 1748984590.088121 mapread 0x299000 thru 0x2a6239 (0xd23a bytes) 000267[1] 1748984590.133508 mapwrite 0x264000 thru 0x265fda (0x1fdb bytes) 000269[0] 1748984590.165196 write_OD 0x976000 thru 0x978fff (0x3000 bytes) 000270[0] 1748984590.189976 read_OD 0x3d7000 thru 0x3d9fff (0x3000 bytes) 000271[1] 1748984590.194835 mapwrite 0x194000 thru 0x19d2ee (0x92ef bytes) 000272[1] 1748984590.248143 mapread 0x52f000 thru 0x5397e2 (0xa7e3 bytes) 000273[1] 1748984590.279776 read 0x8e1000 thru 0x8effb5 (0xefb6 bytes) 000275[1] 1748984590.296335 mapwrite 0x117000 thru 0x118bed (0x1bee bytes) 000276[1] 1748984590.331799 read 0x550000 thru 0x55bedf (0xbee0 bytes) 000277[1] 1748984590.362548 trunc from 0x979000 to 0x2ee5bd (0x68aa42 bytes) 000278[1] 1748984590.374704 mapread 0x243000 thru 0x248419 (0x541a bytes) 000279[0] 1748984590.384214 write_OD 0x655000 thru 0x660fff (0xc000 bytes) 000280[1] 1748984590.410233 mapwrite 0x241000 thru 0x241b1f (0xb20 bytes) 000281[1] 1748984590.441810 mapread 0x14b000 thru 0x14c7c5 (0x17c6 bytes) 000282[0] 1748984590.447203 mapread 0x35c000 thru 0x368291 (0xc292 bytes) 000283[0] 1748984590.508992 mapwrite 0x312000 thru 0x31acf0 (0x8cf1 bytes) 000290[0] 1748984590.586612 trunc from 0x661000 to 0x091fa6 (0x5cf059 bytes) 000293[0] 1748984590.618363 read_OD 0x002000 thru 0x006fff (0x5000 bytes) 000296[1] 1748984590.628948 mapwrite 0x957000 thru 0x9666fe (0xf6ff bytes) 000297[1] 1748984590.707844 write 0x191000 thru 0x19faea (0xeaeb bytes) 000298[1] 1748984590.720695 mapwrite 0x098000 thru 0x0a6b13 (0xeb14 bytes) 000299[1] 1748984590.785426 write 0x4a9000 thru 0x4a9a7e (0xa7f bytes) 000300[0] 1748984590.795553 trunc from 0x9666ff to 0x416b81 (0x54fb7d bytes) 000302[0] 1748984590.812060 write_OD 0x033000 thru 0x034fff (0x2000 bytes) 000303[0] 1748984590.837863 mapread 0x2c8000 thru 0x2c9642 (0x1643 bytes) 000304[1] 1748984590.877214 trunc from 0x416b82 to 0x04ec52 (0x3c7f2f bytes) 000305[0] 1748984590.902884 write_OD 0x713000 thru 0x716fff (0x4000 bytes) 000307[1] 1748984590.935455 write 0x408000 thru 0x408d99 (0xd9a bytes) 000308[0] 1748984590.949305 write_OD 0x9d5000 thru 0x9e3fff (0xf000 bytes) 000309[1] 1748984590.980212 read 0x4a8000 thru 0x4b1fc9 (0x9fca bytes) 000310[0] 1748984591.016266 mapwrite 0x254000 thru 0x255739 (0x173a bytes) 000311[0] 1748984591.064007 read_OD 0x731000 thru 0x73efff (0xe000 bytes) 000312[1] 1748984591.072511 mapread 0x3f8000 thru 0x3f8e80 (0xe81 bytes) 000315[0] 1748984591.077486 read_OD 0x8ef000 thru 0x8fdfff (0xf000 bytes) 000316[0] 1748984591.081547 write_OD 0x018000 thru 0x01ffff (0x8000 bytes) 000318[0] 1748984591.106583 mapread 0x736000 thru 0x7390e2 (0x30e3 bytes) 000319[0] 1748984591.126727 mapread 0x276000 thru 0x2780aa (0x20ab bytes) 000324[1] 1748984591.134568 trunc from 0x9e4000 to 0x73d6d6 (0x2a6929 bytes) 000328[0] 1748984591.159177 write_OD 0x7f3000 thru 0x7f9fff (0x7000 bytes) 000330[0] 1748984591.177081 write_OD 0x8fe000 thru 0x909fff (0xc000 bytes) 000334[1] 1748984591.194191 trunc from 0x90a000 to 0x176506 (0x793af9 bytes) 000335[1] 1748984591.207737 read 0x122000 thru 0x1273d0 (0x53d1 bytes) 000337[1] 1748984591.215283 trunc from 0x176507 to 0x800901 (0x68a3fb bytes) 000338[0] 1748984591.228557 mapread 0x51e000 thru 0x52d17e (0xf17f bytes) 000339[0] 1748984591.263417 trunc from 0x800902 to 0x5b5c99 (0x24ac68 bytes) 000340[0] 1748984591.271160 trunc from 0x5b5c9a to 0x4797f8 (0x13c4a1 bytes) 000342[1] 1748984591.283461 read 0x178000 thru 0x17e5e0 (0x65e1 bytes) 000346[0] 1748984591.311013 mapwrite 0x24f000 thru 0x251105 (0x2106 bytes) 000347[0] 1748984591.345885 trunc from 0x4797f9 to 0x1e5cb4 (0x293b44 bytes) 000348[0] 1748984591.352760 trunc from 0x1e5cb5 to 0x3bd79b (0x1d7ae7 bytes) 000349[0] 1748984591.358296 mapwrite 0x355000 thru 0x3566fd (0x16fe bytes) 000350[0] 1748984591.382270 write_OD 0x273000 thru 0x27bfff (0x9000 bytes) 000352[1] 1748984591.396162 mapwrite 0x558000 thru 0x562694 (0xa695 bytes) 000353[1] 1748984591.429096 read 0x202000 thru 0x20d09f (0xb0a0 bytes) 000354[0] 1748984591.445846 mapwrite 0x359000 thru 0x35d5f7 (0x45f8 bytes) 000358[0] 1748984591.498559 mapwrite 0x81d000 thru 0x821c5f (0x4c60 bytes) 000361[1] 1748984591.528434 mapread 0x414000 thru 0x420768 (0xc769 bytes) 000363[0] 1748984591.575798 trunc from 0x821c60 to 0x817304 (0xa95b bytes) 000365[1] 1748984591.601375 write 0x7df000 thru 0x7e31ae (0x41af bytes) 000366[0] 1748984591.606611 trunc from 0x817305 to 0x8c8c50 (0xb194c bytes) 000367[1] 1748984591.622366 mapwrite 0x563000 thru 0x563157 (0x158 bytes) 000369[0] 1748984591.662901 read_OD 0x584000 thru 0x584fff (0x1000 bytes) 000370[1] 1748984591.671643 read 0x7de000 thru 0x7ec10a (0xe10b bytes) 000375[0] 1748984591.683471 read_OD 0x4b7000 thru 0x4bdfff (0x7000 bytes) 000377[0] 1748984591.686586 trunc from 0x8c8c51 to 0x20b18c (0x6bdac4 bytes) 000378[1] 1748984591.702880 mapread 0x092000 thru 0x09d766 (0xb767 bytes) 000380[0] 1748984591.731269 mapwrite 0x571000 thru 0x57e19c (0xd19d bytes) 000382[1] 1748984591.766076 mapwrite 0x806000 thru 0x811d4f (0xbd50 bytes) 000384[1] 1748984591.830621 trunc from 0x811d50 to 0x18ea6c (0x6832e3 bytes) 000386[1] 1748984591.849625 write 0x712000 thru 0x7185bc (0x65bd bytes) 000387[0] 1748984591.853613 mapwrite 0x7e4000 thru 0x7edc52 (0x9c53 bytes) 000389[0] 1748984591.906022 trunc from 0x7edc53 to 0x58cc14 (0x26103e bytes) 000393[1] 1748984591.934623 read 0x0d4000 thru 0x0e1486 (0xd487 bytes) 000395[0] 1748984591.964599 read_OD 0x167000 thru 0x171fff (0xb000 bytes) 000396[1] 1748984591.967863 trunc from 0x58cc15 to 0x78b912 (0x1fecfe bytes) 000397[0] 1748984591.984557 mapwrite 0x7bf000 thru 0x7c91da (0xa1db bytes) 000398[1] 1748984592.044288 mapread 0x159000 thru 0x165d58 (0xcd59 bytes) 000399[1] 1748984592.098349 trunc from 0x7c91db to 0x8912bf (0xc80e5 bytes) 000400[0] 1748984592.111254 trunc from 0x8912c0 to 0x910729 (0x7f46a bytes) 000401[1] 1748984592.125816 mapread 0x1dd000 thru 0x1def25 (0x1f26 bytes) 000402[0] 1748984592.146243 write_OD 0x029000 thru 0x02dfff (0x5000 bytes) 000404[0] 1748984592.167210 write_OD 0x2fa000 thru 0x2fffff (0x6000 bytes) 000405[0] 1748984592.183762 mapread 0x416000 thru 0x424f39 (0xef3a bytes) 000406[0] 1748984592.212373 mapread 0x54f000 thru 0x558bd3 (0x9bd4 bytes) 000407[0] 1748984592.230713 mapread 0x799000 thru 0x79bd37 (0x2d38 bytes) 000408[0] 1748984592.236787 mapwrite 0x66f000 thru 0x671cc6 (0x2cc7 bytes) 000409[1] 1748984592.267501 mapwrite 0x26e000 thru 0x2765a2 (0x85a3 bytes) 000410[0] 1748984592.315429 trunc from 0x91072a to 0x5b23a5 (0x35e384 bytes) 000411[0] 1748984592.324722 write_OD 0x44b000 thru 0x456fff (0xc000 bytes) 000412[0] 1748984592.341823 read_OD 0x3c6000 thru 0x3d4fff (0xf000 bytes) 000413[0] 1748984592.345207 read_OD 0x2bc000 thru 0x2c7fff (0xc000 bytes) 000414[1] 1748984592.348420 read 0x580000 thru 0x5897d3 (0x97d4 bytes) 000415[1] 1748984592.354777 read 0x0c5000 thru 0x0ca9c6 (0x59c7 bytes) 000416[1] 1748984592.381840 mapwrite 0x93d000 thru 0x941189 (0x418a bytes) 000418[1] 1748984592.437526 mapread 0x3e7000 thru 0x3ebddb (0x4ddc bytes) 000419[1] 1748984592.454575 read 0x6ff000 thru 0x70c0e1 (0xd0e2 bytes) 000422[0] 1748984592.472601 mapwrite 0x4f0000 thru 0x4fccf3 (0xccf4 bytes) 000423[1] 1748984592.539453 mapwrite 0x524000 thru 0x52c325 (0x8326 bytes) 000424[1] 1748984592.594170 write 0x7a9000 thru 0x7aac0c (0x1c0d bytes) 000425[0] 1748984592.596440 trunc from 0x94118a to 0x3c24e0 (0x57eca9 bytes) 000429[0] 1748984592.622479 read_OD 0x101000 thru 0x101fff (0x1000 bytes) 000431[0] 1748984592.627643 trunc from 0x3c24e1 to 0x8c4c74 (0x502794 bytes) 000432[1] 1748984592.643521 mapwrite 0x5db000 thru 0x5e2bd5 (0x7bd6 bytes) 000434[1] 1748984592.688678 mapread 0x834000 thru 0x835f4a (0x1f4b bytes) 000435[0] 1748984592.698381 trunc from 0x8c4c75 to 0x5eb726 (0x2d954e bytes) 000436[1] 1748984592.708403 write 0x706000 thru 0x71274a (0xc74b bytes) 000443[0] 1748984592.734442 read_OD 0x327000 thru 0x327fff (0x1000 bytes) 000444[1] 1748984592.746283 read 0x1a0000 thru 0x1a8ba6 (0x8ba7 bytes) 000450[1] 1748984592.776370 mapwrite 0x974000 thru 0x97d942 (0x9943 bytes) 000451[1] 1748984592.829084 mapwrite 0x42f000 thru 0x435ddb (0x6ddc bytes) 000453[0] 1748984592.867526 mapwrite 0x022000 thru 0x0263c7 (0x43c8 bytes) 000454[0] 1748984592.934333 mapwrite 0x9ea000 thru 0x9ed4dd (0x34de bytes) 000456[1] 1748984592.972843 write 0x5fa000 thru 0x5fc1dd (0x21de bytes) 000458[0] 1748984592.995329 trunc from 0x9ed4de to 0x2f08d9 (0x6fcc04 bytes) 000459[1] 1748984593.009394 write 0x86a000 thru 0x878ea2 (0xeea3 bytes) 000462[0] 1748984593.020323 read_OD 0x611000 thru 0x614fff (0x4000 bytes) 000463[0] 1748984593.028629 read_OD 0x372000 thru 0x37ffff (0xe000 bytes) 000465[0] 1748984593.032432 mapread 0x261000 thru 0x264aaa (0x3aab bytes) 000466[1] 1748984593.063670 mapread 0x4cd000 thru 0x4cec8c (0x1c8d bytes) 000467[1] 1748984593.068376 trunc from 0x878ea3 to 0x68b4a2 (0x1eda00 bytes) 000469[1] 1748984593.087683 trunc from 0x68b4a3 to 0x92b97c (0x2a04da bytes) 000471[0] 1748984593.108690 mapwrite 0x3a2000 thru 0x3a4824 (0x2825 bytes) 000472[1] 1748984593.162303 trunc from 0x92b97d to 0x5ea789 (0x3411f3 bytes) 000473[0] 1748984593.175331 mapread 0x02f000 thru 0x03a721 (0xb722 bytes) 000477[1] 1748984593.214659 read 0x585000 thru 0x589aa1 (0x4aa2 bytes) 000478[1] 1748984593.222828 mapwrite 0x3f4000 thru 0x3fad2f (0x6d30 bytes) 000480[0] 1748984593.282249 read_OD 0x0e2000 thru 0x0eafff (0x9000 bytes) 000481[0] 1748984593.294381 write_OD 0x740000 thru 0x74dfff (0xe000 bytes) 000482[0] 1748984593.321593 write_OD 0x296000 thru 0x29bfff (0x6000 bytes) 000483[0] 1748984593.348191 write_OD 0x9a5000 thru 0x9adfff (0x9000 bytes) 000487[0] 1748984593.375503 mapread 0x647000 thru 0x647952 (0x953 bytes) 000488[0] 1748984593.441466 mapread 0x8da000 thru 0x8de953 (0x4954 bytes) 000490[0] 1748984593.442168 mapread 0x79b000 thru 0x7a0f43 (0x5f44 bytes) 000492[1] 1748984593.442703 mapwrite 0x152000 thru 0x15c4e8 (0xa4e9 bytes) 000493[1] 1748984593.542265 trunc from 0x9ae000 to 0x904fe8 (0xa9017 bytes) 000497[1] 1748984593.575959 mapwrite 0x068000 thru 0x07060b (0x860c bytes) 000499[1] 1748984593.625977 write 0x21f000 thru 0x22dbc2 (0xebc3 bytes) All operations completed A-OK! PASS 16a (20s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 17:03:15 (1748984595) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.125852 s, 16.7 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0963688 s, 21.8 MB/s Chance of close/open is 1 in 50 Seed set to 4596 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x67c005 000003[0] 1748984596.293333 trunc from 00000000 to 0x67c004 (0x67c005 bytes) 000004[0] 1748984596.307868 read 0x041e00 thru 0x043234 (0x1435 bytes) 000005[0] 1748984596.313074 write 0x2eb8dd thru 0x2ed339 (0x1a5d bytes) 000006[0] 1748984596.324751 read 0x5c6c76 thru 0x5c7efd (0x1288 bytes) 000008[0] 1748984596.341298 mapread 0x653d71 thru 0x65552b (0x17bb bytes) 000009[0] 1748984596.349139 mapread 0x38c9f0 thru 0x38d556 (0xb67 bytes) 000010[0] 1748984596.354536 read 0x3d0c69 thru 0x3d140c (0x7a4 bytes) 000013[1] 1748984596.374832 read 0x483fe0 thru 0x4851d2 (0x11f3 bytes) 000016[0] 1748984596.394979 write 0x8ac284 thru 0x8ae15a (0x1ed7 bytes) 000017[0] 1748984596.401167 write 0x00c436 thru 0x00e1bc (0x1d87 bytes) 000018[1] 1748984596.419523 read 0x4221eb thru 0x42245d (0x273 bytes) 000019[0] 1748984596.443905 mapwrite 0x408eff thru 0x40ac21 (0x1d23 bytes) 000021[0] 1748984596.492418 mapwrite 0x1a3b86 thru 0x1a4b95 (0x1010 bytes) 000023[0] 1748984596.529138 read 0x1bf395 thru 0x1c1338 (0x1fa4 bytes) 000027[0] 1748984596.584834 read 0x48bb69 thru 0x48c98d (0xe25 bytes) 000028[0] 1748984596.591752 write 0x4cef55 thru 0x4cef6f (0x1b bytes) 000030[1] 1748984596.592712 trunc from 0x8ae15b to 0x19661c (0x717b3e bytes) 000032[1] 1748984596.626153 mapwrite 0x614034 thru 0x6156ca (0x1697 bytes) 000033[1] 1748984596.663858 read 0x1f78fa thru 0x1f8494 (0xb9b bytes) 000037[1] 1748984596.704466 read 0x171705 thru 0x1735ce (0x1eca bytes) 000041[1] 1748984596.721224 mapwrite 0x30e598 thru 0x30f5dc (0x1045 bytes) 000043[0] 1748984596.752821 write 0x8a2be9 thru 0x8a403d (0x1455 bytes) 000048[0] 1748984596.787702 read 0x002ab6 thru 0x004a61 (0x1fac bytes) 000050[0] 1748984596.811279 mapwrite 0x063bc8 thru 0x0653be (0x17f7 bytes) 000055[0] 1748984596.864697 read 0x47586c thru 0x476ec9 (0x165e bytes) 000056[1] 1748984596.882760 mapread 0x5d978a thru 0x5daccf (0x1546 bytes) 000057[1] 1748984596.894271 read 0x66c984 thru 0x66dfd2 (0x164f bytes) 000058[1] 1748984596.923740 mapread 0x29acfa thru 0x29c2ae (0x15b5 bytes) 000059[0] 1748984596.930975 mapread 0x235f2e thru 0x237cef (0x1dc2 bytes) 000060[1] 1748984596.942067 write 0x4c9442 thru 0x4c98be (0x47d bytes) 000062[1] 1748984596.950955 trunc from 0x8a403e to 0x44752b (0x45cb12 bytes) 000063[1] 1748984596.970072 mapread 0x04aa68 thru 0x04b368 (0x901 bytes) 000064[0] 1748984596.982502 read 0x0096b0 thru 0x009dfb (0x74c bytes) 000065[1] 1748984597.005267 trunc from 0x44752c to 0x4f54a7 (0xadf7c bytes) 000066[1] 1748984597.020437 mapread 0x48dfc8 thru 0x48e7cf (0x808 bytes) 000067[1] 1748984597.036406 read 0x1afcb4 thru 0x1b0b2e (0xe7b bytes) truncating to largest ever: 0x76cf82 000070[0] 1748984597.063536 trunc from 0x4f54a8 to 0x76cf81 (0x277ada bytes) 000071[1] 1748984597.087061 trunc from 0x76cf82 to 0x2c8ec4 (0x4a40bd bytes) 000073[0] 1748984597.112287 write 0x0f719e thru 0x0f8341 (0x11a4 bytes) 000074[0] 1748984597.128364 mapwrite 0x63a9c5 thru 0x63c450 (0x1a8c bytes) 000076[0] 1748984597.213460 mapread 0x026e5c thru 0x028588 (0x172d bytes) 000077[0] 1748984597.228112 read 0x22acf1 thru 0x22cc51 (0x1f61 bytes) 000078[1] 1748984597.231493 write 0x45b61b thru 0x45b640 (0x26 bytes) 000079[1] 1748984597.249258 write 0x11bc26 thru 0x11cecf (0x12aa bytes) 000080[1] 1748984597.269930 mapread 0x3bb3df thru 0x3bbecc (0xaee bytes) 000081[0] 1748984597.272904 mapread 0x130edc thru 0x1314ae (0x5d3 bytes) 000083[1] 1748984597.297646 write 0x754864 thru 0x7556fd (0xe9a bytes) 000088[1] 1748984597.317558 write 0x279ad2 thru 0x27a245 (0x774 bytes) 000089[1] 1748984597.322461 mapread 0x62b67c thru 0x62bcd5 (0x65a bytes) 000092[1] 1748984597.349122 mapread 0x1483cc thru 0x14857a (0x1af bytes) 000094[1] 1748984597.366650 read 0x381360 thru 0x3822d4 (0xf75 bytes) 000096[0] 1748984597.400310 read 0x37d837 thru 0x37f3b1 (0x1b7b bytes) 000098[0] 1748984597.427382 mapwrite 0x9d98bb thru 0x9da9bb (0x1101 bytes) 000099[0] 1748984597.507719 mapread 0x256276 thru 0x25764d (0x13d8 bytes) 000100[1] 1748984597.515480 trunc from 0x9da9bc to 0x4d042f (0x50a58c bytes) 000101[0] 1748984597.543589 mapread 0x450cbe thru 0x451ed4 (0x1217 bytes) 000102[0] 1748984597.560147 mapwrite 0x1f22a9 thru 0x1f368a (0x13e2 bytes) 000104[1] 1748984597.607743 mapwrite 0x80cd0e thru 0x80ebe4 (0x1ed7 bytes) 000105[0] 1748984597.653760 mapread 0x37dbf0 thru 0x37de3b (0x24c bytes) 000106[0] 1748984597.671112 trunc from 0x80ebe5 to 0x4d7eaa (0x336d3a bytes) 000108[0] 1748984597.684847 mapread 0x0f7ba7 thru 0x0f9a2e (0x1e88 bytes) 000110[1] 1748984597.707843 trunc from 0x4d7eab to 0x4da1f5 (0x234b bytes) 000111[1] 1748984597.728742 mapread 0x121b90 thru 0x122a9d (0xf0e bytes) 000113[1] 1748984597.742010 mapwrite 0x92b0de thru 0x92ce07 (0x1d2a bytes) 000114[0] 1748984597.778418 write 0x362b7e thru 0x363062 (0x4e5 bytes) 000116[0] 1748984597.801726 trunc from 0x92ce08 to 0x0759fe (0x8b7409 bytes) 000121[0] 1748984597.830191 mapread 0x008532 thru 0x00a0f6 (0x1bc5 bytes) 000122[1] 1748984597.844921 mapwrite 0x75cb2f thru 0x75d180 (0x652 bytes) 000123[0] 1748984597.889326 write 0x2241df thru 0x225de6 (0x1c08 bytes) 000126[1] 1748984597.921377 trunc from 0x75d181 to 0x400263 (0x35cf1d bytes) 000128[0] 1748984597.935612 trunc from 0x400264 to 0x068254 (0x39800f bytes) 000129[0] 1748984597.951495 trunc from 0x068255 to 0x753494 (0x6eb240 bytes) 000135[0] 1748984597.984423 write 0x8fcddf thru 0x8fdb75 (0xd97 bytes) 000136[1] 1748984597.992017 mapread 0x35457e thru 0x354b46 (0x5c9 bytes) 000137[0] 1748984598.008663 mapread 0x118d80 thru 0x119cc1 (0xf42 bytes) 000139[1] 1748984598.023532 read 0x63de56 thru 0x63fae8 (0x1c93 bytes) 000140[1] 1748984598.052210 read 0x24d0bd thru 0x24d747 (0x68b bytes) 000142[0] 1748984598.079523 write 0x843447 thru 0x8448cd (0x1487 bytes) truncating to largest ever: 0x8a06d2 000143[1] 1748984598.100149 trunc from 0x8fdb76 to 0x8a06d1 (0x5d4a4 bytes) 000145[0] 1748984598.136473 read 0x6ee720 thru 0x6ee786 (0x67 bytes) 000146[1] 1748984598.152619 trunc from 0x8a06d2 to 0x8296ad (0x77024 bytes) 000150[0] 1748984598.182074 write 0x18a688 thru 0x18ae46 (0x7bf bytes) 000154[0] 1748984598.228966 read 0x7445ae thru 0x745b74 (0x15c7 bytes) 000155[0] 1748984598.236964 write 0x812823 thru 0x813784 (0xf62 bytes) 000156[0] 1748984598.244998 trunc from 0x8296ae to 0x49ef22 (0x38a78b bytes) 000157[1] 1748984598.255753 trunc from 0x49ef23 to 0x05a1ed (0x444d35 bytes) 000158[1] 1748984598.280308 mapread 0x0167fb thru 0x0183d0 (0x1bd6 bytes) 000159[1] 1748984598.289653 mapwrite 0x26d4cf thru 0x26da57 (0x589 bytes) 000164[1] 1748984598.341381 mapread 0x03ba19 thru 0x03c434 (0xa1c bytes) 000166[0] 1748984598.353885 write 0x42c30d thru 0x42c443 (0x137 bytes) 000167[0] 1748984598.367095 mapwrite 0x84071e thru 0x841851 (0x1134 bytes) 000168[1] 1748984598.415502 read 0x72f942 thru 0x7312ee (0x19ad bytes) 000170[0] 1748984598.437563 mapwrite 0x3b0bdc thru 0x3b1d77 (0x119c bytes) truncating to largest ever: 0x957d76 000174[1] 1748984598.477463 trunc from 0x841852 to 0x957d75 (0x116524 bytes) 000175[1] 1748984598.500358 mapread 0x38d20c thru 0x38eac2 (0x18b7 bytes) 000176[1] 1748984598.521102 read 0x260fc6 thru 0x2610c7 (0x102 bytes) 000177[0] 1748984598.564792 trunc from 0x957d76 to 0x500df8 (0x456f7d bytes) 000178[0] 1748984598.596725 write 0x861ea7 thru 0x8628b8 (0xa12 bytes) 000179[1] 1748984598.605458 mapwrite 0x03aeed thru 0x03c6f7 (0x180b bytes) 000180[1] 1748984598.637929 read 0x6c61ab thru 0x6c77a6 (0x15fc bytes) 000181[1] 1748984598.650297 mapread 0x090482 thru 0x090927 (0x4a6 bytes) 000183[0] 1748984598.671774 read 0x33f7f4 thru 0x341265 (0x1a72 bytes) 000184[0] 1748984598.691294 trunc from 0x8628b9 to 0x3e57d2 (0x47d0e6 bytes) 000185[1] 1748984598.710747 mapwrite 0x6d16d5 thru 0x6d2046 (0x972 bytes) 000186[1] 1748984598.750702 write 0x6fbc8a thru 0x6fd080 (0x13f7 bytes) 000189[1] 1748984598.765918 read 0x3c9620 thru 0x3ca49f (0xe80 bytes) 000190[1] 1748984598.786664 read 0x114998 thru 0x114db9 (0x422 bytes) 000194[1] 1748984598.825817 mapwrite 0x2e20a5 thru 0x2e3023 (0xf7f bytes) 000197[0] 1748984598.862602 trunc from 0x6fd081 to 0x32c797 (0x3d08e9 bytes) 000199[1] 1748984598.898990 read 0x2fa795 thru 0x2fbbe7 (0x1453 bytes) 000202[1] 1748984598.916659 mapwrite 0x307bec thru 0x309128 (0x153d bytes) 000203[1] 1748984598.951781 mapread 0x2ed9c7 thru 0x2ef507 (0x1b41 bytes) 000206[1] 1748984598.974316 mapwrite 0x6efbd6 thru 0x6f0ba3 (0xfce bytes) 000207[0] 1748984599.013402 read 0x51fc7c thru 0x5212fd (0x1682 bytes) truncating to largest ever: 0x979858 000208[0] 1748984599.041059 trunc from 0x6f0ba4 to 0x979857 (0x288cb4 bytes) 000211[0] 1748984599.067396 trunc from 0x979858 to 0x53bc48 (0x43dc0f bytes) 000212[1] 1748984599.074714 mapwrite 0x60864c thru 0x60a025 (0x19da bytes) 000213[1] 1748984599.112439 write 0x109ff2 thru 0x10bab8 (0x1ac7 bytes) 000215[1] 1748984599.134118 write 0x81c22e thru 0x81dac0 (0x1893 bytes) 000216[1] 1748984599.142118 trunc from 0x81dac1 to 0x28302e (0x59aa92 bytes) 000217[0] 1748984599.158418 write 0x0baee3 thru 0x0bc346 (0x1464 bytes) 000218[0] 1748984599.175972 mapwrite 0x45b9db thru 0x45bd8f (0x3b5 bytes) 000219[0] 1748984599.213650 read 0x110f7e thru 0x112608 (0x168b bytes) 000221[0] 1748984599.247815 read 0x3d7cbd thru 0x3d8ae1 (0xe25 bytes) 000225[0] 1748984599.262805 write 0x606fa1 thru 0x608262 (0x12c2 bytes) 000227[1] 1748984599.271362 write 0x0b32cd thru 0x0b4f62 (0x1c96 bytes) 000228[1] 1748984599.291368 write 0x41505f thru 0x415a81 (0xa23 bytes) 000229[1] 1748984599.301977 mapwrite 0x524b0b thru 0x5250a0 (0x596 bytes) 000233[0] 1748984599.360892 write 0x8300fd thru 0x831766 (0x166a bytes) 000234[1] 1748984599.377944 mapwrite 0x8e7d52 thru 0x8e927a (0x1529 bytes) 000235[1] 1748984599.425829 write 0x618f36 thru 0x61a685 (0x1750 bytes) 000236[0] 1748984599.432715 trunc from 0x8e927b to 0x50aca7 (0x3de5d3 bytes) 000237[1] 1748984599.451581 mapread 0x504f39 thru 0x505c2e (0xcf6 bytes) 000239[0] 1748984599.479953 write 0x0771c4 thru 0x0780cf (0xf0c bytes) 000241[0] 1748984599.494281 trunc from 0x50aca8 to 0x643b2a (0x138e83 bytes) 000242[0] 1748984599.507254 write 0x014fc5 thru 0x01510d (0x149 bytes) 000244[0] 1748984599.528373 mapwrite 0x6f8092 thru 0x6f9a7f (0x19ee bytes) 000245[0] 1748984599.571438 read 0x4c9c76 thru 0x4cb652 (0x19dd bytes) 000248[1] 1748984599.601960 mapread 0x011994 thru 0x0137ac (0x1e19 bytes) 000250[1] 1748984599.633624 mapwrite 0x38ebcb thru 0x38fcb5 (0x10eb bytes) 000251[0] 1748984599.673942 write 0x9aeb8b thru 0x9aee8d (0x303 bytes) 000255[1] 1748984599.686793 write 0x023133 thru 0x024378 (0x1246 bytes) 000256[0] 1748984599.701206 mapwrite 0x306d2a thru 0x30880f (0x1ae6 bytes) 000257[1] 1748984599.739936 mapwrite 0x4f1659 thru 0x4f2e96 (0x183e bytes) 000258[0] 1748984599.776997 mapread 0x0fd4cb thru 0x0ff48f (0x1fc5 bytes) 000262[0] 1748984599.824069 write 0x0dccad thru 0x0de8f1 (0x1c45 bytes) 000263[0] 1748984599.842012 write 0x5400c9 thru 0x540edf (0xe17 bytes) 000265[0] 1748984599.860018 trunc from 0x9aee8e to 0x57e003 (0x430e8a bytes) 000267[0] 1748984599.882435 read 0x3ace1d thru 0x3ae67a (0x185e bytes) truncating to largest ever: 0x9be538 000268[0] 1748984599.897636 trunc from 0x57e004 to 0x9be537 (0x440534 bytes) 000270[1] 1748984599.917258 read 0x095a0e thru 0x0962af (0x8a2 bytes) 000271[1] 1748984599.942341 write 0x939d74 thru 0x93a7d7 (0xa64 bytes) 000273[0] 1748984600.004103 write 0x654d93 thru 0x655c38 (0xea6 bytes) 000274[0] 1748984600.026156 mapread 0x3d8ecc thru 0x3daa45 (0x1b7a bytes) 000275[1] 1748984600.078448 read 0x88b1ec thru 0x88ba14 (0x829 bytes) 000276[1] 1748984600.098469 mapread 0x2c09ec thru 0x2c0df7 (0x40c bytes) 000278[0] 1748984600.106174 mapread 0x7544d7 thru 0x755f5b (0x1a85 bytes) 000279[1] 1748984600.106887 trunc from 0x9be538 to 0x0d7652 (0x8e6ee5 bytes) 000281[1] 1748984600.128362 mapread 0x0c9821 thru 0x0caf82 (0x1762 bytes) 000282[0] 1748984600.133479 trunc from 0x0d7653 to 0x769f03 (0x6928b1 bytes) 000286[1] 1748984600.168400 mapread 0x55a228 thru 0x55b647 (0x1420 bytes) 000288[1] 1748984600.195253 trunc from 0x769f04 to 0x0e28ed (0x687616 bytes) 000289[0] 1748984600.210228 write 0x0be681 thru 0x0beebd (0x83d bytes) 000291[0] 1748984600.233110 trunc from 0x0e28ee to 0x3f21bd (0x30f8d0 bytes) 000292[0] 1748984600.245473 mapread 0x2bf344 thru 0x2c1269 (0x1f26 bytes) 000293[0] 1748984600.262823 mapread 0x2aa0bc thru 0x2ab0c9 (0x100e bytes) 000295[0] 1748984600.282887 mapwrite 0x280ee7 thru 0x281b56 (0xc70 bytes) 000302[1] 1748984600.341912 trunc from 0x3f21be to 0x7d3eb7 (0x3e1cfa bytes) 000303[0] 1748984600.359062 mapread 0x3a3a15 thru 0x3a4ebc (0x14a8 bytes) 000306[0] 1748984600.400111 write 0x4787f5 thru 0x4793aa (0xbb6 bytes) 000308[1] 1748984600.418270 trunc from 0x7d3eb8 to 0x86d006 (0x9914f bytes) 000309[1] 1748984600.436449 mapwrite 0x24e1fa thru 0x24e5ad (0x3b4 bytes) 000310[0] 1748984600.460992 read 0x788038 thru 0x789a47 (0x1a10 bytes) 000311[1] 1748984600.483022 trunc from 0x86d007 to 0x30928e (0x563d78 bytes) 000313[1] 1748984600.505831 write 0x2bba39 thru 0x2bbf64 (0x52c bytes) 000314[0] 1748984600.515282 mapwrite 0x08cc4e thru 0x08d57c (0x92f bytes) 000315[1] 1748984600.557758 mapread 0x1d0361 thru 0x1d1676 (0x1316 bytes) 000316[0] 1748984600.572811 trunc from 0x30928f to 0x099563 (0x26fd2b bytes) 000317[1] 1748984600.591016 mapwrite 0x0f9f74 thru 0x0fa167 (0x1f4 bytes) 000320[0] 1748984600.651686 mapread 0x007c21 thru 0x009aa8 (0x1e88 bytes) 000321[0] 1748984600.671987 write 0x8b49b7 thru 0x8b5d7f (0x13c9 bytes) 000323[0] 1748984600.695797 trunc from 0x8b5d80 to 0x6ce04d (0x1e7d32 bytes) 000326[1] 1748984600.728319 trunc from 0x6ce04e to 0x8475cf (0x179582 bytes) 000328[1] 1748984600.754934 trunc from 0x8475d0 to 0x5d9901 (0x26dcce bytes) 000329[1] 1748984600.770683 mapwrite 0x717512 thru 0x717a71 (0x560 bytes) 000330[0] 1748984600.804372 trunc from 0x717a72 to 0x945fee (0x22e57d bytes) 000331[0] 1748984600.827069 mapwrite 0x021eb4 thru 0x023017 (0x1164 bytes) 000332[0] 1748984600.870614 mapread 0x62b717 thru 0x62be27 (0x711 bytes) 000338[0] 1748984600.896599 trunc from 0x945fef to 0x3bb817 (0x58a7d7 bytes) 000341[1] 1748984600.917104 read 0x0eaa9e thru 0x0ebd9b (0x12fe bytes) 000343[0] 1748984600.932974 mapwrite 0x7b6a8e thru 0x7b7dca (0x133d bytes) 000344[1] 1748984600.980071 mapread 0x0bcf4d thru 0x0be91a (0x19ce bytes) 000345[1] 1748984601.001252 read 0x7a5c45 thru 0x7a71ff (0x15bb bytes) 000348[0] 1748984601.016493 mapread 0x79ca76 thru 0x79cfaf (0x53a bytes) 000349[1] 1748984601.019366 mapread 0x29860c thru 0x299ae0 (0x14d5 bytes) 000350[1] 1748984601.024122 read 0x5f7a92 thru 0x5f8442 (0x9b1 bytes) 000351[1] 1748984601.038182 trunc from 0x7b7dcb to 0x053f0c (0x763ebe bytes) 000354[1] 1748984601.066266 mapread 0x032c78 thru 0x0346f8 (0x1a81 bytes) 000356[1] 1748984601.073611 mapread 0x038fe3 thru 0x0394af (0x4cd bytes) 000358[0] 1748984601.085678 mapread 0x01b780 thru 0x01c7af (0x1030 bytes) 000359[0] 1748984601.099713 read 0x020123 thru 0x02186f (0x174d bytes) 000361[1] 1748984601.114148 mapwrite 0x5fec8f thru 0x5ffeb9 (0x122b bytes) 000362[0] 1748984601.153239 write 0x5166e5 thru 0x51777b (0x1097 bytes) 000363[1] 1748984601.166881 write 0x1799a1 thru 0x17ab25 (0x1185 bytes) 000364[1] 1748984601.182924 write 0x1a0c2d thru 0x1a173f (0xb13 bytes) 000366[0] 1748984601.197824 mapread 0x25c8d3 thru 0x25ca68 (0x196 bytes) 000367[0] 1748984601.217998 mapread 0x59e947 thru 0x59f142 (0x7fc bytes) 000368[0] 1748984601.268070 write 0x13f82c thru 0x140314 (0xae9 bytes) 000371[0] 1748984601.287798 mapwrite 0x047164 thru 0x048734 (0x15d1 bytes) 000374[1] 1748984601.337134 mapwrite 0x2dde63 thru 0x2df69d (0x183b bytes) 000375[1] 1748984601.382965 write 0x599cc0 thru 0x599de6 (0x127 bytes) 000376[1] 1748984601.399512 mapwrite 0x2f3c07 thru 0x2f46c2 (0xabc bytes) 000377[1] 1748984601.431007 trunc from 0x5ffeba to 0x44ed4b (0x1b116e bytes) 000378[1] 1748984601.440621 mapwrite 0x91f645 thru 0x920ed1 (0x188d bytes) 000380[1] 1748984601.485400 write 0x6dfbd2 thru 0x6dffcf (0x3fe bytes) 000383[1] 1748984601.497746 mapread 0x006af4 thru 0x007337 (0x844 bytes) 000386[0] 1748984601.510213 mapwrite 0x269929 thru 0x269a82 (0x15a bytes) 000388[1] 1748984601.556977 write 0x5c7ad2 thru 0x5c7fbe (0x4ed bytes) 000390[1] 1748984601.573458 trunc from 0x920ed2 to 0x30eb16 (0x6123bb bytes) 000391[1] 1748984601.593364 trunc from 0x30eb17 to 0x5e6e7d (0x2d8367 bytes) 000392[1] 1748984601.609321 mapwrite 0x384d0f thru 0x386b22 (0x1e14 bytes) 000393[0] 1748984601.644744 mapread 0x1dae5f thru 0x1db5e7 (0x789 bytes) 000395[0] 1748984601.668401 read 0x479512 thru 0x47a350 (0xe3f bytes) 000396[1] 1748984601.685180 mapwrite 0x10424c thru 0x105cfd (0x1ab2 bytes) 000397[0] 1748984601.720897 read 0x0ed86a thru 0x0ee79f (0xf36 bytes) 000398[1] 1748984601.732708 write 0x527c68 thru 0x528396 (0x72f bytes) 000399[0] 1748984601.745075 read 0x1ea024 thru 0x1ea40b (0x3e8 bytes) 000400[1] 1748984601.776142 mapwrite 0x693d8a thru 0x694b44 (0xdbb bytes) 000403[1] 1748984601.844005 mapread 0x524a0d thru 0x525f16 (0x150a bytes) 000406[1] 1748984601.866081 write 0x1b27bb thru 0x1b3c79 (0x14bf bytes) 000410[1] 1748984601.885633 mapwrite 0x9b970b thru 0x9babe8 (0x14de bytes) 000411[1] 1748984601.932444 mapwrite 0x69c098 thru 0x69c21e (0x187 bytes) 000412[1] 1748984601.956409 trunc from 0x9babe9 to 0x529c04 (0x490fe4 bytes) 000419[1] 1748984601.991054 write 0x138690 thru 0x13879b (0x10c bytes) 000424[0] 1748984602.009072 read 0x4ff2db thru 0x4ff7be (0x4e4 bytes) 000428[1] 1748984602.035068 read 0x3da7d5 thru 0x3db563 (0xd8f bytes) 000429[1] 1748984602.040102 mapwrite 0x0e1d6c thru 0x0e2d41 (0xfd6 bytes) 000431[0] 1748984602.068564 trunc from 0x529c05 to 0x8d5040 (0x3ab43c bytes) 000432[1] 1748984602.079787 trunc from 0x8d5041 to 0x550eb1 (0x38418f bytes) 000434[1] 1748984602.095627 mapread 0x267bc3 thru 0x267d79 (0x1b7 bytes) 000435[1] 1748984602.104141 trunc from 0x550eb2 to 0x627a05 (0xd6b54 bytes) 000436[0] 1748984602.110131 mapread 0x49aa0a thru 0x49c9bb (0x1fb2 bytes) 000437[1] 1748984602.128233 mapwrite 0x6ef299 thru 0x6ef2a3 (0xb bytes) 000438[1] 1748984602.155608 mapread 0x5a35e4 thru 0x5a4912 (0x132f bytes) 000441[0] 1748984602.165393 mapwrite 0x4f6c42 thru 0x4f7b21 (0xee0 bytes) 000443[1] 1748984602.192644 trunc from 0x6ef2a4 to 0x4facb1 (0x1f45f2 bytes) 000446[0] 1748984602.207739 mapread 0x0533c6 thru 0x0548b4 (0x14ef bytes) 000451[1] 1748984602.223598 mapwrite 0x10beaf thru 0x10cc13 (0xd65 bytes) 000452[1] 1748984602.241144 trunc from 0x4facb2 to 0x3e473d (0x116574 bytes) 000453[1] 1748984602.247314 write 0x1e6a41 thru 0x1e7568 (0xb28 bytes) 000455[0] 1748984602.254264 write 0x38487f thru 0x3853fd (0xb7f bytes) 000456[0] 1748984602.263834 read 0x08deae thru 0x08fd53 (0x1ea6 bytes) 000457[1] 1748984602.284985 mapread 0x1778eb thru 0x177f5d (0x673 bytes) 000459[1] 1748984602.302532 trunc from 0x3e473e to 0x8e9126 (0x5049e9 bytes) 000462[1] 1748984602.331640 mapwrite 0x1ab542 thru 0x1ad35e (0x1e1d bytes) 000463[1] 1748984602.361185 mapread 0x2f1c43 thru 0x2f3578 (0x1936 bytes) 000468[0] 1748984602.392370 trunc from 0x8e9127 to 0x2579c1 (0x691765 bytes) 000470[0] 1748984602.423394 trunc from 0x2579c2 to 0x5bd686 (0x365cc5 bytes) 000471[0] 1748984602.433621 mapread 0x09f924 thru 0x0a1027 (0x1704 bytes) 000472[1] 1748984602.458518 write 0x91bb4c thru 0x91bd76 (0x22b bytes) 000473[1] 1748984602.475460 write 0x59005d thru 0x5918e7 (0x188b bytes) 000476[0] 1748984602.501760 read 0x1dc078 thru 0x1dd412 (0x139b bytes) 000479[0] 1748984602.551621 trunc from 0x91bd77 to 0x371006 (0x5aad70 bytes) 000480[1] 1748984602.579778 mapwrite 0x19a09d thru 0x19bb1a (0x1a7e bytes) 000481[1] 1748984602.622908 mapwrite 0x554ca5 thru 0x555903 (0xc5f bytes) 000483[1] 1748984602.663953 write 0x00136b thru 0x002e22 (0x1ab8 bytes) 000485[0] 1748984602.678500 trunc from 0x555904 to 0x55bc44 (0x6341 bytes) 000486[0] 1748984602.696945 read 0x4ea8c4 thru 0x4eb5a6 (0xce3 bytes) 000487[0] 1748984602.702736 write 0x387740 thru 0x388909 (0x11ca bytes) 000488[0] 1748984602.707365 mapread 0x19f0a2 thru 0x1a04ca (0x1429 bytes) 000489[1] 1748984602.712484 mapwrite 0x10d70a thru 0x10f036 (0x192d bytes) 000490[1] 1748984602.760108 trunc from 0x55bc45 to 0x52bd34 (0x2ff10 bytes) 000491[1] 1748984602.773809 mapwrite 0x8eb036 thru 0x8eb122 (0xed bytes) 000493[1] 1748984602.819018 write 0x58f533 thru 0x590e75 (0x1943 bytes) 000496[1] 1748984602.833944 read 0x0a6f42 thru 0x0a7e34 (0xef3 bytes) 000497[0] 1748984602.884753 read 0x0be4ea thru 0x0bfac7 (0x15de bytes) 000498[1] 1748984602.911620 read 0x54afcf thru 0x54c8fa (0x192c bytes) 000500[0] 1748984602.914312 write 0x814f46 thru 0x815b0f (0xbca bytes) All operations completed A-OK! PASS 16b (9s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 17:03:24 (1748984604) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (1s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 17:03:26 (1748984606) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.121622 s, 17.2 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.093343 s, 22.5 MB/s ldlm.namespaces.MGC192.168.202.153@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b58e3000.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff88012a4d1800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b58e3000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b58e3000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 3.97888 s, 26.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.04482 s, 100 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.706125 s, 148 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.84938 s, 56.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.64929 s, 39.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.930343 s, 113 MB/s PASS 16d (15s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 17:03:41 (1748984621) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0810362 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427602 s, 24.5 MB/s PASS 16e (2s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 17:03:43 (1748984623) TIMEOUT PASS 16f (22s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 17:04:05 (1748984645) TIMEOUT PASS 16g (22s) == sanityn test 16i: read after truncate file ============ 17:04:27 (1748984667) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (2s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 17:04:29 (1748984669) fail_loc=0x8000030a PASS 17 (5s) == sanityn test 18: mmap sanity check =========================================================================================== 17:04:34 (1748984674) mmap test1: basic mmap operation (PASS, 0.02165s) mmap test2: MAP_PRIVATE not write back (PASS, 0.015543s) mmap test3: concurrent mmap ops on two nodes (PASS, 11.143s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.062s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.04213s) mmap test6: check mmap write/read content on two nodes (PASS, 0.048786s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0197s) PASS 18 (17s) == sanityn test 19: test concurrent uncached read races ========================================================================= 17:04:51 (1748984691) oleg253-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg253-client: oleg253-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 17:04:53 (1748984693) PASS 20 (2s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 17:04:55 (1748984695) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (2s) == sanityn test 23: others should see updated atime while another read============================================================== 17:04:57 (1748984697) now is 1748984698 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 new atime is 1748984759 PASS 23 (64s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 17:06:01 (1748984761) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.3K 376 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 230.2K 369 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 376 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 369 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 5.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 11.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118072 376 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235729 369 235360 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 376 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 369 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118072 376 117696 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre[OST:1] filesystem_summary: 235729 369 235360 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118072 376 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235729 369 235360 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 PASS 24a (2s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 17:06:03 (1748984763) PASS 24b (2s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 17:06:05 (1748984765) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (3s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 17:06:08 (1748984768) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (1s) == sanityn test 26a: allow mtime to get older ============ 17:06:09 (1748984769) utime: good mknod times 1748984768 <= 1748984769 <= 1748984769 for /mnt/lustre/f26a utime: good mknod times 1748984768 <= 1748984769 <= 1748984769 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (3s) == sanityn test 26b: sync mtime between ost and mds ====== 17:06:12 (1748984772) PASS 26b (4s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 17:06:17 (1748984777) 0 PASS 30 (4s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 17:06:21 (1748984781) fail_loc=0x314 PASS 31a (3s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 17:06:25 (1748984785) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg253-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.202.153@tcp:/lustre 7542784 12288 7526400 1% /mnt/lustre2 PASS 31b (13s) == sanityn test 31r: open-rename(replace) race =========== 17:06:37 (1748984797) -rw-r--r-- 1 root root 0 Jun 3 17:06 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (5s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 17:06:43 (1748984803) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (1s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 17:06:44 (1748984804) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 17:06:45 (1748984805) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (1s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 17:06:46 (1748984806) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (1s) == sanityn test 34: no lock timeout under IO ============= 17:06:47 (1748984807) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg253-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b58e3000.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012a4d1800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800b58e3000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff88012a4d1800.ost_server_uuid in FULL state after 0 sec oleg253-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b58e3000.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012a4d1800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800b58e3000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff88012a4d1800.ost_server_uuid in FULL state after 0 sec oleg253-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b58e3000.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012a4d1800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800b58e3000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff88012a4d1800.ost_server_uuid in IDLE state after 0 sec oleg253-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b58e3000.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012a4d1800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800b58e3000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff88012a4d1800.ost_server_uuid in IDLE state after 0 sec oleg253-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b58e3000.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012a4d1800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800b58e3000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff88012a4d1800.ost_server_uuid in IDLE state after 0 sec oleg253-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b58e3000.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012a4d1800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800b58e3000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff88012a4d1800.ost_server_uuid in IDLE state after 0 sec PASS 34 (79s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 17:08:06 (1748984886) fail_loc=0x80000317 Race attempt 0 Wait for 15606 15748 for 60 sec... - open/close 2523 (time 1748984898.52 total 10.00 last 252.24) total: 4000 open/close in 15.48 seconds: 258.48 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.202.153@tcp:/lustre 7.2G 12M 7.2G 1% /mnt/lustre 192.168.202.153@tcp:/lustre 7.2G 12M 7.2G 1% /mnt/lustre2 PASS 35 (64s) == sanityn test 36: handle ESTALE/open-unlink correctly == 17:09:10 (1748984950) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg253-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.22322 s, 235 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7526400) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.284179 s, 184 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7526400) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.213315 s, 246 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.201664 s, 260 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7524352) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.283798 s, 185 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7526400) after_dd(7471104) after(7522304) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.331042 s, 158 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7522304) after_dd(7471104) after(7522304) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.214797 s, 244 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7522304) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.279754 s, 187 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7526400) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.266883 s, 196 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7526400) after_dd(7469056) after(7520256) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.411083 s, 128 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7520256) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.266289 s, 197 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7526400) after_dd(7475200) after(7526400) PASS 36 (228s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 17:12:58 (1748985178) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 - create 8884 (time 1748985189.69 total 10.00 last 888.39) total: 10000 create in 11.85 seconds: 843.60 ops/second PASS 37 (15s) == sanityn test 39a: test from 11063 ============================================================================================ 17:13:13 (1748985193) repeat after cancel_lru_locks PASS 39a (3s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 17:13:16 (1748985196) repeat after cancel_lru_locks PASS 39b (3s) == sanityn test 39c: check truncate mtime update ================================================================================ 17:13:19 (1748985199) repeat after cancel_lru_locks PASS 39c (2s) == sanityn test 39d: sync write should update mtime ====== 17:13:21 (1748985201) fail_loc=0x411 fail_loc=0 PASS 39d (2s) == sanityn test 40a: pdirops: create vs others ======================================================================== 17:13:23 (1748985203) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (7s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 17:13:30 (1748985210) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (7s) == sanityn test 40c: pdirops: link and others ======================================================================== 17:13:37 (1748985217) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (6s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 17:13:43 (1748985223) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (7s) == sanityn test 40e: pdirops: rename and others ======================================================================== 17:13:50 (1748985230) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (6s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 17:13:56 (1748985236) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (5s) == sanityn test 41b: pdirops: create vs create ======================================================================== 17:14:01 (1748985241) open: File exists Conflict PASS 41b (6s) == sanityn test 41c: pdirops: create vs link ======================================================================== 17:14:07 (1748985247) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (5s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 17:14:12 (1748985252) Conflict PASS 41d (5s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 17:14:17 (1748985257) Conflict PASS 41e (6s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 17:14:23 (1748985263) Conflict PASS 41f (5s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 17:14:28 (1748985268) Conflict PASS 41g (5s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 17:14:33 (1748985273) Conflict PASS 41h (6s) == sanityn test 41i: reint_open: create vs create ======== 17:14:39 (1748985279) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (695s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 17:26:14 (1748985974) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (5s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 17:26:19 (1748985979) open: File exists Conflict PASS 42b (5s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 17:26:24 (1748985984) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (5s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 17:26:29 (1748985989) Conflict PASS 42d (6s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 17:26:35 (1748985995) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (5s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 17:26:40 (1748986000) Conflict PASS 42f (5s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 17:26:46 (1748986006) Conflict PASS 42g (6s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 17:26:51 (1748986011) Conflict PASS 42h (5s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 17:26:56 (1748986016) PASS 43a (18s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 17:27:14 (1748986034) Conflict PASS 43b (5s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 17:27:19 (1748986039) Conflict PASS 43c (5s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 17:27:25 (1748986045) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (5s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 17:27:30 (1748986050) Conflict PASS 43e (5s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 17:27:35 (1748986055) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (6s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 17:27:41 (1748986061) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (5s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 17:27:46 (1748986066) Conflict PASS 43h (5s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 17:27:51 (1748986071) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 17:27:52 (1748986072) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (44s) == sanityn test 43k: unlink vs create ==================== 17:28:37 (1748986117) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (440s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 17:35:56 (1748986556) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Tue Jun 3 17:36:00 EDT 2025 PASS 44a (5s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 17:36:01 (1748986561) open: File exists Conflict PASS 44b (6s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 17:36:07 (1748986567) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (5s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 17:36:12 (1748986572) Conflict PASS 44d (6s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 17:36:18 (1748986578) Conflict PASS 44e (5s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 17:36:23 (1748986583) Conflict PASS 44f (6s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 17:36:29 (1748986589) Conflict PASS 44g (5s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 17:36:34 (1748986594) Conflict PASS 44h (6s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 17:36:40 (1748986600) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 17:36:41 (1748986601) PASS 45a (35s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 17:37:16 (1748986636) Conflict PASS 45b (6s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 17:37:22 (1748986642) Conflict PASS 45c (5s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 17:37:27 (1748986647) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (5s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 17:37:32 (1748986652) Conflict PASS 45e (6s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 17:37:38 (1748986658) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (5s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 17:37:43 (1748986663) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (5s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 17:37:49 (1748986669) Conflict PASS 45h (5s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 17:37:53 (1748986673) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 17:37:54 (1748986674) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (459s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 17:45:33 (1748987133) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (6s) == sanityn test 46b: pdirops: link vs create ======================================================================== 17:45:39 (1748987139) open: File exists Conflict PASS 46b (5s) == sanityn test 46c: pdirops: link vs link ======================================================================== 17:45:44 (1748987144) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (5s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 17:45:49 (1748987149) Conflict PASS 46d (6s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 17:45:55 (1748987155) Conflict PASS 46e (5s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 17:46:00 (1748987160) Conflict PASS 46f (6s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 17:46:06 (1748987166) Conflict PASS 46g (5s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 17:46:11 (1748987171) Conflict PASS 46h (5s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 17:46:16 (1748987176) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 17:46:18 (1748987178) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 17:46:19 (1748987179) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 17:46:20 (1748987180) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (1s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 17:46:21 (1748987181) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 17:46:22 (1748987182) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 17:46:23 (1748987183) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 17:46:24 (1748987184) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 17:46:25 (1748987185) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00787682 s, 1.3 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (7s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 17:46:32 (1748987192) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00709442 s, 22.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3146: kill: (24646) - No such process PASS 51a (5s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 17:46:37 (1748987197) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00463855 s, 221 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204329 s, 51.3 MB/s 3145728 PASS 51b (14s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 17:46:51 (1748987211) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00674395 s, 152 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 17:46:58 (1748987218) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138045 s, 76.0 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 17:47:01 (1748987221) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2437 0x985 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2437 0x985 0 read lease(1) has applied. PASS 51e (4s) == sanityn test 54: rename locking ======================= 17:47:05 (1748987225) llite.lustre-ffff8800b58e3000.xattr_cache=1 llite.lustre-ffff88012a4d1800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504963 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-03 17:47:06.000000000 -0400 Modify: 2025-06-03 17:47:06.000000000 -0400 Change: 2025-06-03 17:47:06.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504966 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-03 17:47:11.000000000 -0400 Modify: 2025-06-03 17:47:11.000000000 -0400 Change: 2025-06-03 17:47:11.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504969 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-03 17:47:17.000000000 -0400 Modify: 2025-06-03 17:47:17.000000000 -0400 Change: 2025-06-03 17:47:17.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-03 17:47:17.000000000 -0400 Modify: 2025-06-03 17:47:17.000000000 -0400 Change: 2025-06-03 17:47:17.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504972 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-03 17:47:22.000000000 -0400 Modify: 2025-06-03 17:47:22.000000000 -0400 Change: 2025-06-03 17:47:22.000000000 -0400 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-03 17:47:22.000000000 -0400 Modify: 2025-06-03 17:47:22.000000000 -0400 Change: 2025-06-03 17:47:22.000000000 -0400 Birth: - PASS 54 (24s) == sanityn test 55a: rename vs unlink target dir ========= 17:47:29 (1748987249) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (8s) == sanityn test 55b: rename vs unlink source dir ========= 17:47:37 (1748987257) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (7s) == sanityn test 55c: rename vs unlink orphan target dir == 17:47:44 (1748987264) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (13s) == sanityn test 55d: rename file vs link ================= 17:47:57 (1748987277) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (10s) == sanityn test 60: Verify data_version behaviour ======== 17:48:07 (1748987287) PASS 60 (2s) == sanityn test 70a: cd directory && rm directory ======== 17:48:09 (1748987289) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 17:48:11 (1748987291) PASS 70b (3s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 17:48:14 (1748987294) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00430212 s, 15.2 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (1s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 17:48:15 (1748987295) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00638801 s, 10.3 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 17:48:16 (1748987296) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (1s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 17:48:17 (1748987297) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.0064211 s, 10.2 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 17:48:18 (1748987298) llite.lustre-ffff8800b58e3000.xattr_cache=1 llite.lustre-ffff88012a4d1800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (3s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 17:48:21 (1748987301) llite.lustre-ffff8800b58e3000.xattr_cache=1 llite.lustre-ffff88012a4d1800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (2s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 17:48:23 (1748987303) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00501904 s, 204 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00801435 s, 128 kB/s 3304: get lock2 3305: get lock1 3304: done 3304: get lock1 3305: done 3305: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 3305: cannot get lock2: Resource deadlock avoided 3305: exit rc=0 3304: done 3304: exit rc=0 PASS 74 (6s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 17:48:29 (1748987309) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0194088 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012393 s, 84.6 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3714: 3938 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (7s) == sanityn test 76: Verify MDT open_files listing ======== 17:48:36 (1748987316) opening files: ........ closing files: ........ PASS 76 (21s) == sanityn test 77a: check FIFO NRS policy =============== 17:48:57 (1748987337) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.112582 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00762406 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00607705 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010881 s, 96.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0261008 s, 40.2 MB/s , 0.0181982 s, 57.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277796 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252043 s, 41.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241962 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336407 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232342 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246246 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360817 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336571 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287646 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276856 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0308406 s, 34.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=3 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0109353 s, 95.9 MB/s , 0.0102052 s, 103 MB/s , 0.00898462 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144319 s, 72.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.013559 s, 77.3 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136591 s, 76.8 MB/s , 0.012652 s, 82.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0137218 s, 76.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119632 s, 87.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144502 s, 72.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121072 s, 86.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132896 s, 78.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122049 s, 85.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115654 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173954 s, 60.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175922 s, 59.6 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (3s) == sanityn test 77b: check CRR-N NRS policy ============== 17:49:00 (1748987340) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.144451 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151847 s, 69.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026759 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219364 s, 47.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306884 s, 34.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0307965 s, 34.0 MB/s , 0.0169071 s, 62.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0198396 s, 52.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180426 s, 58.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127466 s, 82.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310579 s, 33.8 MB/s 1+0 records in 1+0 records out ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203061 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264907 s, 39.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0519798 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0497333 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0546536 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0451045 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012387 s, 84.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015459 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141041 s, 74.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140906 s, 74.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124174 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142585 s, 73.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144609 s, 72.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137748 s, 76.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013915 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156932 s, 66.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158101 s, 66.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0159542 s, 65.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162272 s, 64.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0163806 s, 64.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159191 s, 65.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0178769 s, 58.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=4 removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.140263 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125145 s, 83.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237253 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228175 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236165 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263299 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270236 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240729 s, 43.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260858 s, 40.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0288153 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249263 s, 42.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155751 s, 67.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237268 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351207 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312984 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179783 s, 58.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187302 s, 56.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0104796 s, 100 MB/s 1048576 bytes (1.0 MB) copied, 0.00850225 s, 123 MB/s , 0.00597122 s, 176 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157859 s, 66.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012057 s, 87.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122215 s, 85.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121983 s, 86.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188611 s, 55.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00945861 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102898 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113122 s, 92.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116218 s, 90.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120975 s, 86.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126761 s, 82.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131084 s, 80.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013729 s, 76.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=2 removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (4s) == sanityn test 77c: check ORR NRS policy ================ 17:49:04 (1748987344) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.14366 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114125 s, 91.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152887 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208146 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330352 s, 31.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0379484 s, 27.6 MB/s , 0.0255267 s, 41.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0332582 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033479 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0471047 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0461528 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0403639 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0523573 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0463057 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0501664 s, 20.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=5 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03883 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449229 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162434 s, 64.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016284 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00933739 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00937636 s, 112 MB/s 1048576 bytes (1.0 MB) copied, 0.0114663 s, 91.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011941 s, 87.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158622 s, 66.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0132672 s, 79.0 MB/s 1048576 bytes (1.0 MB) copied, 0.013235 s, 79.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138372 s, 75.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156532 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140357 s, 74.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152013 s, 69.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.016069 s, 65.3 MB/s , 0.0160865 s, 65.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163552 s, 64.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=2 removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.115441 s, 145 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122551 s, 85.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0126207 s, 83.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017633 s, 59.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183763 s, 57.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136828 s, 76.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198178 s, 52.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267091 s, 39.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267244 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138678 s, 75.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176953 s, 59.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232162 s, 45.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192923 s, 54.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105237 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120549 s, 87.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163124 s, 64.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154985 s, 67.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116131 s, 90.3 MB/s , 0.0093997 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115442 s, 90.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0138343 s, 75.8 MB/s , 0.0129042 s, 81.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00912442 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00696468 s, 151 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00714826 s, 147 MB/s , 0.006997 s, 150 MB/s 1048576 bytes (1.0 MB) copied, 0.0075028 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00858 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00887325 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102221 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104532 s, 100 MB/s , 0.0104338 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119386 s, 87.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=4 removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.114735 s, 146 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174436 s, 60.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167868 s, 62.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396705 s, 26.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0439368 s, 23.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032551 s, 32.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0335554 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0494709 s, 21.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=4 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.043453 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424422 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0486173 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0484695 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0475452 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0530218 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0526018 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0493799 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0452983 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013906 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136777 s, 76.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140999 s, 74.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147517 s, 71.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119106 s, 88.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0182409 s, 57.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0160692 s, 65.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153443 s, 68.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146683 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150768 s, 69.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152884 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153696 s, 68.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167676 s, 62.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0171986 s, 61.0 MB/s , 0.0172485 s, 60.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177292 s, 59.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=3 removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (6s) == sanityn test 77d: check TRR nrs policy ================ 17:49:10 (1748987350) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.141656 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111873 s, 93.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151118 s, 69.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243238 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279597 s, 37.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252429 s, 41.5 MB/s 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0271501 s, 38.6 MB/s , 0.0222527 s, 47.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331635 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227601 s, 46.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275577 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311526 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250335 s, 41.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00796136 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111153 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242632 s, 43.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185854 s, 56.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00842369 s, 124 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0105031 s, 99.8 MB/s , 0.0129089 s, 81.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117825 s, 89.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00833367 s, 126 MB/s 1048576 bytes (1.0 MB) copied, 0.00661135 s, 159 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00788798 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0089675 s, 117 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=2 1048576 bytes (1.0 MB) copied, 0.011946 s, 87.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00948338 s, 111 MB/s , 0.0101686 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104852 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0112875 s, 92.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0113213 s, 92.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122411 s, 85.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125696 s, 83.4 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.136939 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127227 s, 82.4 MB/s , 0.0202767 s, 51.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246748 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0378065 s, 27.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0513023 s, 20.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0480978 s, 21.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0594622 s, 17.6 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0560107 s, 18.7 MB/s , 0.0484952 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0593846 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0577233 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0454961 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0560797 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0609779 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0678103 s, 15.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0575733 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125743 s, 83.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112076 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131305 s, 79.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160053 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181242 s, 57.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144311 s, 72.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185498 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144913 s, 72.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148351 s, 70.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149179 s, 70.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155951 s, 67.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155319 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157084 s, 66.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157976 s, 66.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166493 s, 63.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177234 s, 59.2 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.124309 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00921567 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133459 s, 78.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230699 s, 45.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273232 s, 38.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297617 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237194 s, 44.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0223689 s, 46.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145302 s, 72.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287286 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260129 s, 40.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315954 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362237 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197572 s, 53.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220588 s, 47.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175819 s, 59.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227773 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158251 s, 66.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00491358 s, 213 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00146203 s, 717 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00476567 s, 220 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177087 s, 59.2 MB/s , 0.0179772 s, 58.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00425468 s, 246 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0194953 s, 53.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101398 s, 103 MB/s , 0.0118515 s, 88.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00115044 s, 911 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00132331 s, 792 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00226017 s, 464 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00457586 s, 229 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00291764 s, 359 MB/s 1048576 bytes (1.0 MB) copied, 0.0206548 s, 50.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=5 removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (4s) == sanityn test 77e: check TBF NID nrs policy ============ 17:49:14 (1748987354) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.202.53@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.104629 s, 160 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801742 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125435 s, 83.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148426 s, 70.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00908707 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158052 s, 66.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252369 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281186 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115373 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0255326 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260745 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234741 s, 44.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145628 s, 72.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0305073 s, 34.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0239761 s, 43.7 MB/s , 0.0113376 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185337 s, 56.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108818 s, 96.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106858 s, 98.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163839 s, 64.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.014331 s, 73.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0161463 s, 64.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155193 s, 67.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0165723 s, 63.3 MB/s , 0.0165156 s, 63.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141824 s, 73.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0171603 s, 61.1 MB/s , 0.0175063 s, 59.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0168609 s, 62.2 MB/s , 0.0171385 s, 61.2 MB/s , 0.0159073 s, 65.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186902 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209327 s, 50.1 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.129567 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113343 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0088783 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148519 s, 70.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0199394 s, 52.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207787 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345482 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207058 s, 50.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.036772 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230693 s, 45.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0416888 s, 25.2 MB/s , 0.0278296 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0441536 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286881 s, 36.6 MB/s , 0.0423064 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312284 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0445674 s, 23.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015135 s, 69.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0208562 s, 50.3 MB/s , 0.0205826 s, 50.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146135 s, 71.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166922 s, 62.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0168749 s, 62.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0212081 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176656 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195301 s, 53.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0249921 s, 42.0 MB/s 1+0 records in 1+0 records out , 0.0194912 s, 53.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0188116 s, 55.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212659 s, 49.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.019563 s, 53.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0196708 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213701 s, 49.1 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.13012 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102474 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201301 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231129 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031777 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272455 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312919 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173156 s, 60.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027162 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0256272 s, 40.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0199563 s, 52.5 MB/s , 0.0335762 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0266457 s, 39.4 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0327623 s, 32.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285094 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372128 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407391 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00789556 s, 133 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0131918 s, 79.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0117169 s, 89.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00554024 s, 189 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00606613 s, 173 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00994702 s, 105 MB/s , 0.0122166 s, 85.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00732643 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00814805 s, 129 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00877677 s, 119 MB/s , 0.00885513 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00891394 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100701 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101858 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104855 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107592 s, 97.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=2 removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.131587 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142991 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123499 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103315 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142425 s, 73.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219357 s, 47.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188683 s, 55.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250847 s, 41.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170107 s, 61.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0294494 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00755718 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00911895 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306578 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0571734 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0530428 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135773 s, 77.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143295 s, 73.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00154818 s, 677 MB/s 1048576 bytes (1.0 MB) copied, 0.0435393 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113959 s, 92.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137488 s, 76.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0158403 s, 66.2 MB/s 1048576 bytes (1.0 MB) copied, 0.00171352 s, 612 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133759 s, 78.4 MB/s , 0.0130034 s, 80.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00751757 s, 139 MB/s 1048576 bytes (1.0 MB) copied, 0.014594 s, 71.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0701187 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196635 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00605052 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00154188 s, 680 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00132957 s, 789 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0015096 s, 695 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (8s) == sanityn test 77f: check TBF JobID nrs policy ========== 17:49:22 (1748987362) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.165877 s, 101 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108057 s, 97.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180635 s, 58.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018487 s, 56.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220921 s, 47.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495733 s, 21.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0494177 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0454601 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404971 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444656 s, 23.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0555545 s, 18.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0501765 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0468318 s, 22.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0476966 s, 22.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0451866 s, 23.2 MB/s , 0.0479254 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0505226 s, 20.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107979 s, 97.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154172 s, 68.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139416 s, 75.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129078 s, 81.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151701 s, 69.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0149991 s, 69.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0149913 s, 69.9 MB/s 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0170696 s, 61.4 MB/s , 0.0157098 s, 66.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102962 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172014 s, 61.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0156564 s, 67.0 MB/s , 0.0172345 s, 60.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016446 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178545 s, 58.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195387 s, 53.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.135177 s, 124 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144716 s, 72.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213079 s, 49.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268793 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210434 s, 49.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0205799 s, 51.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0167809 s, 62.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0223152 s, 47.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246003 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129081 s, 81.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297617 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0438549 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301881 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032994 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330629 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447047 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0674044 s, 15.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0151269 s, 69.3 MB/s , 0.00295537 s, 355 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130047 s, 80.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130956 s, 80.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147918 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151141 s, 69.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0154115 s, 68.0 MB/s , 0.01364 s, 76.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0146826 s, 71.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147717 s, 71.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00215945 s, 486 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0140062 s, 74.9 MB/s , 0.0147817 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171834 s, 61.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163875 s, 64.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180971 s, 57.9 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.140294 s, 120 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181951 s, 57.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129463 s, 81.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026819 s, 39.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0215327 s, 48.7 MB/s 1048576 bytes (1.0 MB) copied, 0.035529 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236665 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288339 s, 36.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0361421 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296195 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192839 s, 54.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331139 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254003 s, 41.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288227 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0350841 s, 29.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0407999 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396569 s, 26.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=3 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out , 0.0104682 s, 100 MB/s 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00974823 s, 108 MB/s , 0.0126188 s, 83.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116634 s, 89.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131716 s, 79.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168692 s, 62.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00209608 s, 500 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152212 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143898 s, 72.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142234 s, 73.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147023 s, 71.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164471 s, 63.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.013492 s, 77.7 MB/s , 0.0138497 s, 75.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147008 s, 71.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172411 s, 60.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.115624 s, 145 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00808543 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00938268 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015305 s, 68.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287386 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230254 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302543 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246616 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358394 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345288 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249208 s, 42.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0355075 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273629 s, 38.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314096 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307104 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294149 s, 35.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329045 s, 31.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00689238 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00364754 s, 287 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00908011 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116089 s, 90.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00126694 s, 828 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00734203 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00133709 s, 784 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00843463 s, 124 MB/s , 0.00697438 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00110959 s, 945 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190969 s, 54.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00123669 s, 848 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.010179 s, 103 MB/s , 0.0118385 s, 88.6 MB/s , 0.00968099 s, 108 MB/s 1048576 bytes (1.0 MB) copied, 0.00266642 s, 393 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=1 removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (8s) == sanityn test 77g: Change TBF type directly ============ 17:49:30 (1748987370) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (4s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 17:49:34 (1748987374) oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg253-client: oleg253-server: ssh exited with exit code 2 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 12 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 12 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 12 PASS 77h (4s) == sanityn test 77i: Change rank of TBF rule ============= 17:49:38 (1748987378) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (8s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 17:49:46 (1748987386) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.107822 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159297 s, 65.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267134 s, 39.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307208 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0282089 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297582 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226199 s, 46.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295355 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232589 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225135 s, 46.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0476002 s, 22.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0375277 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447907 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351171 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389025 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384845 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369963 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172412 s, 60.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154252 s, 68.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0167392 s, 62.6 MB/s 1048576 bytes (1.0 MB) copied, 0.016559 s, 63.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181576 s, 57.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187396 s, 56.0 MB/s , 0.0183052 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0206785 s, 50.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0207663 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234326 s, 44.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216035 s, 48.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362734 s, 28.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0377672 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241186 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239499 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268222 s, 39.1 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95306 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.442 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (55s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 17:50:41 (1748987441) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.665037 s, 25.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.149643 s, 7.0 MB/s , 0.14658 s, 7.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.143141 s, 7.3 MB/s , 0.144536 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155362 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155941 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.161076 s, 6.5 MB/s , 0.172926 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.349815 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.365839 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.371568 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.379469 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.393839 s, 2.7 MB/s , 0.368631 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.372658 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.391026 s, 2.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127106 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129369 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125102 s, 8.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.132352 s, 7.9 MB/s , 0.12607 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127091 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132987 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131351 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12982 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13022 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130541 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130935 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129396 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130514 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131385 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13388 s, 7.8 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7065 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9332 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.663638 s, 25.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.150654 s, 7.0 MB/s , 0.152765 s, 6.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.147472 s, 7.1 MB/s , 0.161936 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.165615 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150223 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.167824 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154064 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.351416 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.362559 s, 2.9 MB/s , 0.372198 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.361033 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.390034 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.394442 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.380717 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.378451 s, 2.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127951 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128444 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125818 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129499 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130506 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13241 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127911 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128478 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130534 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129563 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129175 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130469 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129096 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129592 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129988 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133411 s, 7.9 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.697 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9353 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (135s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 17:52:56 (1748987576) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.212821 s, 78.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187516 s, 55.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0113415 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260728 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286138 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214183 s, 49.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116484 s, 90.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305394 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150948 s, 69.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0580093 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0662058 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0593894 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0687233 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0920322 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0903772 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0751684 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0789444 s, 13.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131793 s, 79.6 MB/s , 0.0152435 s, 68.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135314 s, 77.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143474 s, 73.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152729 s, 68.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168571 s, 62.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138606 s, 75.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0150866 s, 69.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0140665 s, 74.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00581547 s, 180 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0187618 s, 55.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0146935 s, 71.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017239 s, 60.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174632 s, 60.0 MB/s 1048576 bytes (1.0 MB) copied, 0.00722081 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177248 s, 59.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96079 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74202 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.202.53@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.202.53@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.207661 s, 80.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01196 s, 87.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00749002 s, 140 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0205902 s, 50.9 MB/s , 0.00796005 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196939 s, 53.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179735 s, 58.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00921501 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237382 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0589037 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0803193 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0858941 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0730593 s, 14.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.146269 s, 7.2 MB/s , 0.142623 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.257324 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.249227 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110817 s, 94.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01205 s, 87.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130225 s, 80.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117497 s, 89.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180551 s, 58.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014613 s, 71.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152833 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170017 s, 61.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0152539 s, 68.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0154323 s, 67.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017365 s, 60.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178194 s, 58.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0180184 s, 58.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0168417 s, 62.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183116 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205665 s, 51.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96444 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74391 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.202.53@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.213725 s, 78.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203879 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147541 s, 71.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265448 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155449 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200351 s, 52.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177422 s, 59.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176546 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146374 s, 71.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567203 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0811093 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0793506 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0713577 s, 14.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0884401 s, 11.9 MB/s , 0.0741071 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0850344 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0934485 s, 11.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151023 s, 69.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115178 s, 91.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145789 s, 71.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133756 s, 78.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130499 s, 80.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0137008 s, 76.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00290048 s, 362 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163954 s, 64.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0169395 s, 61.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139828 s, 75.0 MB/s , 0.0168093 s, 62.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156451 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015373 s, 68.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00274448 s, 382 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161617 s, 64.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195929 s, 53.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95918 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.89546 s, 21.4 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.361543 s, 46.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201353 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336958 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385719 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304078 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044858 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0477871 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0417077 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.042536 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152521 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17969 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169752 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.167714 s, 6.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.318589 s, 3.3 MB/s , 0.300928 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.353108 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.344528 s, 3.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126287 s, 83.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012702 s, 82.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141902 s, 73.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315957 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162434 s, 64.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0196748 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0175566 s, 59.7 MB/s 1048576 bytes (1.0 MB) copied, 0.017725 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211218 s, 49.6 MB/s 1048576 bytes (1.0 MB) copied, 0.019214 s, 54.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0344416 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020023 s, 52.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361182 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02006 s, 52.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202482 s, 51.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204927 s, 51.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80468 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74322 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95282 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74402 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.660501 s, 25.4 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192311 s, 54.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193578 s, 54.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131641 s, 79.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188552 s, 55.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229141 s, 45.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00982404 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185531 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360732 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.352813 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.362599 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.369222 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.364735 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.372065 s, 2.8 MB/s , 0.387389 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.390137 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.394735 s, 2.7 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101316 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118776 s, 88.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177571 s, 59.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146365 s, 71.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00972821 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122726 s, 85.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0156737 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177046 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202551 s, 51.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143669 s, 73.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016936 s, 61.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159994 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157948 s, 66.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0175975 s, 59.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168645 s, 62.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189486 s, 55.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7061 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4444 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.215259 s, 77.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146436 s, 71.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023925 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283938 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0381556 s, 27.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0222141 s, 47.2 MB/s , 0.0127937 s, 82.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221231 s, 47.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190398 s, 55.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0554015 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0528828 s, 19.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0693527 s, 15.1 MB/s 1+0 records in 1+0 records out , 0.0654212 s, 16.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0728737 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0768109 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.088524 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0785723 s, 13.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.012413 s, 84.5 MB/s , 0.0163382 s, 64.2 MB/s 1+0 records in 1+0 records out , 0.0122939 s, 85.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0149013 s, 70.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014793 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00787538 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148676 s, 70.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152345 s, 68.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00948553 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176856 s, 59.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176156 s, 59.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172838 s, 60.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00548097 s, 191 MB/s , 0.0169992 s, 61.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0163598 s, 64.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188522 s, 55.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96105 s, 21.1 MB/s Write runtime is 5 s, speed is 20.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74399 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.360556 s, 46.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253627 s, 41.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345345 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259537 s, 40.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0377861 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251355 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226598 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027976 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024688 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151827 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145828 s, 7.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.331683 s, 3.2 MB/s 1048576 bytes (1.0 MB) copied, 0.349793 s, 3.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.360229 s, 2.9 MB/s , 0.351747 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.38773 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.401989 s, 2.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124395 s, 84.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0137312 s, 76.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0159608 s, 65.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144234 s, 72.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0171383 s, 61.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188793 s, 55.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169961 s, 61.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0180624 s, 58.1 MB/s , 0.0204561 s, 51.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165799 s, 63.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0196824 s, 53.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0194125 s, 54.0 MB/s , 0.0193736 s, 54.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0433411 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209674 s, 50.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022331 s, 47.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg253-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80589 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74263 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80062 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74288 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (362s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 17:58:58 (1748987938) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (3s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 17:59:02 (1748987942) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg253-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 4.02774 s, 260 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg253-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0151 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (52s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 17:59:53 (1748987993) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.150951 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192033 s, 54.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01999 s, 52.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418469 s, 25.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0397578 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0561624 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0492225 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0534714 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0590611 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0630986 s, 16.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0589563 s, 17.8 MB/s , 0.05808 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0648141 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0663306 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0522252 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495753 s, 21.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a4d1800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567826 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106869 s, 98.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00711555 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00567046 s, 185 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00201176 s, 521 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113635 s, 92.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0099329 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126113 s, 83.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00687329 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113624 s, 92.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00862007 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00941125 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106471 s, 98.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108112 s, 97.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114054 s, 91.9 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff88012a4d1800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01674 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00336307 s, 312 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97195 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97612 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.212555 s, 78.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277175 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0474763 s, 22.1 MB/s , 0.029195 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291056 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0531427 s, 19.7 MB/s , 0.04561 s, 23.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.102627 s, 10.2 MB/s , 0.099351 s, 10.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.133903 s, 7.8 MB/s , 0.147157 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188035 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.195227 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.250538 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.248264 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.33338 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.333734 s, 3.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01272 s, 82.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0102564 s, 102 MB/s , 0.0164516 s, 63.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166264 s, 63.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011703 s, 89.6 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143705 s, 73.0 MB/s , 0.0161991 s, 64.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160059 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184794 s, 56.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015256 s, 68.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155714 s, 67.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176956 s, 59.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178129 s, 58.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174767 s, 60.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0199886 s, 52.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212404 s, 49.4 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg253-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg253-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96022 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97414 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (69s) == sanityn test 77o: Changing rank should not panic ====== 18:01:02 (1748988062) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (4s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 18:01:06 (1748988066) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_policies=fifo PASS 77q (35s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 18:01:41 (1748988101) mds.MDS.mdt.nrs_policies=tbf oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg253-client: oleg253-server: ssh exited with exit code 36 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg253-client: oleg253-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (13s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 18:01:54 (1748988114) oleg253-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: Resource temporarily unavailable pdsh@oleg253-client: oleg253-server: ssh exited with exit code 11 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (3s) == sanityn test 79: xattr: intent error ================== 18:01:58 (1748988118) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505431 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-03 18:01:58.000000000 -0400 Modify: 2025-06-03 18:01:58.000000000 -0400 Change: 2025-06-03 18:01:58.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (13s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 18:02:10 (1748988130) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 18:02:11 (1748988131) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 18:02:13 (1748988133) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 18:02:14 (1748988134) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 18:02:15 (1748988135) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 18:02:16 (1748988136) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6850 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6850 PASS 82 (2s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 18:02:18 (1748988138) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 18:02:19 (1748988139) fail_loc=0x8000060b PASS 84 (8s) == sanityn test 90: open/create and unlink striped directory ========================================================== 18:02:27 (1748988147) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 18:02:28 (1748988148) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 18:02:29 (1748988149) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (1s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 18:02:30 (1748988150) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2627 0xa43 0 0 2647 0xa57 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2628 0xa44 0 0 2648 0xa58 0 rc1=0 and rc2=0 PASS 93 (9s) == sanityn test 94: signal vs CP callback race =========== 18:02:39 (1748988159) osc.lustre-OST0000-osc-ffff8800b58e3000.idle_timeout=0 osc.lustre-OST0000-osc-ffff88012a4d1800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b58e3000.idle_timeout=0 osc.lustre-OST0001-osc-ffff88012a4d1800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.0626412 s, 131 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.00267 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5135: 4881 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0235449 s, 174 kB/s osc.lustre-OST0000-osc-ffff8800b58e3000.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012a4d1800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b58e3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a4d1800.idle_timeout=debug PASS 94 (11s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 18:02:50 (1748988170) llite.lustre-ffff8800b58e3000.fast_read=0 llite.lustre-ffff88012a4d1800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00294408 s, 4.2 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800b58e3000.fast_read=1 llite.lustre-ffff88012a4d1800.fast_read=1 PASS 95b (8s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 18:02:58 (1748988178) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 18:02:59 (1748988179) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00289652 s, 1.4 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (3s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 18:03:02 (1748988182) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0298615 s, 70.2 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (2s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 18:03:04 (1748988184) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0298045 s, 70.4 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (3s) == sanityn test 100e: DoM: read on open and file size ==== 18:03:07 (1748988187) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.0030252 s, 4.0 MB/s PASS 100e (2s) == sanityn test 101a: Discard DoM data on unlink ========= 18:03:09 (1748988189) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00075044 s, 5.5 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 18:03:11 (1748988191) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00081657 s, 5.0 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 18:03:14 (1748988194) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000778731 s, 5.3 MB/s PASS 101c (3s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 18:03:17 (1748988197) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1748988198 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1748988201 Finishing test test23 at 1748988201 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 18:03:25 (1748988205) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 18:03:26 (1748988206) fail_loc=0x416 PASS 105 (48s) == sanityn test 106a: Verify the btime via statx() ======= 18:04:14 (1748988254) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 18:04:15 (1748988255) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 18:04:16 (1748988256) SKIP: sanityn test_106c statx() only test SKIP 106c (1s) == sanityn test 107a: Basic grouplock conflict =========== 18:04:17 (1748988257) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.074631 s, 141 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2633 0xa49 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 18:04:22 (1748988262) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0771906 s, 136 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2654 0xa5e 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6850 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) == sanityn test 108a: lseek: parallel updates ============ 18:04:30 (1748988270) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.0028777 s, 3.5 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.26585 s, 2.0 MB/s PASS 108a (7s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 18:04:37 (1748988277) 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 11 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 19 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 25 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 26 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 27 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 30 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 33 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 37 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 45 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 48 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions oleg253-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 49 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 192.168.202.153@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.153@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg253-client.virtnet /mnt/lustre (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre Starting client: oleg253-client.virtnet: -o user_xattr,flock oleg253-server@tcp:/lustre /mnt/lustre2 PASS 109 (472s) == sanityn test 110: do not grant another lock on resend ========================================================== 18:12:29 (1748988749) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-03 18:12:30.000000000 -0400 Modify: 2025-06-03 18:12:30.000000000 -0400 Change: 2025-06-03 18:12:30.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg253-client.virtnet oleg253-client.virtnet PASS 110 (36s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 18:13:05 (1748988785) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 18:13:06 (1748988786) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 18:13:08 (1748988788) lustre-OST0000-osc-ffff8800a8b4b000 active. lustre-OST0001-osc-ffff8800a8b4b000 active. lustre-OST0000-osc-ffff8800a8b4b000 active. lustre-OST0001-osc-ffff8800a8b4b000 active. MGC192.168.202.153@tcp active. PASS 113 (3s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 18:13:10 (1748988790) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (1s) cleanup: ====================================================== == sanityn test complete, duration 4464 sec ============== 18:13:12 (1748988792) Stopping clients: oleg253-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg253-client.virtnet /mnt/lustre2 opts: