-----============= acceptance-small: sanityn ============----- Fri Dec 5 07:15:49 EST 2025 oleg257-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Started clients oleg257-client.virtnet: 192.168.202.157@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) oleg257-client.virtnet: executing check_config_client /mnt/lustre oleg257-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg257-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9134c2bc3000.idle_timeout=debug osc.lustre-OST0000-osc-ffff9134d13ea800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9134c2bc3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9134d13ea800.idle_timeout=debug disable quota as required oleg257-server: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218122 s, 48.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7141] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 07:16:30 (1764936990) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (8s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 07:16:38 (1764936998) -rw-r--r-- 1 root root 0 Dec 5 07:16 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (6s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 07:16:44 (1764937004) -rw-r--r-- 1 root root 0 Dec 5 07:16 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (6s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 07:16:50 (1764937010) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (9s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 07:16:59 (1764937019) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (8s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 07:17:07 (1764937027) total 1 -rwxrwxrwx 1 root root 0 Dec 5 07:16 f2a -rwxrwxrwx 1 root root 0 Dec 5 07:16 f2b total 1 -rwxrwxrwx 1 root root 0 Dec 5 07:16 f2a -rwxrwxrwx 1 root root 0 Dec 5 07:16 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.0164452 s, 31.1 kB/s PASS 2e (6s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 07:17:14 (1764937034) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (3s) == sanityn test 2g: check blocks update on sync write ==== 07:17:17 (1764937037) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.399437 s, 5.3 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (7s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 07:17:24 (1764937044) PASS 3 (6s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 07:17:30 (1764937050) PASS 4 (6s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 07:17:37 (1764937057) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (6s) == sanityn test 6: remove of open file on other node ============================================================================ 07:17:44 (1764937064) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (6s) == sanityn test 7: remove of open directory on other node ======================================================================= 07:17:51 (1764937071) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (6s) == sanityn test 8: remove of open special file on other node ==================================================================== 07:17:57 (1764937077) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (5s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 07:18:02 (1764937082) PASS 9a (5s) == sanityn test 9b: append to striped sparse file ======== 07:18:07 (1764937087) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425771 s, 24.6 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.0687129 s, 0.0 kB/s Data read (expecting 'foo'): foo PASS 9b (6s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 07:18:13 (1764937093) 1+0 records in 1+0 records out 1 byte copied, 0.0044552 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00857962 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0124018 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0053262 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00745346 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0051779 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0054811 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0128109 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00724356 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0122211 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00663041 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00436204 s, 0.2 kB/s PASS 10a (6s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 07:18:19 (1764937099) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0234855 s, 131 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0547153 s, 74.9 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.000788745 s, 3.9 MB/s PASS 10b (5s) == sanityn test 11: execution of file opened for write should return error ============================================================== 07:18:24 (1764937104) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (6s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 07:18:30 (1764937110) warning: '-runtime' deprecated, use '-t runtime' instead - link 382 (time 1764937122.45 total 10.00 last 38.18) - link 738 (time 1764937132.47 total 20.02 last 35.55) - link 1143 (time 1764937142.47 total 30.02 last 40.48) - link 1553 (time 1764937152.47 total 40.02 last 41.00) - link 1938 (time 1764937162.49 total 50.04 last 38.43) - link 2292 (time 1764937172.50 total 60.05 last 35.37) - link 2610 (time 1764937182.53 total 70.08 last 31.72) - link 2916 (time 1764937192.55 total 80.10 last 30.53) - link 3234 (time 1764937202.55 total 90.10 last 31.78) total: 3592 link in 100.01 seconds: 35.92 ops/second using seed 2667024199 running for 100 seconds - stat 10000 (time 1764937122 ; total 9 ; last 9) - stat 20000 (time 1764937131 ; total 18 ; last 9) - stat 30000 (time 1764937138 ; total 25 ; last 7) - stat 40000 (time 1764937145 ; total 32 ; last 7) - stat 50000 (time 1764937152 ; total 39 ; last 7) - stat 60000 (time 1764937160 ; total 47 ; last 8) - stat 68590 (time 1764937171 ; total 58 ; last 11) - stat 70000 (time 1764937173 ; total 60 ; last 2) - stat 75351 (time 1764937184 ; total 71 ; last 11) - stat 80000 (time 1764937192 ; total 79 ; last 8) - stat 85485 (time 1764937203 ; total 90 ; last 11) - stat 90000 (time 1764937210 ; total 97 ; last 7) total: 91730 stats in 100 seconds: 917.299988 stats/second - unlinked 0 (time 1764937163 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile3592) error: No such file or directory total: 3591 unlinks in 90 seconds: 39.900002 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (19720) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (19722) - No such process PASS 12 (149s) == sanityn test 13: test directory page revocation ======= 07:20:59 (1764937259) f13 f13 PASS 13 (9s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 07:21:08 (1764937268) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4298: 20894 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (6s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 07:21:14 (1764937274) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4298: 21467 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (6s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 07:21:20 (1764937280) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 22040 Terminated $DIR1/$tdir/sleep 60 PASS 14b (6s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 07:21:26 (1764937286) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 22616 Terminated $DIR1/$tdir/sleep 60 PASS 14c (7s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 07:21:33 (1764937293) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 23192 Terminated $DIR1/$tdir/sleep 60 PASS 14d (7s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 07:21:40 (1764937300) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7519232 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7519232kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (20s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 07:22:00 (1764937320) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.381764 s, 5.5 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.270049 s, 7.8 MB/s Chance of close/open is 1 in 50 Seed set to 7323 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x5ed6e6 000015[1] 1764937324.559081 trunc from 00000000 to 0x5ed6e5 (0x5ed6e6 bytes) 000018[0] 1764937324.649987 mapwrite 0x4cc6b6 thru 0x4d3506 (0x6e51 bytes) 000020[1] 1764937324.901146 mapwrite 0x8e4d9e thru 0x8e9851 (0x4ab4 bytes) 000022[0] 1764937325.086759 trunc from 0x8e9852 to 0x44c4d7 (0x49d37a bytes) 000023[1] 1764937325.216154 read 0x18ac2a thru 0x18be3a (0x1211 bytes) 000029[1] 1764937325.414785 mapread 0x3d9683 thru 0x3ddd5d (0x46db bytes) 000033[1] 1764937325.486450 mapwrite 0x717e81 thru 0x7279d1 (0xfb51 bytes) 000034[0] 1764937325.748029 trunc from 0x7279d2 to 0x3c6283 (0x36174e bytes) 000035[1] 1764937325.795041 write 0x5e07db thru 0x5eb2fe (0xab24 bytes) 000036[1] 1764937325.855987 mapread 0x40b1a1 thru 0x40d30c (0x216c bytes) 000037[0] 1764937325.921271 trunc from 0x5eb2ff to 0x0ebcf6 (0x4ff608 bytes) 000039[1] 1764937326.000432 mapwrite 0x531978 thru 0x5397e6 (0x7e6f bytes) 000040[0] 1764937326.212445 write 0x3f7133 thru 0x406ddf (0xfcad bytes) 000041[0] 1764937326.257452 read 0x07427b thru 0x07b1f0 (0x6f76 bytes) 000043[1] 1764937326.327772 mapwrite 0x5d2402 thru 0x5d2e6a (0xa69 bytes) 000045[1] 1764937326.532638 read 0x090601 thru 0x09909d (0x8a9d bytes) 000046[0] 1764937326.711791 read 0x122b22 thru 0x1326c7 (0xfba6 bytes) 000047[1] 1764937326.787423 mapread 0x194856 thru 0x19af58 (0x6703 bytes) 000048[1] 1764937326.892070 read 0x314c04 thru 0x31574d (0xb4a bytes) 000049[0] 1764937327.002214 write 0x5b116f thru 0x5b8ece (0x7d60 bytes) 000052[0] 1764937327.093913 write 0x084df3 thru 0x085f45 (0x1153 bytes) 000056[1] 1764937327.267235 read 0x1143fa thru 0x11cefd (0x8b04 bytes) 000057[0] 1764937327.370650 mapread 0x28921d thru 0x293abb (0xa89f bytes) 000059[1] 1764937327.373285 read 0x5a6dfc thru 0x5b5515 (0xe71a bytes) 000060[0] 1764937327.427560 mapwrite 0x07c7fe thru 0x07ec1b (0x241e bytes) 000061[1] 1764937327.524167 write 0x735d55 thru 0x740ceb (0xaf97 bytes) 000063[0] 1764937327.582839 read 0x4d7d0e thru 0x4dcdab (0x509e bytes) 000065[0] 1764937327.628189 write 0x44136c thru 0x450005 (0xec9a bytes) 000066[1] 1764937327.651828 read 0x5ba6d4 thru 0x5bc12a (0x1a57 bytes) 000067[0] 1764937327.683574 read 0x64b717 thru 0x651396 (0x5c80 bytes) 000069[1] 1764937327.751885 mapread 0x022d93 thru 0x032117 (0xf385 bytes) 000070[1] 1764937327.979325 write 0x9c3db4 thru 0x9d1438 (0xd685 bytes) 000072[0] 1764937328.013220 trunc from 0x9d1439 to 0x1d69ee (0x7faa4a bytes) 000073[0] 1764937328.078773 mapwrite 0x36fe3d thru 0x379539 (0x96fd bytes) 000074[0] 1764937328.313074 mapwrite 0x0fa88d thru 0x0fac8c (0x400 bytes) 000076[0] 1764937328.492211 mapread 0x314072 thru 0x31faea (0xba79 bytes) truncating to largest ever: 0x6e9df5 000078[1] 1764937328.638428 trunc from 0x37953a to 0x6e9df4 (0x3708bb bytes) 000079[0] 1764937328.689675 mapwrite 0x364170 thru 0x36c9e1 (0x8872 bytes) 000080[0] 1764937328.866573 mapread 0x47ac3a thru 0x47f5ed (0x49b4 bytes) 000081[0] 1764937328.947827 trunc from 0x6e9df5 to 0x12e8d9 (0x5bb51b bytes) 000084[1] 1764937329.041778 trunc from 0x12e8da to 0x10864b (0x2628e bytes) 000085[0] 1764937329.106659 mapread 0x038dc7 thru 0x03ad32 (0x1f6c bytes) 000086[1] 1764937329.152872 read 0x051df0 thru 0x0565bf (0x47d0 bytes) 000088[1] 1764937329.207779 read 0x077ea6 thru 0x07a899 (0x29f4 bytes) 000091[0] 1764937329.235403 write 0x126b1e thru 0x130bf7 (0xa0da bytes) 000092[0] 1764937329.266539 mapwrite 0x81831e thru 0x8241d5 (0xbeb8 bytes) 000093[0] 1764937329.426550 mapread 0x36cc4d thru 0x36fad0 (0x2e84 bytes) 000094[1] 1764937329.447233 mapread 0x7a4b34 thru 0x7ae5ea (0x9ab7 bytes) truncating to largest ever: 0x7f4bdc 000097[0] 1764937329.637265 trunc from 0x8241d6 to 0x7f4bdb (0x2f5fa bytes) truncating to largest ever: 0x9ad6fd 000102[1] 1764937329.751331 trunc from 0x7f4bdc to 0x9ad6fc (0x1b8b21 bytes) 000106[0] 1764937329.901847 write 0x495741 thru 0x4a2290 (0xcb50 bytes) 000108[0] 1764937329.964388 trunc from 0x9ad6fd to 0x3cbf98 (0x5e1764 bytes) 000109[0] 1764937329.991783 write 0x3eb7af thru 0x3f1ce1 (0x6533 bytes) 000110[0] 1764937329.992792 trunc from 0x3f1ce2 to 0x788ee3 (0x397202 bytes) 000111[1] 1764937330.031734 read 0x5f455c thru 0x5fcb7e (0x8623 bytes) 000112[0] 1764937330.085932 mapwrite 0x52a942 thru 0x538c51 (0xe310 bytes) 000114[0] 1764937330.359224 mapread 0x32a8c3 thru 0x332d94 (0x84d2 bytes) 000115[1] 1764937330.420071 read 0x41c81e thru 0x429ae5 (0xd2c8 bytes) 000116[0] 1764937330.463705 mapread 0x215775 thru 0x220a66 (0xb2f2 bytes) 000118[0] 1764937330.626386 read 0x5da8a7 thru 0x5e9409 (0xeb63 bytes) 000120[1] 1764937330.710804 mapread 0x2c0c11 thru 0x2c3bdd (0x2fcd bytes) 000121[0] 1764937330.749054 read 0x3f6cad thru 0x40315a (0xc4ae bytes) 000124[0] 1764937330.813948 mapread 0x444ba7 thru 0x44ab9d (0x5ff7 bytes) 000126[1] 1764937330.816202 read 0x72f8c8 thru 0x72ff47 (0x680 bytes) 000127[0] 1764937330.860034 mapread 0x255635 thru 0x256ddb (0x17a7 bytes) 000128[0] 1764937330.874059 trunc from 0x788ee4 to 0x5a6675 (0x1e286e bytes) 000129[1] 1764937330.933604 read 0x06c762 thru 0x079fb7 (0xd856 bytes) 000130[0] 1764937330.989690 write 0x49f635 thru 0x49fa07 (0x3d3 bytes) 000131[0] 1764937331.017161 mapread 0x08d335 thru 0x092bed (0x58b9 bytes) 000132[1] 1764937331.123028 trunc from 0x5a6676 to 0x954d46 (0x3ae6d1 bytes) 000133[1] 1764937331.183394 trunc from 0x954d47 to 0x8b9a6a (0x9b2dc bytes) 000141[0] 1764937331.287620 mapwrite 0x47db32 thru 0x48bf9b (0xe46a bytes) 000142[0] 1764937331.459254 mapread 0x02155f thru 0x021909 (0x3ab bytes) 000144[0] 1764937331.507028 mapwrite 0x7b498c thru 0x7b6c4f (0x22c4 bytes) 000146[1] 1764937331.592764 mapwrite 0x1db0b7 thru 0x1ea2ec (0xf236 bytes) 000147[1] 1764937331.748677 write 0x14ba2d thru 0x151caa (0x627e bytes) 000148[0] 1764937331.763355 mapwrite 0x1b673e thru 0x1c63ea (0xfcad bytes) 000149[1] 1764937332.026012 read 0x73808f thru 0x73a390 (0x2302 bytes) 000152[1] 1764937332.106571 read 0x4f6d49 thru 0x4fdb4f (0x6e07 bytes) 000153[1] 1764937332.176354 mapread 0x841abc thru 0x84853e (0x6a83 bytes) 000156[1] 1764937332.178554 read 0x76bef2 thru 0x77be80 (0xff8f bytes) 000157[0] 1764937332.178993 read 0x092d5e thru 0x09f59c (0xc83f bytes) 000158[0] 1764937332.249949 trunc from 0x8b9a6b to 0x0ea33d (0x7cf72d bytes) 000159[0] 1764937332.390604 write 0x9ec972 thru 0x9f435f (0x79ee bytes) 000162[1] 1764937332.443576 read 0x531d32 thru 0x53b207 (0x94d6 bytes) 000164[0] 1764937332.520975 mapread 0x11ae05 thru 0x123c1f (0x8e1b bytes) 000165[0] 1764937332.616232 mapwrite 0x4097b6 thru 0x413b4f (0xa39a bytes) 000169[0] 1764937332.765609 mapread 0x819933 thru 0x81995a (0x28 bytes) 000177[1] 1764937332.817491 mapwrite 0x7f579a thru 0x802898 (0xd0ff bytes) 000179[0] 1764937333.105169 write 0x6be975 thru 0x6c8f8c (0xa618 bytes) 000181[0] 1764937333.174096 trunc from 0x9f4360 to 0x755acb (0x29e894 bytes) 000182[0] 1764937333.234565 write 0x0b33bf thru 0x0bed6e (0xb9b0 bytes) 000183[0] 1764937333.250895 mapwrite 0x31a398 thru 0x3251c2 (0xae2b bytes) 000185[1] 1764937333.375143 trunc from 0x755acc to 0x8ce7ae (0x178ce3 bytes) 000186[0] 1764937333.446000 mapwrite 0x4c954f thru 0x4d1cf8 (0x87aa bytes) 000188[1] 1764937333.617784 mapread 0x06c049 thru 0x06d37e (0x1336 bytes) 000189[0] 1764937333.657515 trunc from 0x8ce7af to 0x7932b5 (0x13b4f9 bytes) 000190[0] 1764937333.727758 mapread 0x3847f3 thru 0x384946 (0x154 bytes) 000191[1] 1764937333.757199 mapread 0x4dad2a thru 0x4e7924 (0xcbfb bytes) 000192[1] 1764937333.877982 write 0x7a801a thru 0x7b0743 (0x872a bytes) 000193[0] 1764937333.906848 write 0x411aaf thru 0x414022 (0x2574 bytes) 000194[0] 1764937333.957948 write 0x49e7a3 thru 0x49f671 (0xecf bytes) 000198[0] 1764937334.022862 write 0x9e4410 thru 0x9f305a (0xec4b bytes) 000199[0] 1764937334.063176 trunc from 0x9f305b to 0x08bc05 (0x967455 bytes) 000200[0] 1764937334.111808 read 0x02a3f1 thru 0x0391cf (0xeddf bytes) 000201[0] 1764937334.131345 write 0x6733fc thru 0x678ad6 (0x56db bytes) 000203[1] 1764937334.170403 mapwrite 0x3b6c4f thru 0x3bcd7a (0x612c bytes) 000206[1] 1764937334.510854 read 0x292fa4 thru 0x297ea8 (0x4f05 bytes) 000208[1] 1764937334.613983 trunc from 0x678ad7 to 0x70ea2b (0x95f55 bytes) 000210[1] 1764937334.707527 write 0x1f6ba5 thru 0x1ff77d (0x8bd9 bytes) 000211[1] 1764937334.748239 mapwrite 0x075585 thru 0x07b4f4 (0x5f70 bytes) 000212[1] 1764937334.859255 mapwrite 0x2d5b1e thru 0x2db4df (0x59c2 bytes) 000213[0] 1764937334.949093 trunc from 0x70ea2c to 0x3a7438 (0x3675f3 bytes) 000214[0] 1764937335.015966 mapread 0x2785a1 thru 0x27b3a6 (0x2e06 bytes) 000216[0] 1764937335.067496 mapwrite 0x193420 thru 0x198c5a (0x583b bytes) 000217[1] 1764937335.171411 mapwrite 0x066e1f thru 0x06ae34 (0x4016 bytes) truncating to largest ever: 0x9b0f01 000218[0] 1764937335.310092 trunc from 0x3a7439 to 0x9b0f00 (0x609ac8 bytes) 000219[0] 1764937335.385221 mapread 0x0f7b0b thru 0x1005c3 (0x8ab9 bytes) 000223[0] 1764937335.476851 mapwrite 0x5b920f thru 0x5c829b (0xf08d bytes) 000225[1] 1764937335.738814 read 0x65a0cd thru 0x65d791 (0x36c5 bytes) 000226[1] 1764937335.780605 read 0x2e901e thru 0x2f29bd (0x99a0 bytes) 000228[0] 1764937335.816531 mapwrite 0x332036 thru 0x33fe46 (0xde11 bytes) 000236[1] 1764937335.994985 mapwrite 0x5e71e2 thru 0x5e9ca2 (0x2ac1 bytes) 000238[0] 1764937336.203924 mapwrite 0x7b8667 thru 0x7ba216 (0x1bb0 bytes) 000240[1] 1764937336.380788 mapwrite 0x5c6aeb thru 0x5cfc14 (0x912a bytes) 000241[1] 1764937336.595744 read 0x4a8061 thru 0x4b593f (0xd8df bytes) 000244[1] 1764937336.668135 mapread 0x0db129 thru 0x0db78b (0x663 bytes) 000248[1] 1764937336.746880 read 0x97d73e thru 0x98b25e (0xdb21 bytes) 000249[1] 1764937336.747489 mapwrite 0x4e61b2 thru 0x4f5efb (0xfd4a bytes) 000250[0] 1764937337.066515 write 0x4b3584 thru 0x4b80dd (0x4b5a bytes) 000251[0] 1764937337.101662 write 0x507d07 thru 0x50cbad (0x4ea7 bytes) 000254[0] 1764937337.153703 mapread 0x17318c thru 0x17fbcd (0xca42 bytes) 000255[0] 1764937337.272409 write 0x0e3462 thru 0x0e3513 (0xb2 bytes) 000260[1] 1764937337.384513 write 0x2ab157 thru 0x2b0c06 (0x5ab0 bytes) 000263[1] 1764937337.488178 read 0x4a04e5 thru 0x4a0f8f (0xaab bytes) 000270[1] 1764937337.646412 trunc from 0x9b0f01 to 0x598f8d (0x417f73 bytes) 000272[1] 1764937337.712720 read 0x0fe7bf thru 0x107a50 (0x9292 bytes) 000275[0] 1764937337.804102 read 0x1d0da5 thru 0x1da5c4 (0x9820 bytes) 000276[0] 1764937337.848474 mapwrite 0x489819 thru 0x48b6ec (0x1ed4 bytes) 000277[0] 1764937338.027851 mapread 0x3eafd7 thru 0x3f7e96 (0xcec0 bytes) 000278[0] 1764937338.056278 read 0x2520fe thru 0x254bba (0x2abd bytes) 000280[0] 1764937338.057101 read 0x49e9a4 thru 0x4a2d75 (0x43d2 bytes) 000281[0] 1764937338.073012 mapread 0x48a61a thru 0x4918ee (0x72d5 bytes) 000282[1] 1764937338.073798 mapwrite 0x72616b thru 0x730de2 (0xac78 bytes) 000283[0] 1764937338.204765 write 0x0e4db6 thru 0x0e822d (0x3478 bytes) 000284[1] 1764937338.270448 mapwrite 0x67e232 thru 0x681ad3 (0x38a2 bytes) 000286[1] 1764937338.434621 read 0x5f79db thru 0x5fbafb (0x4121 bytes) 000288[0] 1764937338.486980 write 0x1c5f05 thru 0x1d3e4b (0xdf47 bytes) 000289[0] 1764937338.526018 trunc from 0x730de3 to 0x4339ba (0x2fd428 bytes) 000291[1] 1764937338.600102 read 0x2bc8b7 thru 0x2bddf0 (0x153a bytes) 000293[1] 1764937338.689728 mapread 0x0d8bca thru 0x0e527c (0xc6b3 bytes) 000295[1] 1764937338.827730 mapwrite 0x7eaba1 thru 0x7f3056 (0x84b6 bytes) 000298[1] 1764937339.076825 read 0x5388c1 thru 0x53a7b7 (0x1ef7 bytes) 000301[0] 1764937339.157571 write 0x0b991b thru 0x0bb349 (0x1a2f bytes) 000303[1] 1764937339.206938 write 0x92f100 thru 0x93a211 (0xb112 bytes) 000305[1] 1764937339.248703 mapwrite 0x509d8e thru 0x518559 (0xe7cc bytes) 000306[1] 1764937339.346706 read 0x59507e thru 0x59c7b8 (0x773b bytes) 000307[0] 1764937339.363831 mapread 0x28cf2c thru 0x296d36 (0x9e0b bytes) 000310[1] 1764937339.475185 mapread 0x081853 thru 0x082302 (0xab0 bytes) 000311[0] 1764937339.566891 trunc from 0x93a212 to 0x3956e1 (0x5a4b30 bytes) 000316[1] 1764937339.701178 trunc from 0x3956e2 to 0x0ecdf1 (0x2a88f0 bytes) 000319[1] 1764937339.752173 read 0x029ad4 thru 0x035186 (0xb6b3 bytes) 000321[0] 1764937339.774178 mapwrite 0x130989 thru 0x136ba9 (0x6221 bytes) 000326[0] 1764937340.119852 read 0x027255 thru 0x02b75c (0x4508 bytes) 000327[1] 1764937340.168565 trunc from 0x136baa to 0x745b3f (0x60ef96 bytes) 000328[1] 1764937340.271287 mapwrite 0x68018b thru 0x6814c0 (0x1336 bytes) 000330[1] 1764937340.420889 mapwrite 0x3bcd0d thru 0x3c5762 (0x8a56 bytes) 000333[0] 1764937340.517342 read 0x53ae35 thru 0x549873 (0xea3f bytes) 000334[1] 1764937340.580043 write 0x018594 thru 0x01cd53 (0x47c0 bytes) 000335[0] 1764937340.650479 write 0x160828 thru 0x16c7ca (0xbfa3 bytes) 000336[1] 1764937340.710450 read 0x01e816 thru 0x02d483 (0xec6e bytes) 000337[0] 1764937340.759588 mapread 0x10dbc8 thru 0x11b45e (0xd897 bytes) 000339[1] 1764937340.959485 trunc from 0x745b40 to 0x14ebdc (0x5f6f63 bytes) 000341[1] 1764937341.011974 mapwrite 0x8fac24 thru 0x901903 (0x6ce0 bytes) 000344[1] 1764937341.387389 trunc from 0x901904 to 0x1bbdd6 (0x745b2d bytes) 000346[0] 1764937341.468870 trunc from 0x1bbdd7 to 0x928c2f (0x76ce59 bytes) 000347[0] 1764937341.551806 read 0x04dba6 thru 0x05920a (0xb665 bytes) 000348[0] 1764937341.701542 trunc from 0x928c30 to 0x700984 (0x2282ab bytes) 000349[0] 1764937341.737218 read 0x17060b thru 0x17cd90 (0xc786 bytes) 000350[0] 1764937341.770712 read 0x57672f thru 0x582776 (0xc048 bytes) 000351[1] 1764937341.771246 trunc from 0x700985 to 0x6b5101 (0x4b883 bytes) 000354[1] 1764937341.898615 write 0x238106 thru 0x24544b (0xd346 bytes) 000357[0] 1764937341.954474 mapwrite 0x43256c thru 0x438d30 (0x67c5 bytes) 000358[0] 1764937342.161416 mapwrite 0x7e26c0 thru 0x7f03d9 (0xdd1a bytes) 000359[1] 1764937342.403632 trunc from 0x7f03da to 0x76b78f (0x84c4a bytes) 000360[1] 1764937342.472897 write 0x4631d5 thru 0x4724a5 (0xf2d1 bytes) 000361[1] 1764937342.507095 mapread 0x464e58 thru 0x466c87 (0x1e30 bytes) 000362[1] 1764937342.512744 write 0x69c57c thru 0x6a8353 (0xbdd8 bytes) 000365[0] 1764937342.553795 read 0x107ba3 thru 0x11135b (0x97b9 bytes) 000369[1] 1764937342.660833 write 0x1e2ebd thru 0x1e50ab (0x21ef bytes) 000371[0] 1764937342.722493 mapwrite 0x5bed47 thru 0x5ca99b (0xbc55 bytes) 000372[0] 1764937342.967627 write 0x8d466f thru 0x8d8e31 (0x47c3 bytes) 000373[0] 1764937342.991191 read 0x50b1f8 thru 0x50c53d (0x1346 bytes) 000374[0] 1764937343.059756 trunc from 0x8d8e32 to 0x47a542 (0x45e8ef bytes) 000375[0] 1764937343.106523 mapwrite 0x1a42d5 thru 0x1af52a (0xb256 bytes) 000377[1] 1764937343.337177 write 0x761972 thru 0x767e82 (0x6511 bytes) 000378[0] 1764937343.382115 mapread 0x1c8d47 thru 0x1d7ca4 (0xef5e bytes) 000379[0] 1764937343.560929 read 0x6b67b7 thru 0x6bab95 (0x43df bytes) 000380[1] 1764937343.597768 read 0x0d346f thru 0x0d43d2 (0xf64 bytes) 000382[0] 1764937343.703682 write 0x53524e thru 0x53d1f8 (0x7fab bytes) 000383[0] 1764937343.747218 write 0x46a44e thru 0x4744d1 (0xa084 bytes) 000385[0] 1764937343.797699 write 0x595a95 thru 0x5a0d53 (0xb2bf bytes) 000386[1] 1764937343.816709 read 0x32c7ad thru 0x32cc92 (0x4e6 bytes) 000387[0] 1764937343.882094 write 0x2b9676 thru 0x2c65c3 (0xcf4e bytes) 000388[0] 1764937343.900285 mapwrite 0x7ea028 thru 0x7f6e6c (0xce45 bytes) 000389[0] 1764937344.064733 mapread 0x56d574 thru 0x56fcc5 (0x2752 bytes) 000390[1] 1764937344.081206 mapwrite 0x6f0a92 thru 0x6f58a6 (0x4e15 bytes) 000392[1] 1764937344.309782 write 0x65359a thru 0x65908c (0x5af3 bytes) 000393[0] 1764937344.337595 mapwrite 0x545354 thru 0x54708a (0x1d37 bytes) 000396[0] 1764937344.496188 write 0x476e5d thru 0x485106 (0xe2aa bytes) 000397[0] 1764937344.556064 mapwrite 0x9784c4 thru 0x979bcb (0x1708 bytes) 000398[0] 1764937344.652948 trunc from 0x979bcc to 0x94c18f (0x2da3c bytes) 000399[0] 1764937344.671788 mapread 0x08e98d thru 0x08fece (0x1542 bytes) 000403[0] 1764937344.733501 write 0x0ea307 thru 0x0f9b3d (0xf837 bytes) 000407[1] 1764937344.763804 mapread 0x7642dd thru 0x76cf6a (0x8c8e bytes) 000408[1] 1764937344.892089 mapwrite 0x780bfe thru 0x7836cf (0x2ad2 bytes) 000410[1] 1764937345.035380 write 0x8b82a7 thru 0x8c3214 (0xaf6e bytes) 000412[1] 1764937345.129826 read 0x2d61b5 thru 0x2dce84 (0x6cd0 bytes) 000413[1] 1764937345.189578 read 0x22c1b3 thru 0x23a8cc (0xe71a bytes) 000415[0] 1764937345.241384 mapwrite 0x72ab06 thru 0x72ea55 (0x3f50 bytes) 000416[0] 1764937345.431037 mapread 0x0ee790 thru 0x0f3b56 (0x53c7 bytes) 000418[1] 1764937345.591260 trunc from 0x94c190 to 0x68b9c6 (0x2c07c9 bytes) 000419[0] 1764937345.635040 trunc from 0x68b9c7 to 0x3df946 (0x2ac080 bytes) 000421[0] 1764937345.699724 trunc from 0x3df947 to 0x7f4c44 (0x4152fe bytes) 000423[1] 1764937345.777913 mapread 0x0fb072 thru 0x10adc8 (0xfd57 bytes) 000427[1] 1764937345.929530 write 0x3da1a1 thru 0x3e8616 (0xe476 bytes) 000428[0] 1764937345.984817 mapwrite 0x3c7caf thru 0x3d4df5 (0xd147 bytes) 000429[0] 1764937346.169714 mapwrite 0x1795e4 thru 0x17fcc8 (0x66e5 bytes) 000430[0] 1764937346.284478 trunc from 0x7f4c45 to 0x0df287 (0x7159bd bytes) 000431[0] 1764937346.366482 write 0x980e5e thru 0x988f62 (0x8105 bytes) 000434[1] 1764937346.424236 write 0x34ded8 thru 0x35d5da (0xf703 bytes) 000436[0] 1764937346.518807 mapread 0x852523 thru 0x860a94 (0xe572 bytes) 000441[0] 1764937346.957425 write 0x10e9af thru 0x11cd48 (0xe39a bytes) 000442[1] 1764937347.005218 trunc from 0x988f63 to 0x3d863d (0x5b0925 bytes) 000443[1] 1764937347.066033 read 0x07e7cb thru 0x07fceb (0x1521 bytes) 000446[1] 1764937347.176875 write 0x47fc81 thru 0x489ed7 (0xa257 bytes) 000450[1] 1764937347.179612 mapread 0x3a8822 thru 0x3a8ab1 (0x290 bytes) 000452[1] 1764937347.180478 mapwrite 0x67a3d2 thru 0x68a0e3 (0xfd12 bytes) 000454[0] 1764937347.509858 write 0x7e8ff7 thru 0x7ee322 (0x532c bytes) 000456[0] 1764937347.590851 write 0x0518d3 thru 0x057236 (0x5964 bytes) 000459[0] 1764937347.725929 write 0x64a7da thru 0x651ae1 (0x7308 bytes) 000462[0] 1764937347.776031 mapread 0x5a13df thru 0x5aebfc (0xd81e bytes) 000463[1] 1764937347.887090 mapread 0x2ef0c8 thru 0x2f7cbc (0x8bf5 bytes) 000464[1] 1764937348.008207 trunc from 0x7ee323 to 0x62aa5b (0x1c38c7 bytes) 000465[1] 1764937348.069098 read 0x4e4c15 thru 0x4e99c1 (0x4dad bytes) 000466[1] 1764937348.104169 write 0x590236 thru 0x59690c (0x66d7 bytes) 000467[1] 1764937348.144047 trunc from 0x62aa5c to 0x1b381f (0x47723c bytes) 000468[1] 1764937348.175109 write 0x570470 thru 0x57727c (0x6e0d bytes) 000469[0] 1764937348.210279 mapread 0x39f322 thru 0x3a658d (0x726c bytes) 000470[0] 1764937348.283813 trunc from 0x57727d to 0x66c6b2 (0xf5436 bytes) 000471[0] 1764937348.335552 write 0x711026 thru 0x712c0f (0x1bea bytes) 000473[1] 1764937348.366063 read 0x4e6f9b thru 0x4f00fa (0x9160 bytes) 000474[1] 1764937348.415688 write 0x4bf500 thru 0x4c5a1d (0x651e bytes) 000479[1] 1764937348.566400 mapread 0x27ad4c thru 0x27d5cc (0x2881 bytes) 000481[0] 1764937348.632435 read 0x3ba888 thru 0x3bc8ae (0x2027 bytes) 000485[1] 1764937348.764842 mapread 0x27ef81 thru 0x28d692 (0xe712 bytes) 000486[1] 1764937348.997281 mapwrite 0x2a23a3 thru 0x2a8a03 (0x6661 bytes) 000487[1] 1764937349.149183 mapread 0x199c4d thru 0x1a2c3c (0x8ff0 bytes) 000488[1] 1764937349.346111 mapwrite 0x381295 thru 0x38f926 (0xe692 bytes) 000492[0] 1764937349.704567 mapwrite 0x5edd0d thru 0x5f6c53 (0x8f47 bytes) 000493[0] 1764937349.954922 trunc from 0x712c10 to 0x8c93e0 (0x1b67d1 bytes) 000494[1] 1764937350.026388 mapwrite 0x175bcc thru 0x178d0f (0x3144 bytes) 000496[1] 1764937350.195117 mapread 0x5047e7 thru 0x508d39 (0x4553 bytes) 000497[1] 1764937350.283873 mapwrite 0x594f3c thru 0x59eb50 (0x9c15 bytes) 000500[0] 1764937350.584472 trunc from 0x8c93e1 to 0x909912 (0x40532 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 7350 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000003[1] 1764937351.274867 mapwrite 0x334000 thru 0x3412f4 (0xd2f5 bytes) 000004[1] 1764937351.545806 mapread 0x0a0000 thru 0x0aac03 (0xac04 bytes) truncating to largest ever: 0x1966f9 000005[1] 1764937351.578035 trunc from 0x3412f5 to 0x1966f8 (0x1aabfc bytes) 000008[1] 1764937351.671835 mapwrite 0x160000 thru 0x16511b (0x511c bytes) truncating to largest ever: 0x9596a3 000009[0] 1764937351.794156 trunc from 0x1966f9 to 0x9596a2 (0x7c2faa bytes) 000010[1] 1764937351.836975 mapread 0x238000 thru 0x239880 (0x1881 bytes) 000011[0] 1764937351.911873 write 0x03a000 thru 0x045a88 (0xba89 bytes) 000013[0] 1764937351.980865 write 0x15a000 thru 0x15ea71 (0x4a72 bytes) 000015[0] 1764937352.040017 read 0x0b8000 thru 0x0c2b30 (0xab31 bytes) 000021[0] 1764937352.139547 mapwrite 0x3af000 thru 0x3b0e64 (0x1e65 bytes) 000024[1] 1764937352.251396 read 0x421000 thru 0x422071 (0x1072 bytes) 000027[0] 1764937352.276458 trunc from 0x9596a3 to 0x63dd15 (0x31b98d bytes) 000028[1] 1764937352.310585 mapwrite 0x27b000 thru 0x287656 (0xc657 bytes) 000029[1] 1764937352.476005 write 0x351000 thru 0x359aa7 (0x8aa8 bytes) 000032[0] 1764937352.508856 mapwrite 0x547000 thru 0x5504e3 (0x94e4 bytes) 000033[1] 1764937352.665028 write 0x947000 thru 0x947b59 (0xb5a bytes) 000034[1] 1764937352.712909 write 0x475000 thru 0x4753c3 (0x3c4 bytes) 000038[0] 1764937352.760248 mapread 0x938000 thru 0x941663 (0x9664 bytes) 000041[0] 1764937352.821084 read 0x272000 thru 0x276e57 (0x4e58 bytes) 000043[1] 1764937352.952031 trunc from 0x947b5a to 0x048eb5 (0x8feca4 bytes) 000045[0] 1764937353.058157 write 0x293000 thru 0x29c447 (0x9448 bytes) 000047[1] 1764937353.070741 read 0x14e000 thru 0x157a41 (0x9a42 bytes) 000049[1] 1764937353.153948 read 0x14b000 thru 0x157950 (0xc951 bytes) 000050[0] 1764937353.169073 read 0x277000 thru 0x2807e6 (0x97e7 bytes) 000051[1] 1764937353.183424 mapread 0x0a4000 thru 0x0af3c9 (0xb3ca bytes) 000053[1] 1764937353.245565 read 0x0eb000 thru 0x0ecd56 (0x1d57 bytes) 000055[0] 1764937353.266751 trunc from 0x29c448 to 0x620d3a (0x3848f3 bytes) 000058[1] 1764937353.371409 read 0x331000 thru 0x333d51 (0x2d52 bytes) 000061[0] 1764937353.473768 mapwrite 0x0b0000 thru 0x0bb0f4 (0xb0f5 bytes) 000066[0] 1764937353.829423 mapread 0x3d5000 thru 0x3dd4ae (0x84af bytes) 000073[1] 1764937353.863776 write 0x1f3000 thru 0x1f5f4d (0x2f4e bytes) 000074[0] 1764937353.933046 write 0x64c000 thru 0x65716d (0xb16e bytes) 000075[1] 1764937353.995214 read 0x0e8000 thru 0x0e9dc7 (0x1dc8 bytes) 000077[0] 1764937354.131158 mapread 0x2b7000 thru 0x2c510f (0xe110 bytes) 000079[0] 1764937354.367970 mapread 0x467000 thru 0x46c72d (0x572e bytes) 000081[1] 1764937354.402566 mapwrite 0x4cc000 thru 0x4db4fe (0xf4ff bytes) 000083[1] 1764937354.551796 write_OD 0x21d000 thru 0x22afff (0xe000 bytes) 000084[1] 1764937354.623540 read_OD 0x551000 thru 0x55efff (0xe000 bytes) 000085[1] 1764937354.637111 mapwrite 0x398000 thru 0x3a1e51 (0x9e52 bytes) 000088[1] 1764937354.766887 write_OD 0x1ab000 thru 0x1b0fff (0x6000 bytes) 000090[0] 1764937354.834902 mapread 0x205000 thru 0x20dabf (0x8ac0 bytes) 000091[1] 1764937354.890780 trunc from 0x65716e to 0x63f65e (0x17b0f bytes) 000092[0] 1764937354.955708 write 0x352000 thru 0x3551ff (0x3200 bytes) 000093[0] 1764937355.001230 trunc from 0x63f65f to 0x18a9ab (0x4b4cb3 bytes) 000094[0] 1764937355.047046 write 0x135000 thru 0x139a1b (0x4a1c bytes) 000095[0] 1764937355.067647 read 0x15d000 thru 0x163e0a (0x6e0b bytes) 000096[0] 1764937355.085637 trunc from 0x18a9ac to 0x3a8870 (0x21dec5 bytes) 000097[1] 1764937355.145756 mapread 0x011000 thru 0x013ddc (0x2ddd bytes) 000102[0] 1764937355.223919 mapwrite 0x6e2000 thru 0x6e30b4 (0x10b5 bytes) truncating to largest ever: 0x9a1fad 000103[1] 1764937355.480191 trunc from 0x6e30b5 to 0x9a1fac (0x2beef8 bytes) 000106[1] 1764937355.594100 mapread 0x8e0000 thru 0x8e78eb (0x78ec bytes) 000107[1] 1764937355.618684 write_OD 0x1e6000 thru 0x1f3fff (0xe000 bytes) 000110[0] 1764937355.691536 mapread 0x566000 thru 0x568f46 (0x2f47 bytes) 000112[1] 1764937355.786594 mapread 0x661000 thru 0x664435 (0x3436 bytes) 000115[0] 1764937355.806043 read 0x72d000 thru 0x73030b (0x330c bytes) 000116[0] 1764937355.806481 mapread 0x27a000 thru 0x286837 (0xc838 bytes) 000117[1] 1764937355.899451 read_OD 0x14a000 thru 0x150fff (0x7000 bytes) 000119[1] 1764937355.920119 mapread 0x3cb000 thru 0x3d5c44 (0xac45 bytes) 000122[0] 1764937356.064402 trunc from 0x9a1fad to 0x2f469b (0x6ad911 bytes) 000126[0] 1764937356.203168 mapread 0x2e1000 thru 0x2f0bf7 (0xfbf8 bytes) 000127[1] 1764937356.357198 read_OD 0x1e0000 thru 0x1ebfff (0xc000 bytes) 000130[1] 1764937356.419685 mapread 0x04c000 thru 0x053127 (0x7128 bytes) 000133[0] 1764937356.540706 mapwrite 0x262000 thru 0x26ce98 (0xae99 bytes) 000134[1] 1764937356.737883 trunc from 0x2f469c to 0x89f750 (0x5ab0b5 bytes) 000135[0] 1764937356.814865 mapwrite 0x3f4000 thru 0x3fb66b (0x766c bytes) 000136[0] 1764937357.045394 trunc from 0x89f751 to 0x53b7db (0x363f75 bytes) 000137[1] 1764937357.061740 mapread 0x434000 thru 0x43fe1f (0xbe20 bytes) truncating to largest ever: 0x9fab72 000138[1] 1764937357.140028 trunc from 0x53b7dc to 0x9fab71 (0x4bf396 bytes) 000139[1] 1764937357.219423 mapwrite 0x6e3000 thru 0x6f1b60 (0xeb61 bytes) 000140[1] 1764937357.393978 trunc from 0x9fab72 to 0x0ec23a (0x90e937 bytes) 000141[1] 1764937357.430368 write_OD 0x3ce000 thru 0x3d2fff (0x5000 bytes) 000142[1] 1764937357.488993 read_OD 0x387000 thru 0x38cfff (0x6000 bytes) 000143[1] 1764937357.500715 read_OD 0x21e000 thru 0x221fff (0x4000 bytes) 000145[1] 1764937357.506932 write_OD 0x1d4000 thru 0x1e2fff (0xf000 bytes) 000148[1] 1764937357.566012 trunc from 0x3d3000 to 0x92ae88 (0x557e89 bytes) 000151[1] 1764937357.643198 mapread 0x17e000 thru 0x18b5b4 (0xd5b5 bytes) 000153[0] 1764937357.923702 trunc from 0x92ae89 to 0x4b5f82 (0x474f06 bytes) 000154[0] 1764937358.041864 read 0x2d0000 thru 0x2de17a (0xe17b bytes) 000155[1] 1764937358.112099 write_OD 0x021000 thru 0x022fff (0x2000 bytes) 000157[0] 1764937358.195895 read 0x045000 thru 0x04e14f (0x9150 bytes) 000158[0] 1764937358.290644 mapread 0x2ed000 thru 0x2f5807 (0x8808 bytes) 000159[1] 1764937358.291341 mapread 0x146000 thru 0x154f62 (0xef63 bytes) 000161[0] 1764937358.381195 write 0x367000 thru 0x3709bd (0x99be bytes) 000164[1] 1764937358.426953 mapread 0x00d000 thru 0x01b41b (0xe41c bytes) 000165[0] 1764937358.540146 trunc from 0x4b5f83 to 0x50b3d8 (0x55456 bytes) 000168[0] 1764937358.638171 trunc from 0x50b3d9 to 0x0aab5d (0x46087b bytes) 000171[0] 1764937358.734645 read 0x045000 thru 0x0485db (0x35dc bytes) 000172[0] 1764937358.758684 trunc from 0x0aab5e to 0x896e68 (0x7ec30b bytes) 000174[1] 1764937358.822700 mapread 0x3d2000 thru 0x3d4131 (0x2132 bytes) 000176[0] 1764937358.877740 read 0x3f5000 thru 0x404218 (0xf219 bytes) 000177[1] 1764937358.930200 mapwrite 0x365000 thru 0x3743c4 (0xf3c5 bytes) 000179[1] 1764937359.192261 read_OD 0x6b6000 thru 0x6b6fff (0x1000 bytes) 000181[0] 1764937359.205626 mapread 0x515000 thru 0x516155 (0x1156 bytes) 000182[1] 1764937359.220101 trunc from 0x896e69 to 0x5e73d8 (0x2afa90 bytes) 000183[0] 1764937359.294744 mapread 0x570000 thru 0x57065e (0x65f bytes) 000184[1] 1764937359.348340 read_OD 0x141000 thru 0x141fff (0x1000 bytes) 000190[1] 1764937359.372830 read_OD 0x4d7000 thru 0x4e2fff (0xc000 bytes) 000191[1] 1764937359.390500 write_OD 0x7ff000 thru 0x800fff (0x2000 bytes) 000193[1] 1764937359.442770 mapwrite 0x7e7000 thru 0x7f0392 (0x9393 bytes) 000196[1] 1764937359.619076 mapread 0x2eb000 thru 0x2f749d (0xc49e bytes) 000198[1] 1764937359.770554 trunc from 0x801000 to 0x8b2079 (0xb107a bytes) 000200[0] 1764937359.815222 read 0x2b9000 thru 0x2c2873 (0x9874 bytes) 000204[0] 1764937359.934771 mapwrite 0x2c1000 thru 0x2c7ab6 (0x6ab7 bytes) 000211[0] 1764937360.245029 mapwrite 0x1b9000 thru 0x1bc1db (0x31dc bytes) 000212[0] 1764937360.364252 write 0x781000 thru 0x787f1e (0x6f1f bytes) 000213[0] 1764937360.371561 write 0x8b9000 thru 0x8c7f97 (0xef98 bytes) 000217[0] 1764937360.419688 mapwrite 0x30c000 thru 0x31bcff (0xfd00 bytes) 000220[0] 1764937360.724924 mapread 0x752000 thru 0x75c885 (0xa886 bytes) 000221[1] 1764937360.847467 trunc from 0x8c7f98 to 0x18860b (0x73f98c bytes) 000222[0] 1764937360.907701 read 0x071000 thru 0x07cb0b (0xbb0c bytes) 000224[0] 1764937360.975251 read 0x0a1000 thru 0x0a9e99 (0x8e9a bytes) 000226[1] 1764937360.976798 read_OD 0x121000 thru 0x12ffff (0xf000 bytes) 000227[0] 1764937361.004892 trunc from 0x18860c to 0x110584 (0x78087 bytes) 000228[1] 1764937361.096766 read_OD 0x0a5000 thru 0x0b3fff (0xf000 bytes) 000230[0] 1764937361.141841 mapwrite 0x485000 thru 0x485498 (0x499 bytes) 000231[0] 1764937361.255749 mapread 0x01e000 thru 0x022566 (0x4567 bytes) 000232[0] 1764937361.303934 read 0x0db000 thru 0x0e72eb (0xc2ec bytes) 000233[1] 1764937361.373233 trunc from 0x485499 to 0x155e24 (0x32f674 bytes) 000235[1] 1764937361.441048 trunc from 0x155e25 to 0x19e269 (0x48445 bytes) 000237[1] 1764937361.499496 read_OD 0x070000 thru 0x079fff (0xa000 bytes) 000239[0] 1764937361.521882 trunc from 0x19e26a to 0x65be12 (0x4bdba9 bytes) 000241[1] 1764937361.569002 trunc from 0x65be13 to 0x192d87 (0x4c908b bytes) 000244[0] 1764937361.637404 mapread 0x18a000 thru 0x1922aa (0x82ab bytes) 000245[0] 1764937361.723533 mapwrite 0x33b000 thru 0x343aa5 (0x8aa6 bytes) 000246[1] 1764937361.889341 mapwrite 0x002000 thru 0x00b860 (0x9861 bytes) 000247[1] 1764937362.176783 mapwrite 0x8d8000 thru 0x8db412 (0x3413 bytes) 000248[0] 1764937362.359265 mapwrite 0x4e1000 thru 0x4e3a38 (0x2a39 bytes) 000249[0] 1764937362.605947 read 0x451000 thru 0x457a6e (0x6a6f bytes) 000250[0] 1764937362.657945 mapwrite 0x28d000 thru 0x295990 (0x8991 bytes) 000251[0] 1764937362.786002 trunc from 0x8db413 to 0x65f0c6 (0x27c34c bytes) 000253[1] 1764937362.874797 mapwrite 0x59d000 thru 0x59eb87 (0x1b88 bytes) 000254[1] 1764937362.963979 write_OD 0x91a000 thru 0x920fff (0x7000 bytes) 000255[0] 1764937363.016049 read 0x749000 thru 0x752d83 (0x9d84 bytes) 000256[0] 1764937363.075277 write 0x68a000 thru 0x69388f (0x9890 bytes) 000258[0] 1764937363.107520 mapwrite 0x16d000 thru 0x16ed1a (0x1d1b bytes) 000259[0] 1764937363.208848 mapread 0x3f6000 thru 0x3f77d9 (0x17da bytes) 000261[1] 1764937363.285917 mapwrite 0x70b000 thru 0x7183d7 (0xd3d8 bytes) 000263[1] 1764937363.602583 read_OD 0x68b000 thru 0x68cfff (0x2000 bytes) 000264[0] 1764937363.621915 mapread 0x436000 thru 0x4417b4 (0xb7b5 bytes) 000266[1] 1764937363.717399 mapwrite 0x2e0000 thru 0x2e8fb0 (0x8fb1 bytes) 000268[0] 1764937363.876706 write 0x6e7000 thru 0x6e84e0 (0x14e1 bytes) 000270[0] 1764937363.904966 read 0x5db000 thru 0x5db45f (0x460 bytes) 000271[1] 1764937363.963631 read_OD 0x204000 thru 0x211fff (0xe000 bytes) 000272[0] 1764937364.014728 mapwrite 0x7ac000 thru 0x7b9a33 (0xda34 bytes) 000273[1] 1764937364.157168 mapwrite 0x2f8000 thru 0x2fbea7 (0x3ea8 bytes) 000274[0] 1764937364.379875 write 0x212000 thru 0x21dab3 (0xbab4 bytes) 000276[0] 1764937364.445852 read 0x8a5000 thru 0x8b22cc (0xd2cd bytes) 000278[1] 1764937364.468202 read_OD 0x671000 thru 0x678fff (0x8000 bytes) 000279[1] 1764937364.517868 trunc from 0x921000 to 0x525cf5 (0x3fb30a bytes) 000282[1] 1764937364.609398 read_OD 0x455000 thru 0x45bfff (0x7000 bytes) 000283[0] 1764937364.639712 mapread 0x313000 thru 0x3176e5 (0x46e6 bytes) 000284[1] 1764937364.702830 mapread 0x26d000 thru 0x27a96e (0xd96f bytes) 000288[0] 1764937364.847010 mapread 0x4f8000 thru 0x4f90e9 (0x10ea bytes) 000291[1] 1764937364.871503 mapwrite 0x025000 thru 0x02d2a0 (0x82a1 bytes) 000293[1] 1764937365.064268 read_OD 0x362000 thru 0x366fff (0x5000 bytes) 000294[1] 1764937365.096486 trunc from 0x525cf6 to 0x439f83 (0xebd72 bytes) 000296[0] 1764937365.162701 write 0x12c000 thru 0x13ac0c (0xec0d bytes) 000297[0] 1764937365.196078 trunc from 0x439f84 to 0x933c75 (0x4f9cf2 bytes) 000298[1] 1764937365.227991 write_OD 0x627000 thru 0x62efff (0x8000 bytes) 000300[1] 1764937365.321649 trunc from 0x933c76 to 0x64b912 (0x2e8363 bytes) 000301[0] 1764937365.347412 mapread 0x3f2000 thru 0x3ffb7d (0xdb7e bytes) 000303[1] 1764937365.441086 trunc from 0x64b913 to 0x117793 (0x53417f bytes) 000305[1] 1764937365.506738 mapwrite 0x974000 thru 0x97994a (0x594b bytes) 000307[0] 1764937365.705121 trunc from 0x97994b to 0x90fa98 (0x69eb2 bytes) 000308[0] 1764937365.768418 mapwrite 0x10c000 thru 0x10f528 (0x3529 bytes) 000309[0] 1764937365.886886 trunc from 0x90fa99 to 0x55b900 (0x3b4198 bytes) 000312[0] 1764937366.000276 write 0x68f000 thru 0x69a7b2 (0xb7b3 bytes) 000313[1] 1764937366.005511 read_OD 0x693000 thru 0x699fff (0x7000 bytes) 000314[0] 1764937366.063247 trunc from 0x69a7b3 to 0x97c58c (0x2e1dda bytes) 000315[1] 1764937366.102444 mapwrite 0x376000 thru 0x37cab6 (0x6ab7 bytes) 000317[0] 1764937366.359269 trunc from 0x97c58d to 0x602576 (0x37a016 bytes) 000318[0] 1764937366.428291 mapread 0x221000 thru 0x22e6f9 (0xd6fa bytes) 000321[1] 1764937366.563544 read_OD 0x28c000 thru 0x290fff (0x5000 bytes) 000322[1] 1764937366.593639 mapread 0x0b2000 thru 0x0bb66d (0x966e bytes) 000323[0] 1764937366.704746 mapread 0x3c7000 thru 0x3d0834 (0x9835 bytes) 000324[0] 1764937366.779524 read 0x0bd000 thru 0x0ca63c (0xd63d bytes) 000325[0] 1764937366.859463 mapread 0x04d000 thru 0x05128f (0x4290 bytes) 000327[1] 1764937366.949898 trunc from 0x602577 to 0x349057 (0x2b951f bytes) 000329[1] 1764937367.066351 write_OD 0x585000 thru 0x58afff (0x6000 bytes) 000334[1] 1764937367.119938 write_OD 0x202000 thru 0x20dfff (0xc000 bytes) 000335[1] 1764937367.182819 trunc from 0x58b000 to 0x94141d (0x3b641e bytes) 000336[0] 1764937367.223915 trunc from 0x94141e to 0x848885 (0xf8b98 bytes) 000337[1] 1764937367.266982 read_OD 0x4fc000 thru 0x503fff (0x8000 bytes) 000339[1] 1764937367.309179 mapwrite 0x01d000 thru 0x029778 (0xc779 bytes) 000341[1] 1764937367.523400 mapwrite 0x606000 thru 0x60b85a (0x585b bytes) 000343[0] 1764937367.590415 trunc from 0x848886 to 0x1956eb (0x6b319a bytes) 000344[1] 1764937367.652025 write_OD 0x5b4000 thru 0x5bffff (0xc000 bytes) 000346[0] 1764937367.719878 read 0x3fe000 thru 0x4048c4 (0x68c5 bytes) 000347[1] 1764937367.772144 write_OD 0x0b3000 thru 0x0b6fff (0x4000 bytes) 000348[0] 1764937367.859723 mapwrite 0x268000 thru 0x26f76c (0x776d bytes) 000350[1] 1764937368.071108 write_OD 0x574000 thru 0x57efff (0xb000 bytes) 000351[0] 1764937368.139433 mapread 0x5bd000 thru 0x5bfed8 (0x2ed9 bytes) 000352[0] 1764937368.187723 mapwrite 0x04a000 thru 0x04e66e (0x466f bytes) 000353[1] 1764937368.379587 trunc from 0x5c0000 to 0x1aef4b (0x4110b4 bytes) 000355[1] 1764937368.467856 mapwrite 0x0ab000 thru 0x0b96b4 (0xe6b5 bytes) 000356[0] 1764937368.638519 write 0x6d4000 thru 0x6d920d (0x520e bytes) 000357[0] 1764937368.697065 read 0x650000 thru 0x650a1b (0xa1c bytes) 000358[1] 1764937368.711548 mapread 0x60e000 thru 0x6154ab (0x74ac bytes) 000360[0] 1764937368.820851 trunc from 0x6d920e to 0x2a4d07 (0x434506 bytes) 000362[1] 1764937368.898010 mapwrite 0x855000 thru 0x855efc (0xefd bytes) 000363[1] 1764937369.078277 mapwrite 0x985000 thru 0x9873cf (0x23d0 bytes) 000369[1] 1764937369.278536 read_OD 0x536000 thru 0x536fff (0x1000 bytes) 000370[0] 1764937369.299119 mapread 0x4c6000 thru 0x4d54be (0xf4bf bytes) 000371[0] 1764937369.554862 trunc from 0x9873d0 to 0x884842 (0x102b8d bytes) 000372[1] 1764937369.676180 read_OD 0x15d000 thru 0x15dfff (0x1000 bytes) 000373[0] 1764937369.735757 write 0x760000 thru 0x76a076 (0xa077 bytes) 000374[0] 1764937369.808371 mapwrite 0x175000 thru 0x182c28 (0xdc29 bytes) 000377[1] 1764937370.038006 read_OD 0x569000 thru 0x56bfff (0x3000 bytes) 000378[1] 1764937370.083174 write_OD 0x15c000 thru 0x165fff (0xa000 bytes) 000379[0] 1764937370.181831 trunc from 0x884843 to 0x58819f (0x2fc6a3 bytes) 000383[0] 1764937370.356107 read_OD 0x3ac000 thru 0x3adfff (0x2000 bytes) 000384[0] 1764937370.390654 mapread 0x1d5000 thru 0x1defe5 (0x9fe6 bytes) 000386[0] 1764937370.421517 read_OD 0x320000 thru 0x328fff (0x9000 bytes) 000388[1] 1764937370.436676 read_OD 0x2f5000 thru 0x2f5fff (0x1000 bytes) 000391[0] 1764937370.442122 mapread 0x02b000 thru 0x035544 (0xa545 bytes) 000394[0] 1764937370.572069 mapread 0x200000 thru 0x20b764 (0xb765 bytes) 000395[1] 1764937370.633397 mapwrite 0x091000 thru 0x09485c (0x385d bytes) 000396[0] 1764937370.780603 write_OD 0x254000 thru 0x259fff (0x6000 bytes) 000398[1] 1764937370.890457 write_OD 0x622000 thru 0x627fff (0x6000 bytes) 000399[1] 1764937370.964829 mapwrite 0x869000 thru 0x875ca8 (0xcca9 bytes) 000401[0] 1764937371.160397 read_OD 0x86d000 thru 0x874fff (0x8000 bytes) 000402[0] 1764937371.232212 mapwrite 0x64f000 thru 0x65d486 (0xe487 bytes) 000405[0] 1764937371.465029 read_OD 0x571000 thru 0x571fff (0x1000 bytes) 000407[0] 1764937371.490213 mapread 0x65f000 thru 0x6664b8 (0x74b9 bytes) 000410[0] 1764937371.576625 mapread 0x09d000 thru 0x09d416 (0x417 bytes) 000411[0] 1764937371.588519 trunc from 0x875ca9 to 0x1d1cb0 (0x6a3ff8 bytes) 000412[0] 1764937371.655603 trunc from 0x1d1cb1 to 0x27384c (0xa1b9c bytes) 000413[1] 1764937371.691039 read_OD 0x02a000 thru 0x02dfff (0x4000 bytes) 000414[1] 1764937371.717064 mapwrite 0x20d000 thru 0x2131d5 (0x61d6 bytes) 000415[0] 1764937371.836365 read_OD 0x046000 thru 0x050fff (0xb000 bytes) 000418[0] 1764937371.875437 mapwrite 0x5b0000 thru 0x5b7902 (0x7903 bytes) 000419[1] 1764937372.052220 mapread 0x565000 thru 0x56bccb (0x6ccc bytes) 000420[1] 1764937372.155584 mapread 0x298000 thru 0x29dd22 (0x5d23 bytes) 000421[1] 1764937372.199157 mapwrite 0x110000 thru 0x1141f7 (0x41f8 bytes) 000422[1] 1764937372.319879 mapread 0x07b000 thru 0x08736c (0xc36d bytes) 000425[1] 1764937372.441044 read_OD 0x165000 thru 0x16efff (0xa000 bytes) 000426[0] 1764937372.465598 mapread 0x2c1000 thru 0x2d01b1 (0xf1b2 bytes) 000428[1] 1764937372.568356 mapwrite 0x002000 thru 0x006259 (0x425a bytes) 000430[1] 1764937372.844262 write_OD 0x7ad000 thru 0x7b3fff (0x7000 bytes) 000431[0] 1764937372.975474 trunc from 0x7b4000 to 0x44bc01 (0x3683fe bytes) 000432[1] 1764937373.046896 mapwrite 0x7c7000 thru 0x7cbf0a (0x4f0b bytes) 000433[1] 1764937373.202057 read_OD 0x200000 thru 0x208fff (0x9000 bytes) 000434[0] 1764937373.223468 read_OD 0x0ae000 thru 0x0b4fff (0x7000 bytes) 000435[0] 1764937373.240770 read_OD 0x125000 thru 0x12ffff (0xb000 bytes) 000438[0] 1764937373.249549 trunc from 0x7cbf0b to 0x147b18 (0x6843f2 bytes) 000439[1] 1764937373.311237 mapwrite 0x492000 thru 0x4a147c (0xf47d bytes) 000442[0] 1764937373.537448 write_OD 0x9f6000 thru 0x9fefff (0x9000 bytes) 000445[1] 1764937373.618679 trunc from 0x9ff000 to 0x3a59dc (0x659623 bytes) 000449[0] 1764937373.730475 trunc from 0x3a59dd to 0x1fc4bb (0x1a9521 bytes) 000451[1] 1764937373.825182 mapread 0x158000 thru 0x1628b9 (0xa8ba bytes) 000453[0] 1764937373.974595 write_OD 0x480000 thru 0x483fff (0x4000 bytes) 000454[1] 1764937374.098095 mapwrite 0x99f000 thru 0x9a4a42 (0x5a43 bytes) 000455[0] 1764937374.326600 trunc from 0x9a4a43 to 0x8fedbd (0xa5c85 bytes) 000456[1] 1764937374.385548 read_OD 0x4e8000 thru 0x4f0fff (0x9000 bytes) 000461[0] 1764937374.440236 trunc from 0x8fedbe to 0x33a0ed (0x5c4cd0 bytes) 000462[0] 1764937374.494704 read_OD 0x143000 thru 0x147fff (0x5000 bytes) 000463[0] 1764937374.536581 mapread 0x09e000 thru 0x0ab759 (0xd75a bytes) 000466[0] 1764937374.758922 mapread 0x209000 thru 0x21450c (0xb50d bytes) 000467[1] 1764937374.762063 trunc from 0x33a0ee to 0x9b59d5 (0x67b8e8 bytes) 000469[0] 1764937374.883133 write_OD 0x08b000 thru 0x097fff (0xd000 bytes) 000470[0] 1764937375.070695 mapwrite 0x7ed000 thru 0x7f1fab (0x4fac bytes) 000477[1] 1764937375.350076 mapwrite 0x91c000 thru 0x922371 (0x6372 bytes) 000478[1] 1764937375.614217 mapread 0x1bf000 thru 0x1c19f4 (0x29f5 bytes) 000480[1] 1764937375.650656 trunc from 0x9b59d6 to 0x3c50e8 (0x5f08ed bytes) 000481[0] 1764937375.680127 mapread 0x349000 thru 0x357a1a (0xea1b bytes) 000482[0] 1764937375.782460 read_OD 0x1fa000 thru 0x1fafff (0x1000 bytes) 000484[0] 1764937375.797483 trunc from 0x3c50e9 to 0x6762b9 (0x2b11d1 bytes) 000487[1] 1764937375.861673 mapread 0x4cb000 thru 0x4d07f5 (0x57f6 bytes) 000489[0] 1764937375.952863 mapwrite 0x5ae000 thru 0x5b5a14 (0x7a15 bytes) 000490[1] 1764937376.215185 read_OD 0x64d000 thru 0x64efff (0x2000 bytes) 000492[1] 1764937376.305829 mapread 0x423000 thru 0x432153 (0xf154 bytes) 000493[0] 1764937376.520359 write_OD 0x9bc000 thru 0x9c7fff (0xc000 bytes) 000494[1] 1764937376.647360 trunc from 0x9c8000 to 0x5039b3 (0x4c464c bytes) 000495[0] 1764937376.716523 mapwrite 0x9e8000 thru 0x9f3797 (0xb798 bytes) 000498[0] 1764937377.020948 mapwrite 0x33b000 thru 0x3459f2 (0xa9f3 bytes) 000499[0] 1764937377.339139 read_OD 0x312000 thru 0x31afff (0x9000 bytes) All operations completed A-OK! PASS 16a (63s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 07:23:03 (1764937383) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.421726 s, 5.0 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.309008 s, 6.8 MB/s Chance of close/open is 1 in 50 Seed set to 7386 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x9255ab 000001[1] 1764937386.785047 trunc from 00000000 to 0x9255aa (0x9255ab bytes) 000004[1] 1764937386.854405 mapread 0x041693 thru 0x043322 (0x1c90 bytes) 000007[0] 1764937386.902543 read 0x5d0366 thru 0x5d1854 (0x14ef bytes) 000008[1] 1764937386.944960 write 0x647855 thru 0x649322 (0x1ace bytes) 000010[0] 1764937386.956872 write 0x30e416 thru 0x30f61a (0x1205 bytes) 000013[0] 1764937387.094415 mapread 0x5c0c0e thru 0x5c1fcd (0x13c0 bytes) 000014[0] 1764937387.239952 trunc from 0x9255ab to 0x240102 (0x6e54a8 bytes) 000015[0] 1764937387.348613 mapread 0x10c073 thru 0x10d2b3 (0x1241 bytes) 000016[0] 1764937387.385649 mapread 0x098f6d thru 0x0996b2 (0x746 bytes) 000017[0] 1764937387.415442 mapwrite 0x60ce2d thru 0x60d813 (0x9e7 bytes) 000018[1] 1764937387.630029 trunc from 0x60d814 to 0x86e03c (0x260829 bytes) 000020[1] 1764937387.738959 write 0x02cc1e thru 0x02ea0e (0x1df1 bytes) 000021[0] 1764937387.804289 write 0x107cf1 thru 0x108b38 (0xe48 bytes) 000022[1] 1764937387.860506 trunc from 0x86e03d to 0x68ed45 (0x1df2f7 bytes) 000024[0] 1764937387.908613 write 0x1b7081 thru 0x1b8b99 (0x1b19 bytes) 000025[1] 1764937387.958531 mapwrite 0x54b320 thru 0x54d14b (0x1e2c bytes) 000029[0] 1764937388.236184 mapwrite 0x9ccbf7 thru 0x9cce99 (0x2a3 bytes) 000030[1] 1764937388.515150 write 0x22c1f6 thru 0x22ca08 (0x813 bytes) 000031[1] 1764937388.582455 trunc from 0x9cce9a to 0x397cc8 (0x6351d1 bytes) 000032[0] 1764937388.678382 read 0x180540 thru 0x181c85 (0x1746 bytes) 000034[1] 1764937388.776151 write 0x240672 thru 0x242535 (0x1ec4 bytes) 000035[1] 1764937388.795973 mapwrite 0x3c5f1e thru 0x3c6797 (0x87a bytes) 000036[1] 1764937388.904718 mapwrite 0x9ca4da thru 0x9cb517 (0x103e bytes) 000037[1] 1764937389.026428 trunc from 0x9cb518 to 0x5883da (0x44313d bytes) 000039[1] 1764937389.088339 read 0x41f153 thru 0x420427 (0x12d5 bytes) 000043[1] 1764937389.202001 mapwrite 0x0b7eea thru 0x0b826c (0x383 bytes) 000044[0] 1764937389.304248 mapread 0x201566 thru 0x2021f8 (0xc93 bytes) 000045[0] 1764937389.428791 trunc from 0x5883db to 0x0dd4ea (0x4aaef0 bytes) 000046[1] 1764937389.529909 write 0x0ccb47 thru 0x0cdbf8 (0x10b2 bytes) 000047[0] 1764937389.584190 mapwrite 0x7b48cd thru 0x7b6284 (0x19b8 bytes) 000048[0] 1764937389.767954 read 0x563c0a thru 0x563c76 (0x6d bytes) 000049[0] 1764937389.867276 mapwrite 0x8e4511 thru 0x8e4ff4 (0xae4 bytes) 000050[1] 1764937389.965741 mapwrite 0x0354a4 thru 0x035e49 (0x9a6 bytes) 000051[1] 1764937390.070429 write 0x380c47 thru 0x381ed2 (0x128c bytes) 000056[1] 1764937390.202178 read 0x8b2c94 thru 0x8b35af (0x91c bytes) 000060[1] 1764937390.277386 trunc from 0x8e4ff5 to 0x73997c (0x1ab678 bytes) 000066[1] 1764937390.380389 trunc from 0x73997d to 0x864a15 (0x12b099 bytes) 000069[1] 1764937390.432087 write 0x399a39 thru 0x39b21f (0x17e7 bytes) 000070[1] 1764937390.488776 mapread 0x58d736 thru 0x58e6b7 (0xf82 bytes) 000072[1] 1764937390.589866 trunc from 0x864a16 to 0x2866da (0x5de33b bytes) 000078[0] 1764937390.713469 read 0x039a70 thru 0x03b976 (0x1f07 bytes) 000081[1] 1764937390.767409 read 0x07a52c thru 0x07b4d4 (0xfa9 bytes) 000082[0] 1764937390.809641 write 0x2fa41e thru 0x2faaee (0x6d1 bytes) 000083[0] 1764937390.853974 mapread 0x0a4bc9 thru 0x0a5144 (0x57c bytes) 000088[1] 1764937390.947021 read 0x1d65b3 thru 0x1d8075 (0x1ac3 bytes) 000092[1] 1764937391.004886 mapwrite 0x5aa184 thru 0x5ab992 (0x180f bytes) 000093[0] 1764937391.094134 mapwrite 0x41ebb1 thru 0x41ebb3 (0x3 bytes) 000094[1] 1764937391.201576 read 0x5822db thru 0x584293 (0x1fb9 bytes) 000095[0] 1764937391.231962 mapwrite 0x0de568 thru 0x0dfef8 (0x1991 bytes) 000099[1] 1764937391.354785 trunc from 0x5ab993 to 0x66b8ac (0xbff1a bytes) 000101[0] 1764937391.449100 read 0x4f42b2 thru 0x4f53b7 (0x1106 bytes) 000103[0] 1764937391.474965 mapread 0x1136e0 thru 0x114924 (0x1245 bytes) 000105[1] 1764937391.544265 write 0x9858f2 thru 0x9860fa (0x809 bytes) 000108[1] 1764937391.615463 read 0x213282 thru 0x213e43 (0xbc2 bytes) 000109[0] 1764937391.715805 mapread 0x436ff8 thru 0x438c2a (0x1c33 bytes) 000110[0] 1764937391.740812 write 0x73d126 thru 0x73dd16 (0xbf1 bytes) 000111[1] 1764937391.841751 read 0x43facf thru 0x43fb46 (0x78 bytes) 000113[1] 1764937391.855372 write 0x5fdf8a thru 0x5fe310 (0x387 bytes) 000115[1] 1764937391.907508 trunc from 0x9860fb to 0x89ea7c (0xe767e bytes) 000119[0] 1764937391.997081 mapread 0x27416b thru 0x274e93 (0xd29 bytes) 000120[0] 1764937392.040078 mapread 0x59fa1e thru 0x5a0c47 (0x122a bytes) 000121[1] 1764937392.078668 mapread 0x06ffee thru 0x07190a (0x191d bytes) 000124[0] 1764937392.102890 mapwrite 0x4e131c thru 0x4e1c51 (0x936 bytes) 000126[0] 1764937392.179139 read 0x846800 thru 0x846b39 (0x33a bytes) 000128[1] 1764937392.221967 write 0x1fb45f thru 0x1fb495 (0x37 bytes) 000129[0] 1764937392.279543 read 0x54e8b2 thru 0x55041c (0x1b6b bytes) 000130[0] 1764937392.394638 read 0x08a2e1 thru 0x08aeb5 (0xbd5 bytes) 000131[0] 1764937392.499955 mapread 0x0c9708 thru 0x0cade4 (0x16dd bytes) 000132[1] 1764937392.551663 read 0x1b5013 thru 0x1b5786 (0x774 bytes) 000133[1] 1764937392.615824 write 0x327747 thru 0x327b16 (0x3d0 bytes) 000137[0] 1764937392.747927 read 0x2a5ccc thru 0x2a76db (0x1a10 bytes) 000138[0] 1764937392.781932 write 0x7a4202 thru 0x7a4f87 (0xd86 bytes) 000139[0] 1764937392.842726 write 0x968e3b thru 0x96a1ea (0x13b0 bytes) 000140[1] 1764937392.873391 write 0x22771f thru 0x22801f (0x901 bytes) 000142[0] 1764937393.018488 trunc from 0x96a1eb to 0x46d14f (0x4fd09b bytes) 000144[0] 1764937393.120419 write 0x3c7c80 thru 0x3c9698 (0x1a19 bytes) 000146[1] 1764937393.152198 mapwrite 0x3e25e8 thru 0x3e2af6 (0x50f bytes) 000148[0] 1764937393.325147 trunc from 0x46d150 to 0x83b936 (0x3ce7e7 bytes) 000149[1] 1764937393.387214 trunc from 0x83b937 to 0x27ded5 (0x5bda61 bytes) 000151[0] 1764937393.472251 write 0x49d8c7 thru 0x49ecd6 (0x1410 bytes) 000152[0] 1764937393.531920 mapwrite 0x41dc4b thru 0x41f934 (0x1cea bytes) 000153[1] 1764937393.694253 mapread 0x2a4dad thru 0x2a5bcb (0xe1f bytes) 000154[0] 1764937393.757993 mapwrite 0x2d88af thru 0x2d8e83 (0x5d5 bytes) 000155[0] 1764937393.896903 trunc from 0x49ecd7 to 0x69b7d6 (0x1fcb00 bytes) 000157[0] 1764937393.987556 mapread 0x264cbc thru 0x266063 (0x13a8 bytes) 000162[1] 1764937394.079689 trunc from 0x69b7d7 to 0x0e35af (0x5b8227 bytes) 000164[0] 1764937394.154748 write 0x187b2b thru 0x1898e1 (0x1db7 bytes) 000165[1] 1764937394.183908 trunc from 0x1898e2 to 0x59e92a (0x415049 bytes) 000168[0] 1764937394.273472 mapread 0x214f0c thru 0x215e7c (0xf71 bytes) 000170[1] 1764937394.321943 mapwrite 0x965bad thru 0x965cd7 (0x12b bytes) 000171[1] 1764937394.534460 trunc from 0x965cd8 to 0x158184 (0x80db53 bytes) 000174[0] 1764937394.572901 mapwrite 0x0382e1 thru 0x0388e5 (0x605 bytes) 000179[0] 1764937394.727437 write 0x69ee93 thru 0x6a0a07 (0x1b75 bytes) 000180[1] 1764937394.747628 mapwrite 0x68aa3b thru 0x68aae3 (0xa9 bytes) 000181[0] 1764937394.818045 mapread 0x30f02c thru 0x30fdea (0xdbf bytes) 000182[1] 1764937394.862039 trunc from 0x6a0a08 to 0x529c50 (0x176db7 bytes) 000184[1] 1764937394.906008 write 0x2b428f thru 0x2b5f0e (0x1c80 bytes) 000186[1] 1764937394.968004 mapread 0x00947c thru 0x009f2c (0xab1 bytes) 000187[0] 1764937394.972986 read 0x456c2d thru 0x457048 (0x41c bytes) 000188[1] 1764937395.019995 read 0x35bca3 thru 0x35c0cc (0x42a bytes) 000191[0] 1764937395.110287 mapwrite 0x7876d7 thru 0x7885b6 (0xee0 bytes) 000192[1] 1764937395.296135 read 0x4de355 thru 0x4df6f8 (0x13a4 bytes) 000193[0] 1764937395.370692 mapwrite 0x77a6c5 thru 0x77b0e1 (0xa1d bytes) 000194[0] 1764937395.441677 mapread 0x47e1f8 thru 0x4800e2 (0x1eeb bytes) 000196[0] 1764937395.476293 read 0x084865 thru 0x08539f (0xb3b bytes) 000197[1] 1764937395.572009 write 0x0ba6f6 thru 0x0bc0eb (0x19f6 bytes) 000199[0] 1764937395.642153 mapread 0x255d8b thru 0x256955 (0xbcb bytes) 000200[1] 1764937395.712655 write 0x9eaa7e thru 0x9ec511 (0x1a94 bytes) 000202[1] 1764937395.790194 write 0x909963 thru 0x90a442 (0xae0 bytes) 000204[0] 1764937395.897976 mapread 0x4eb5a5 thru 0x4eb8c0 (0x31c bytes) 000205[1] 1764937395.944880 mapread 0x556192 thru 0x5562e5 (0x154 bytes) 000206[0] 1764937395.969895 mapread 0x96235f thru 0x9637f5 (0x1497 bytes) 000208[1] 1764937396.056187 trunc from 0x9ec512 to 0x2ccf45 (0x71f5cc bytes) 000209[1] 1764937396.113376 read 0x0ac30e thru 0x0ad178 (0xe6b bytes) 000210[1] 1764937396.187594 read 0x20fa77 thru 0x210444 (0x9ce bytes) 000211[1] 1764937396.216546 mapread 0x095281 thru 0x095fcc (0xd4c bytes) 000212[1] 1764937396.231163 trunc from 0x2ccf46 to 0x57f17d (0x2b2238 bytes) truncating to largest ever: 0x938cfb 000214[1] 1764937396.294141 trunc from 0x57f17e to 0x938cfa (0x3b9b7d bytes) 000216[1] 1764937396.345720 mapwrite 0x52e524 thru 0x52eb0d (0x5ea bytes) 000218[0] 1764937396.467232 mapread 0x9386f2 thru 0x938cfa (0x609 bytes) 000220[0] 1764937396.533148 mapread 0x2bf0d8 thru 0x2bf250 (0x179 bytes) truncating to largest ever: 0x962d22 000222[0] 1764937396.555729 trunc from 0x938cfb to 0x962d21 (0x2a027 bytes) 000223[1] 1764937396.607116 read 0x86312f thru 0x863d7b (0xc4d bytes) 000226[0] 1764937396.645238 write 0x36274b thru 0x3638f7 (0x11ad bytes) 000228[1] 1764937396.690423 mapread 0x7def27 thru 0x7df3c8 (0x4a2 bytes) 000229[1] 1764937396.745261 mapread 0x798a71 thru 0x798c29 (0x1b9 bytes) 000230[1] 1764937396.757421 trunc from 0x962d22 to 0x84b751 (0x1175d0 bytes) 000233[1] 1764937396.880888 write 0x99f438 thru 0x99fbb9 (0x782 bytes) 000234[0] 1764937396.903011 mapwrite 0x1d6fa2 thru 0x1d81d6 (0x1235 bytes) 000235[1] 1764937397.033562 write 0x64e2f7 thru 0x65014f (0x1e59 bytes) 000238[1] 1764937397.120014 write 0x165141 thru 0x1670fa (0x1fba bytes) 000239[0] 1764937397.235493 read 0x122cf4 thru 0x123574 (0x881 bytes) 000240[0] 1764937397.289388 mapread 0x870d2d thru 0x872741 (0x1a15 bytes) 000241[0] 1764937397.437003 trunc from 0x99fbba to 0x8ad0f6 (0xf2ac3 bytes) 000244[0] 1764937397.555556 write 0x9a943a thru 0x9a972d (0x2f4 bytes) 000245[1] 1764937397.556479 mapread 0x95ab3e thru 0x95c0fa (0x15bd bytes) 000246[1] 1764937397.631892 read 0x634aeb thru 0x634f06 (0x41c bytes) 000247[0] 1764937397.709806 mapread 0x8d85fa thru 0x8d8a52 (0x459 bytes) 000249[1] 1764937397.721749 mapread 0x246e92 thru 0x247398 (0x507 bytes) 000250[0] 1764937397.744986 mapwrite 0x37e453 thru 0x37fe37 (0x19e5 bytes) 000252[1] 1764937397.878807 trunc from 0x9a972e to 0x60202a (0x3a7703 bytes) 000253[1] 1764937397.953510 read 0x58c5c4 thru 0x58da2e (0x146b bytes) 000256[0] 1764937397.997338 read 0x2b3540 thru 0x2b4273 (0xd34 bytes) 000257[1] 1764937398.054803 mapread 0x3eaa24 thru 0x3eb176 (0x753 bytes) 000258[0] 1764937398.085102 trunc from 0x60202b to 0x771868 (0x16f83e bytes) 000260[0] 1764937398.175755 mapread 0x34e19f thru 0x34eb73 (0x9d5 bytes) 000264[1] 1764937398.396238 read 0x2b5788 thru 0x2b6a93 (0x130c bytes) 000266[0] 1764937398.464698 trunc from 0x771869 to 0x17d843 (0x5f4025 bytes) 000267[0] 1764937398.535578 trunc from 0x17d844 to 0x10c4fd (0x71346 bytes) 000269[0] 1764937398.637518 trunc from 0x10c4fe to 0x907be5 (0x7fb6e8 bytes) 000271[1] 1764937398.695982 write 0x225689 thru 0x22638b (0xd03 bytes) 000274[1] 1764937398.818234 mapwrite 0x61ff4a thru 0x62001d (0xd4 bytes) 000275[1] 1764937398.913635 mapread 0x767372 thru 0x767e9d (0xb2c bytes) 000278[1] 1764937399.071358 read 0x36a16d thru 0x36a9e5 (0x879 bytes) 000281[0] 1764937399.117906 read 0x1db35a thru 0x1dc78f (0x1436 bytes) 000282[1] 1764937399.129727 trunc from 0x907be6 to 0x24caa5 (0x6bb140 bytes) 000283[0] 1764937399.199437 mapread 0x1df1f2 thru 0x1df605 (0x414 bytes) 000284[0] 1764937399.235365 trunc from 0x24caa6 to 0x5fb3fa (0x3ae955 bytes) 000290[0] 1764937399.396102 mapread 0x4be771 thru 0x4bf984 (0x1214 bytes) 000292[0] 1764937399.476965 mapread 0x24b492 thru 0x24cb56 (0x16c5 bytes) 000294[1] 1764937399.477989 mapwrite 0x379f8a thru 0x37bc56 (0x1ccd bytes) 000295[1] 1764937399.577427 read 0x4c77bd thru 0x4c9566 (0x1daa bytes) 000296[1] 1764937399.644847 write 0x239607 thru 0x239fb5 (0x9af bytes) truncating to largest ever: 0x9a62c8 000297[0] 1764937399.669192 trunc from 0x5fb3fb to 0x9a62c7 (0x3aaecd bytes) 000298[1] 1764937399.754085 mapwrite 0x315a7d thru 0x316101 (0x685 bytes) 000300[0] 1764937399.885629 mapwrite 0x3358a0 thru 0x3366f6 (0xe57 bytes) 000303[1] 1764937400.032401 read 0x2c37e9 thru 0x2c3a45 (0x25d bytes) 000305[1] 1764937400.104489 trunc from 0x9a62c8 to 0x0fc558 (0x8a9d6f bytes) 000307[1] 1764937400.178447 read 0x0e4b77 thru 0x0e5c15 (0x109f bytes) 000308[1] 1764937400.247270 write 0x08dad9 thru 0x08f155 (0x167d bytes) 000309[1] 1764937400.300811 mapwrite 0x0863e1 thru 0x086e72 (0xa92 bytes) 000310[1] 1764937400.434803 write 0x6f39f0 thru 0x6f3a8d (0x9e bytes) 000312[0] 1764937400.471740 read 0x3998c3 thru 0x39ae56 (0x1594 bytes) 000315[1] 1764937400.580007 trunc from 0x6f3a8e to 0x754099 (0x6060c bytes) 000317[0] 1764937400.648120 write 0x13f861 thru 0x141696 (0x1e36 bytes) 000323[0] 1764937400.827948 trunc from 0x75409a to 0x893ca1 (0x13fc08 bytes) 000324[0] 1764937400.893459 trunc from 0x893ca2 to 0x1cf90b (0x6c4396 bytes) 000325[1] 1764937400.922095 mapwrite 0x0c5bd5 thru 0x0c7a64 (0x1e90 bytes) 000327[0] 1764937401.130814 write 0x36204d thru 0x363197 (0x114b bytes) 000328[0] 1764937401.151050 mapread 0x0bd065 thru 0x0bd928 (0x8c4 bytes) 000330[1] 1764937401.209977 mapread 0x27869d thru 0x2791c4 (0xb28 bytes) 000332[0] 1764937401.303014 read 0x143348 thru 0x143509 (0x1c2 bytes) 000334[1] 1764937401.416766 mapread 0x2fdd41 thru 0x2fe816 (0xad6 bytes) 000339[1] 1764937401.556791 mapread 0x2df5a1 thru 0x2e0b2b (0x158b bytes) 000340[0] 1764937401.614213 mapwrite 0x1d8267 thru 0x1d8f5a (0xcf4 bytes) 000343[0] 1764937401.726577 write 0x0216d2 thru 0x0232b6 (0x1be5 bytes) 000345[1] 1764937401.811421 mapwrite 0x928431 thru 0x9294d1 (0x10a1 bytes) 000346[1] 1764937402.136997 write 0x0f5f53 thru 0x0f79f7 (0x1aa5 bytes) 000349[1] 1764937402.185440 read 0x2d6a8b thru 0x2d6dec (0x362 bytes) 000352[1] 1764937402.186491 read 0x296f0d thru 0x298066 (0x115a bytes) 000353[1] 1764937402.186819 write 0x05f643 thru 0x0608cb (0x1289 bytes) 000355[1] 1764937402.248780 trunc from 0x9294d2 to 0x41b371 (0x50e160 bytes) 000358[0] 1764937402.329200 mapread 0x25b98c thru 0x25c4cf (0xb44 bytes) 000360[1] 1764937402.377999 mapread 0x227695 thru 0x228c66 (0x15d2 bytes) 000361[0] 1764937402.401890 read 0x32edc6 thru 0x330870 (0x1aab bytes) 000362[1] 1764937402.452398 trunc from 0x41b372 to 0x58398a (0x168619 bytes) 000363[0] 1764937402.516931 write 0x3c206a thru 0x3c368a (0x1621 bytes) 000366[0] 1764937402.581481 read 0x1f48e5 thru 0x1f4e3d (0x559 bytes) 000370[1] 1764937402.701057 trunc from 0x58398b to 0x78350e (0x1ffb84 bytes) 000371[0] 1764937402.789943 read 0x4bd6c9 thru 0x4beded (0x1725 bytes) 000372[1] 1764937402.845485 mapread 0x5d13de thru 0x5d33c2 (0x1fe5 bytes) 000374[1] 1764937402.867281 mapwrite 0x25e2f5 thru 0x25ed85 (0xa91 bytes) 000375[0] 1764937402.936447 trunc from 0x78350f to 0x6725b0 (0x110f5e bytes) 000380[0] 1764937403.015189 read 0x491988 thru 0x4931ff (0x1878 bytes) 000383[1] 1764937403.105170 write 0x053d54 thru 0x0541b4 (0x461 bytes) 000384[0] 1764937403.156159 trunc from 0x6725b1 to 0x7b17da (0x13f22a bytes) 000385[0] 1764937403.218004 trunc from 0x7b17db to 0x0ea21e (0x6c75bc bytes) 000386[0] 1764937403.275897 mapread 0x03e1c4 thru 0x0401b2 (0x1fef bytes) 000388[1] 1764937403.332864 trunc from 0x0ea21f to 0x8db184 (0x7f0f66 bytes) 000390[1] 1764937403.450059 read 0x452135 thru 0x453c5c (0x1b28 bytes) 000391[0] 1764937403.548185 trunc from 0x8db185 to 0x75472f (0x186a55 bytes) 000394[0] 1764937403.699170 write 0x90d959 thru 0x90f515 (0x1bbd bytes) 000395[1] 1764937403.735731 mapread 0x594419 thru 0x594c42 (0x82a bytes) 000396[0] 1764937403.835719 mapread 0x0d4583 thru 0x0d57a5 (0x1223 bytes) 000397[0] 1764937403.926742 mapread 0x395841 thru 0x395d6d (0x52d bytes) 000398[1] 1764937403.949578 read 0x6d7199 thru 0x6d827b (0x10e3 bytes) 000399[0] 1764937404.025479 mapread 0x476e09 thru 0x478223 (0x141b bytes) 000401[0] 1764937404.047530 mapwrite 0x675ed4 thru 0x67730a (0x1437 bytes) 000402[0] 1764937404.140031 trunc from 0x90f516 to 0x33282b (0x5dccea bytes) truncating to largest ever: 0x9eb9a4 000407[1] 1764937404.261053 trunc from 0x33282c to 0x9eb9a3 (0x6b9178 bytes) 000408[1] 1764937404.346622 read 0x97339a thru 0x973869 (0x4d0 bytes) 000411[0] 1764937404.396882 read 0x0e58f3 thru 0x0e5bd6 (0x2e4 bytes) 000413[0] 1764937404.450924 mapwrite 0x897c41 thru 0x897d2d (0xed bytes) 000414[0] 1764937404.567125 mapwrite 0x825245 thru 0x825fce (0xd8a bytes) 000415[0] 1764937404.645059 trunc from 0x9eb9a4 to 0x161776 (0x88a22d bytes) 000416[1] 1764937404.716952 mapread 0x07b800 thru 0x07cbbf (0x13c0 bytes) 000417[1] 1764937404.761803 trunc from 0x161777 to 0x176de7 (0x15671 bytes) 000418[1] 1764937404.833064 mapwrite 0x170e7c thru 0x17284e (0x19d3 bytes) 000419[1] 1764937404.918543 mapread 0x103141 thru 0x104d0b (0x1bcb bytes) 000423[1] 1764937404.967489 write 0x890d89 thru 0x891020 (0x298 bytes) 000424[1] 1764937404.998138 mapwrite 0x295796 thru 0x2968ba (0x1125 bytes) 000426[1] 1764937405.090596 write 0x213ac9 thru 0x215373 (0x18ab bytes) 000428[1] 1764937405.124037 write 0x1a9962 thru 0x1aaf44 (0x15e3 bytes) 000429[0] 1764937405.152451 trunc from 0x891021 to 0x14017a (0x750ea6 bytes) 000431[1] 1764937405.270113 mapwrite 0x95e0a0 thru 0x95fe9c (0x1dfd bytes) 000432[0] 1764937405.379620 trunc from 0x95fe9d to 0x488d56 (0x4d7146 bytes) 000433[0] 1764937405.431724 write 0x951a6e thru 0x95204a (0x5dd bytes) 000434[0] 1764937405.434760 mapread 0x2474c7 thru 0x249081 (0x1bbb bytes) 000435[0] 1764937405.583043 trunc from 0x95204b to 0x25efcf (0x6f307b bytes) 000439[1] 1764937405.682602 read 0x094ec7 thru 0x09689e (0x19d8 bytes) 000440[0] 1764937405.707609 mapread 0x1b3f2f thru 0x1b55fe (0x16d0 bytes) 000443[1] 1764937405.729680 trunc from 0x25efd0 to 0x32d206 (0xce237 bytes) 000444[1] 1764937405.808023 trunc from 0x32d207 to 0x99bb13 (0x66e90d bytes) 000447[1] 1764937405.918200 read 0x58a77e thru 0x58adbb (0x63e bytes) 000448[1] 1764937406.045151 mapwrite 0x26c9a8 thru 0x26dc4e (0x12a7 bytes) 000449[0] 1764937406.096493 write 0x3fc587 thru 0x3fc5f5 (0x6f bytes) 000453[1] 1764937406.214961 mapwrite 0x1961d0 thru 0x19749b (0x12cc bytes) 000454[1] 1764937406.361131 write 0x9e68f9 thru 0x9e7605 (0xd0d bytes) 000456[0] 1764937406.396271 write 0x43e465 thru 0x43f45e (0xffa bytes) 000458[1] 1764937406.472005 trunc from 0x9e7606 to 0x74bfd3 (0x29b632 bytes) 000459[1] 1764937406.542277 write 0x49ce0e thru 0x49d044 (0x237 bytes) 000460[1] 1764937406.563191 trunc from 0x74bfd4 to 0x1435ab (0x608a28 bytes) 000462[1] 1764937406.616872 read 0x11d138 thru 0x11dcb9 (0xb82 bytes) 000463[0] 1764937406.628903 trunc from 0x1435ac to 0x7716db (0x62e130 bytes) 000464[1] 1764937406.700119 read 0x1857f8 thru 0x185a76 (0x27f bytes) 000465[1] 1764937406.738607 write 0x077745 thru 0x078280 (0xb3c bytes) 000466[0] 1764937406.859885 mapread 0x6b6a3c thru 0x6b6d45 (0x30a bytes) 000467[1] 1764937406.927522 mapwrite 0x7aa001 thru 0x7aa21f (0x21f bytes) 000468[0] 1764937407.042042 write 0x57ae33 thru 0x57c6e2 (0x18b0 bytes) 000470[1] 1764937407.098088 read 0x04a0b3 thru 0x04a18f (0xdd bytes) 000471[0] 1764937407.147772 read 0x36e397 thru 0x36ef6b (0xbd5 bytes) 000472[0] 1764937407.189935 mapwrite 0x2d3d4c thru 0x2d4bc2 (0xe77 bytes) 000474[1] 1764937407.351748 write 0x4b34a1 thru 0x4b47e7 (0x1347 bytes) 000475[0] 1764937407.402419 trunc from 0x7aa220 to 0x6f6aeb (0xb3734 bytes) 000476[0] 1764937407.516435 mapread 0x6908f6 thru 0x6925a0 (0x1cab bytes) 000478[1] 1764937407.553984 read 0x0723ae thru 0x07312a (0xd7d bytes) 000480[1] 1764937407.632085 mapread 0x5724c9 thru 0x573075 (0xbad bytes) 000481[1] 1764937407.879867 mapread 0x59e147 thru 0x59ed00 (0xbba bytes) 000483[0] 1764937407.880852 write 0x7b7c48 thru 0x7b8f0d (0x12c6 bytes) 000488[1] 1764937408.014943 write 0x0b573e thru 0x0b6de2 (0x16a5 bytes) 000489[1] 1764937408.065161 read 0x069257 thru 0x06acbf (0x1a69 bytes) 000490[0] 1764937408.115804 read 0x02ad5f thru 0x02ae91 (0x133 bytes) 000491[0] 1764937408.266566 mapwrite 0x9f9559 thru 0x9f9f05 (0x9ad bytes) 000495[1] 1764937408.563447 mapwrite 0x91fcd8 thru 0x921c65 (0x1f8e bytes) 000496[1] 1764937408.705383 write 0x4c1ae1 thru 0x4c29e9 (0xf09 bytes) 000497[0] 1764937408.927738 mapread 0x025561 thru 0x025e23 (0x8c3 bytes) 000500[0] 1764937408.975546 mapwrite 0x11bfcf thru 0x11dcc2 (0x1cf4 bytes) All operations completed A-OK! PASS 16b (31s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 07:23:34 (1764937414) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (4s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 07:23:38 (1764937418) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.322572 s, 6.5 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.219551 s, 9.6 MB/s ldlm.namespaces.MGC192.168.202.157@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff9134c2bc3000.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff9134d13ea800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff9134d13ea800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff9134d13ea800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 11.931 s, 8.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.26901 s, 32.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.00386 s, 34.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.75166 s, 18.2 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.22441 s, 14.5 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.66494 s, 39.3 MB/s PASS 16d (45s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 07:24:23 (1764937463) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.243147 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102783 s, 10.2 MB/s PASS 16e (6s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 07:24:29 (1764937469) TIMEOUT PASS 16f (27s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 07:24:56 (1764937496) TIMEOUT PASS 16g (28s) == sanityn test 16i: read after truncate file ============ 07:25:24 (1764937524) ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16i (7s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 07:25:31 (1764937531) fail_loc=0x8000030a PASS 17 (10s) == sanityn test 18: mmap sanity check =========================================================================================== 07:25:41 (1764937541) mmap test1: basic mmap operation (PASS, 0.12153s) mmap test2: MAP_PRIVATE not write back (PASS, 0.1413s) mmap test3: concurrent mmap ops on two nodes (PASS, 3.6724s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.3975s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.12675s) mmap test6: check mmap write/read content on two nodes (PASS, 0.16452s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.1017s) PASS 18 (14s) == sanityn test 19: test concurrent uncached read races ========================================================================= 07:25:55 (1764937555) oleg257-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg257-client: oleg257-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (4s) == sanityn test 20: test extra readahead page left in cache ============================================================== 07:25:59 (1764937559) PASS 20 (7s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 07:26:06 (1764937566) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (6s) == sanityn test 23: others should see updated atime while another read============================================================== 07:26:12 (1764937572) now is 1764937575 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 new atime is 1764937636 PASS 23 (69s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 07:27:21 (1764937641) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 5.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 11.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 PASS 24a (6s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 07:27:27 (1764937647) PASS 24b (7s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 07:27:34 (1764937654) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (7s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 07:27:41 (1764937661) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (3s) == sanityn test 26a: allow mtime to get older ============ 07:27:44 (1764937664) utime: good mknod times 1764937665 <= 1764937666 <= 1764937666 for /mnt/lustre/f26a utime: good mknod times 1764937665 <= 1764937666 <= 1764937666 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (8s) == sanityn test 26b: sync mtime between ost and mds ====== 07:27:52 (1764937672) PASS 26b (7s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 07:28:02 (1764937682) 0 PASS 30 (8s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 07:28:10 (1764937690) fail_loc=0x314 PASS 31a (7s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 07:28:17 (1764937697) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg257-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.202.157@tcp:/lustre 7542784 12288 7524352 1% /mnt/lustre2 PASS 31b (20s) == sanityn test 31r: open-rename(replace) race =========== 07:28:37 (1764937717) -rw-r--r-- 1 root root 0 Dec 5 07:28 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (9s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 07:28:48 (1764937728) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (4s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 07:28:52 (1764937732) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (3s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 07:28:55 (1764937735) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (3s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 07:28:59 (1764937739) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (3s) == sanityn test 34: no lock timeout under IO ============= 07:29:02 (1764937742) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9134c2bc3000.ost_server_uuid,osc.lustre-OST0000-osc-ffff9134d13ea800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9134c2bc3000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9134d13ea800.ost_server_uuid in IDLE state after 0 sec oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9134c2bc3000.ost_server_uuid,osc.lustre-OST0001-osc-ffff9134d13ea800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9134c2bc3000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff9134d13ea800.ost_server_uuid in FULL state after 0 sec oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9134c2bc3000.ost_server_uuid,osc.lustre-OST0000-osc-ffff9134d13ea800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9134c2bc3000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9134d13ea800.ost_server_uuid in IDLE state after 0 sec oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9134c2bc3000.ost_server_uuid,osc.lustre-OST0001-osc-ffff9134d13ea800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9134c2bc3000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff9134d13ea800.ost_server_uuid in FULL state after 0 sec oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9134c2bc3000.ost_server_uuid,osc.lustre-OST0000-osc-ffff9134d13ea800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9134c2bc3000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9134d13ea800.ost_server_uuid in IDLE state after 0 sec oleg257-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9134c2bc3000.ost_server_uuid,osc.lustre-OST0001-osc-ffff9134d13ea800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9134c2bc3000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff9134d13ea800.ost_server_uuid in FULL state after 0 sec PASS 34 (126s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 07:31:08 (1764937868) fail_loc=0x80000317 Race attempt 0 Wait for 44697 44747 for 60 sec... /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1379: 44697 Killed createmany -o $MOUNT2/$tdir/a 4000 fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.202.157@tcp:/lustre 7.2G 12M 7.2G 1% /mnt/lustre 192.168.202.157@tcp:/lustre 7.2G 12M 7.2G 1% /mnt/lustre2 - open/close 670 (time 1764937885.13 total 10.00 last 66.98) - open/close 1307 (time 1764937895.14 total 20.01 last 63.65) - open/close 1857 (time 1764937905.15 total 30.03 last 54.90) - open/close 2464 (time 1764937915.16 total 40.04 last 60.65) - open/close 3106 (time 1764937925.18 total 50.05 last 64.09) - open/close 3787 (time 1764937935.18 total 60.06 last 68.07) total: 4000 open/close in 63.58 seconds: 62.91 ops/second PASS 35 (71s) == sanityn test 36: handle ESTALE/open-unlink correctly == 07:32:19 (1764937939) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg257-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.605068 s, 86.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7526400) after_dd(7460864) after(7512064) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.592897 s, 88.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7512064) after_dd(7469056) after(7520256) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.406562 s, 129 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7520256) after_dd(7448576) after(7499776) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.418337 s, 125 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7499776) after_dd(7460864) after(7512064) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.535204 s, 98.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7512064) after_dd(7469056) after(7520256) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.464122 s, 113 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7520256) after_dd(7465984) after(7517184) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.537081 s, 97.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7517184) after_dd(7468032) after(7519232) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.4428 s, 118 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7519232) after_dd(7471104) after(7522304) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.52947 s, 99.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7522304) after_dd(7460864) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.815026 s, 64.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7526400) after_dd(7464960) after(7516160) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.40595 s, 129 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7516160) after_dd(7448576) after(7499776) PASS 36 (293s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 07:37:12 (1764938232) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 - create 1342 (time 1764938245.40 total 10.00 last 134.20) - create 2620 (time 1764938255.40 total 20.00 last 127.78) - create 3872 (time 1764938265.41 total 30.01 last 125.11) - create 5255 (time 1764938275.41 total 40.01 last 138.24) - create 6547 (time 1764938285.41 total 50.02 last 129.15) - create 7841 (time 1764938295.42 total 60.02 last 129.35) - create 9250 (time 1764938305.42 total 70.02 last 140.88) total: 10000 create in 75.48 seconds: 132.48 ops/second PASS 37 (84s) == sanityn test 39a: test from 11063 ============================================================================================ 07:38:37 (1764938317) repeat after cancel_lru_locks PASS 39a (5s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 07:38:42 (1764938322) repeat after cancel_lru_locks PASS 39b (6s) == sanityn test 39c: check truncate mtime update ================================================================================ 07:38:48 (1764938328) repeat after cancel_lru_locks PASS 39c (6s) == sanityn test 39d: sync write should update mtime ====== 07:38:55 (1764938335) fail_loc=0x411 fail_loc=0 PASS 39d (6s) == sanityn test 40a: pdirops: create vs others ======================================================================== 07:39:00 (1764938340) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (14s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 07:39:14 (1764938354) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (14s) == sanityn test 40c: pdirops: link and others ======================================================================== 07:39:29 (1764938369) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (15s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 07:39:44 (1764938384) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (15s) == sanityn test 40e: pdirops: rename and others ======================================================================== 07:40:00 (1764938400) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (16s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 07:40:15 (1764938415) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (14s) == sanityn test 41b: pdirops: create vs create ======================================================================== 07:40:29 (1764938429) open: File exists Conflict PASS 41b (12s) == sanityn test 41c: pdirops: create vs link ======================================================================== 07:40:42 (1764938442) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (11s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 07:40:53 (1764938453) Conflict PASS 41d (13s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 07:41:06 (1764938466) Conflict PASS 41e (13s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 07:41:19 (1764938479) Conflict PASS 41f (11s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 07:41:31 (1764938491) Conflict PASS 41g (13s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 07:41:44 (1764938504) Conflict PASS 41h (13s) == sanityn test 41i: reint_open: create vs create ======== 07:41:57 (1764938517) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (1017s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 07:58:54 (1764939534) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (12s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 07:59:06 (1764939546) open: File exists Conflict PASS 42b (11s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 07:59:17 (1764939557) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (10s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 07:59:28 (1764939568) Conflict PASS 42d (12s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 07:59:40 (1764939580) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (12s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 07:59:53 (1764939593) Conflict PASS 42f (12s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 08:00:04 (1764939604) Conflict PASS 42g (11s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 08:00:15 (1764939615) Conflict PASS 42h (9s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 08:00:25 (1764939625) PASS 43a (41s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 08:01:06 (1764939666) Conflict PASS 43b (9s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 08:01:16 (1764939676) Conflict PASS 43c (8s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 08:01:25 (1764939685) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (10s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 08:01:34 (1764939694) Conflict PASS 43e (11s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 08:01:45 (1764939705) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (10s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 08:01:55 (1764939715) stat: cannot statx '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (10s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 08:02:05 (1764939725) Conflict PASS 43h (9s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 08:02:14 (1764939734) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (2s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 08:02:16 (1764939736) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists PASS 43j (97s) == sanityn test 43k: unlink vs create ==================== 08:03:53 (1764939833) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (737s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 08:16:10 (1764940570) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Fri Dec 5 08:16:15 EST 2025 PASS 44a (7s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 08:16:17 (1764940577) open: File exists Conflict PASS 44b (7s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 08:16:24 (1764940584) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (8s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 08:16:32 (1764940592) Conflict PASS 44d (7s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 08:16:39 (1764940599) Conflict PASS 44e (7s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 08:16:46 (1764940606) Conflict PASS 44f (7s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 08:16:53 (1764940613) Conflict PASS 44g (6s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 08:16:59 (1764940619) Conflict PASS 44h (7s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 08:17:06 (1764940626) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 08:17:07 (1764940627) PASS 45a (43s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 08:17:51 (1764940671) Conflict PASS 45b (6s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 08:17:57 (1764940677) Conflict PASS 45c (7s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 08:18:04 (1764940684) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (6s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 08:18:10 (1764940690) Conflict PASS 45e (6s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 08:18:17 (1764940697) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (7s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 08:18:23 (1764940703) stat: cannot statx '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (6s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 08:18:29 (1764940709) Conflict PASS 45h (6s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 08:18:36 (1764940716) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (2s) == sanityn test 45j: read vs rename ====================== 08:18:37 (1764940717) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (551s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 08:27:48 (1764941268) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (6s) == sanityn test 46b: pdirops: link vs create ======================================================================== 08:27:54 (1764941274) open: File exists Conflict PASS 46b (6s) == sanityn test 46c: pdirops: link vs link ======================================================================== 08:28:00 (1764941280) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (6s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 08:28:07 (1764941287) Conflict PASS 46d (7s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 08:28:13 (1764941293) Conflict PASS 46e (6s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 08:28:19 (1764941299) Conflict PASS 46f (6s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 08:28:25 (1764941305) Conflict PASS 46g (6s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 08:28:32 (1764941312) Conflict PASS 46h (5s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 08:28:37 (1764941317) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (2s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 08:28:39 (1764941319) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 08:28:40 (1764941320) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 08:28:41 (1764941321) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (2s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 08:28:43 (1764941323) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 08:28:44 (1764941324) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 08:28:45 (1764941325) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (2s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 08:28:47 (1764941327) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 08:28:48 (1764941328) 10+0 records in 10+0 records out 10240 bytes (10 kB, 10 KiB) copied, 0.00568395 s, 1.8 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (8s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 08:28:56 (1764941336) 0+1 records in 0+1 records out 158 bytes copied, 0.00674626 s, 23.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3146: kill: (242348) - No such process PASS 51a (4s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 08:29:00 (1764941340) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00388894 s, 263 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134627 s, 77.9 MB/s 3145728 PASS 51b (15s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 08:29:15 (1764941355) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0039434 s, 260 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 08:29:22 (1764941362) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939321 s, 112 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 08:29:25 (1764941365) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2430 0x97e 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2430 0x97e 0 read lease(1) has applied. PASS 51e (5s) == sanityn test 54: rename locking ======================= 08:29:30 (1764941370) llite.lustre-ffff9134c2bc3000.xattr_cache=1 llite.lustre-ffff9134d13ea800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504962 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:29:30.000000000 -0500 Modify: 2025-12-05 08:29:30.000000000 -0500 Change: 2025-12-05 08:29:30.000000000 -0500 Birth: 2025-12-05 08:29:30.000000000 -0500 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504965 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:29:36.000000000 -0500 Modify: 2025-12-05 08:29:36.000000000 -0500 Change: 2025-12-05 08:29:36.000000000 -0500 Birth: 2025-12-05 08:29:36.000000000 -0500 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:29:42.000000000 -0500 Modify: 2025-12-05 08:29:42.000000000 -0500 Change: 2025-12-05 08:29:42.000000000 -0500 Birth: 2025-12-05 08:29:42.000000000 -0500 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504967 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:29:42.000000000 -0500 Modify: 2025-12-05 08:29:42.000000000 -0500 Change: 2025-12-05 08:29:42.000000000 -0500 Birth: 2025-12-05 08:29:42.000000000 -0500 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:29:47.000000000 -0500 Modify: 2025-12-05 08:29:48.000000000 -0500 Change: 2025-12-05 08:29:48.000000000 -0500 Birth: 2025-12-05 08:29:47.000000000 -0500 File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504970 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:29:47.000000000 -0500 Modify: 2025-12-05 08:29:48.000000000 -0500 Change: 2025-12-05 08:29:48.000000000 -0500 Birth: 2025-12-05 08:29:47.000000000 -0500 PASS 54 (25s) == sanityn test 55a: rename vs unlink target dir ========= 08:29:55 (1764941395) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (8s) == sanityn test 55b: rename vs unlink source dir ========= 08:30:03 (1764941403) fail_loc=0x80000156 mv: cannot stat '/mnt/lustre/d55b.sanityn/d1/d2': No such file or directory PASS 55b (7s) == sanityn test 55c: rename vs unlink orphan target dir == 08:30:11 (1764941411) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (13s) == sanityn test 55d: rename file vs link ================= 08:30:24 (1764941424) fail_loc=0x155 mv: '/mnt/lustre/d55d.sanityn/f1' and '/mnt/lustre/d55d.sanityn/d55d.sanityn/f1' are the same file PASS 55d (10s) == sanityn test 60: Verify data_version behaviour ======== 08:30:34 (1764941434) PASS 60 (2s) == sanityn test 70a: cd directory && rm directory ======== 08:30:36 (1764941436) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 08:30:39 (1764941439) PASS 70b (3s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 08:30:41 (1764941441) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.00468179 s, 14.0 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (2s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 08:30:43 (1764941443) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.00369286 s, 17.7 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 08:30:44 (1764941444) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (1s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 08:30:45 (1764941445) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.00513548 s, 12.8 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 08:30:46 (1764941446) llite.lustre-ffff9134c2bc3000.xattr_cache=1 llite.lustre-ffff9134d13ea800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (3s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 08:30:49 (1764941449) llite.lustre-ffff9134c2bc3000.xattr_cache=1 llite.lustre-ffff9134d13ea800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (3s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 08:30:52 (1764941452) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00281761 s, 363 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00694364 s, 147 kB/s 252387: get lock2 252390: get lock1 252387: done 252387: get lock1 252390: done 252390: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 252390: cannot get lock2: Resource deadlock avoided 252390: exit rc=0 fcntl cmd 7 failed: Resource deadlock avoided 252387: cannot get lock1: Resource deadlock avoided 252387: done 252387: exit rc=0 PASS 74 (6s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 08:30:58 (1764941458) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0152568 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779483 s, 135 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3714: 252963 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (8s) == sanityn test 76: Verify MDT open_files listing ======== 08:31:06 (1764941466) opening files: ........ closing files: ........ PASS 76 (19s) == sanityn test 77a: check FIFO NRS policy =============== 08:31:25 (1764941485) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0736419 s, 228 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164395 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237807 s, 44.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332994 s, 31.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0388101 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0569726 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315488 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0519357 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.048258 s, 21.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0731278 s, 14.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.068975 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0445629 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0485276 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0598848 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376686 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0722514 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0710941 s, 14.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334195 s, 31.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285526 s, 36.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315709 s, 33.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269537 s, 38.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298363 s, 35.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036893 s, 28.4 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311244 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347612 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0381088 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356261 s, 29.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0396985 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0523959 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0438966 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415345 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0469278 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0421981 s, 24.8 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77a.sanityn' PASS 77a (4s) == sanityn test 77b: check CRR-N NRS policy ============== 08:31:29 (1764941489) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.088996 s, 189 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155375 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338267 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.037277 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0486319 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0534414 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0497776 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0514635 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0638789 s, 16.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0589155 s, 17.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0430162 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0664949 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0448706 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0651024 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363648 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0633128 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253662 s, 41.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=4 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241705 s, 43.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227851 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198133 s, 52.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233245 s, 45.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121404 s, 86.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176055 s, 59.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215544 s, 48.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294213 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319868 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560874 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830914 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00400859 s, 262 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216229 s, 48.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854525 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176356 s, 59.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611236 s, 172 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0711285 s, 236 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176535 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023941 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288427 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0377706 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329483 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0420505 s, 24.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034736 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0546753 s, 19.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039338 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0552724 s, 19.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0490238 s, 21.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0450426 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0688237 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398656 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283874 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0862542 s, 12.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246958 s, 42.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231327 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256039 s, 41.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253145 s, 41.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284993 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228439 s, 45.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188558 s, 55.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320776 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105497 s, 99.4 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348324 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289946 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624825 s, 168 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154384 s, 67.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209443 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134955 s, 77.7 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923407 s, 114 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (5s) == sanityn test 77c: check ORR NRS policy ================ 08:31:34 (1764941494) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.111479 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156313 s, 67.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171573 s, 61.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350636 s, 29.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374386 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361388 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.037925 s, 27.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290943 s, 36.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0399673 s, 26.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212746 s, 49.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0391387 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0385823 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0373497 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279788 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440173 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0598766 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0683862 s, 15.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263055 s, 39.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305267 s, 34.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218229 s, 48.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260398 s, 40.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025609 s, 40.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0388917 s, 27.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331247 s, 31.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296996 s, 35.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029924 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177952 s, 58.9 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=2 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268775 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0430193 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406694 s, 25.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380128 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143275 s, 73.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951516 s, 110 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.062209 s, 270 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276095 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0373135 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114553 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0973544 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0982588 s, 10.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119396 s, 8.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130347 s, 8.0 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0945203 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135764 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125677 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11131 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12833 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124186 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17016 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167394 s, 6.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368108 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172903 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0901265 s, 11.6 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361501 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0491553 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372509 s, 28.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160448 s, 65.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105099 s, 10.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143757 s, 72.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0449169 s, 23.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291048 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011349 s, 92.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0663269 s, 15.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398981 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0988221 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00426854 s, 246 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00363403 s, 289 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0823658 s, 204 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169923 s, 61.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195701 s, 53.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358259 s, 29.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0448588 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0527666 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0387661 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0538026 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0387107 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0447006 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0432298 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309409 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0453843 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0517874 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0472151 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276027 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0494424 s, 21.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156447 s, 67.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189794 s, 55.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255112 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171758 s, 61.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160929 s, 65.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158732 s, 66.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928223 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184555 s, 56.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833568 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065046 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120219 s, 87.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178104 s, 58.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147818 s, 70.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010919 s, 96.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694955 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228349 s, 45.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (6s) == sanityn test 77d: check TRR nrs policy ================ 08:31:40 (1764941500) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0918418 s, 183 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167609 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237241 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379136 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0497029 s, 21.1 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0430539 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0422955 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.041291 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364581 s, 28.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.038365 s, 27.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0497701 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231542 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0449246 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0662627 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0569591 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.055879 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.056957 s, 18.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157355 s, 66.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020361 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235111 s, 44.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256916 s, 40.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246449 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157477 s, 66.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103903 s, 101 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274334 s, 38.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00470956 s, 223 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246801 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179008 s, 58.6 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204364 s, 51.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116046 s, 90.4 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0392019 s, 26.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219434 s, 47.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181117 s, 57.9 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0928648 s, 181 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141794 s, 74.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183984 s, 57.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298699 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375639 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179037 s, 58.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386307 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031325 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218341 s, 48.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255866 s, 41.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0649418 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0599764 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0417809 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0520198 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.062828 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0692602 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0864849 s, 12.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=7 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249256 s, 42.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300116 s, 34.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279282 s, 37.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254949 s, 41.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255847 s, 41.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995476 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337623 s, 31.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0392581 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015982 s, 65.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197066 s, 53.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156428 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228277 s, 45.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196313 s, 53.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203651 s, 51.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291298 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264669 s, 39.6 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0678404 s, 247 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268507 s, 39.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187891 s, 55.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352598 s, 29.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329387 s, 31.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291575 s, 36.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0562724 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0523575 s, 20.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0452205 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0588472 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426832 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425549 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.070673 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.051284 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0644491 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0572847 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0716655 s, 14.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164522 s, 63.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238223 s, 44.0 MB/s 1+0 records in 1+0 records out ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725623 s, 145 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241632 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206806 s, 50.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221266 s, 47.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312529 s, 33.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338137 s, 31.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607136 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195697 s, 53.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199607 s, 52.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168937 s, 62.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124237 s, 84.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924295 s, 113 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027452 s, 38.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201166 s, 52.1 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (5s) == sanityn test 77e: check TBF NID nrs policy ============ 08:31:45 (1764941505) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.202.57@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.116106 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241371 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312388 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0431052 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0396566 s, 26.4 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0477236 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.047476 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383861 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0527747 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0618464 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0472552 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0489571 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0408277 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0701918 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0555545 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634383 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376619 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215132 s, 48.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250726 s, 41.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248066 s, 42.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217677 s, 48.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025124 s, 41.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334008 s, 31.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309917 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631969 s, 166 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0373039 s, 28.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299707 s, 35.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305583 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323737 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561149 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142904 s, 73.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00493376 s, 213 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00534179 s, 196 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0864138 s, 194 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214348 s, 48.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302732 s, 34.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027105 s, 38.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0473003 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0435405 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0464225 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194221 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0517677 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274517 s, 38.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0576289 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398916 s, 26.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244491 s, 42.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0399426 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352078 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0405587 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426548 s, 24.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195844 s, 53.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162385 s, 64.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160748 s, 65.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168355 s, 62.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248003 s, 42.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191564 s, 54.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209578 s, 50.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227914 s, 46.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182851 s, 57.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177987 s, 58.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236096 s, 44.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928034 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249082 s, 42.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00463359 s, 226 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00500016 s, 210 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00409902 s, 256 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0678263 s, 247 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148847 s, 70.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243991 s, 43.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0481715 s, 21.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386121 s, 27.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0624636 s, 16.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0392036 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425888 s, 24.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0407952 s, 25.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0667813 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440334 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325637 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0532316 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.066313 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0547107 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0471918 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283232 s, 37.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219509 s, 47.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027484 s, 38.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351275 s, 29.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317493 s, 33.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234377 s, 44.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313997 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363288 s, 28.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166652 s, 62.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0416441 s, 25.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236258 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0359951 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220802 s, 47.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341128 s, 30.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173833 s, 60.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278009 s, 37.7 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175701 s, 59.7 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.11646 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126902 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223371 s, 46.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0393216 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339876 s, 30.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402092 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232454 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0373376 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339636 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0396559 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406074 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0535623 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0804443 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.073847 s, 14.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0531129 s, 19.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355325 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542929 s, 19.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215989 s, 48.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138901 s, 75.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347777 s, 30.2 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0392842 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260713 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166455 s, 63.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278391 s, 37.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163682 s, 64.1 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03116 s, 33.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125646 s, 83.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218275 s, 48.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132864 s, 78.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127529 s, 82.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746086 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375059 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156642 s, 66.9 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' PASS 77e (9s) == sanityn test 77f: check TBF JobID nrs policy ========== 08:31:54 (1764941514) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0959776 s, 175 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122005 s, 85.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145966 s, 71.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259205 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0423579 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340178 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0416826 s, 25.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0428044 s, 24.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0476867 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0377117 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355491 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0486836 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0622216 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0395902 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131533 s, 79.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0555643 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0636926 s, 16.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152934 s, 68.6 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111465 s, 94.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159094 s, 65.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177661 s, 59.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232628 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274262 s, 38.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256703 s, 40.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022333 s, 47.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213216 s, 49.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087949 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124695 s, 84.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638375 s, 164 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00463555 s, 226 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719181 s, 146 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00333436 s, 314 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00388396 s, 270 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0587517 s, 286 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196919 s, 53.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239249 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361992 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270661 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0443723 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0433188 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372051 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542202 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0615292 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313051 s, 33.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0486391 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0447221 s, 23.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0473085 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0447985 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240152 s, 43.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.064916 s, 16.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237814 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214057 s, 49.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195193 s, 53.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244198 s, 42.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020442 s, 51.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02345 s, 44.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200594 s, 52.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207232 s, 50.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120354 s, 87.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020287 s, 51.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178058 s, 58.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257948 s, 40.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00420858 s, 249 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236919 s, 44.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265752 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264061 s, 39.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0962923 s, 174 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107181 s, 97.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305125 s, 34.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0407388 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304022 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.037956 s, 27.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0580884 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305132 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0607956 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0458764 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031164 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0647388 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0471073 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0371008 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0572663 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0535117 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0466546 s, 22.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250229 s, 41.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229246 s, 45.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303686 s, 34.5 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363363 s, 28.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02086 s, 50.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337131 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235854 s, 44.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029726 s, 35.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.037 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253466 s, 41.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383574 s, 27.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0418307 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035163 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00436861 s, 240 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032393 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116148 s, 90.3 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0682579 s, 246 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251284 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384486 s, 27.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321816 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0519601 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0476608 s, 22.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0438125 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0365764 s, 28.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415922 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0641952 s, 16.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0410921 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0613318 s, 17.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0584102 s, 18.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0561421 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0717766 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283445 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0676744 s, 15.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=1 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019814 s, 52.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190672 s, 55.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221421 s, 47.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219652 s, 47.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134938 s, 77.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150415 s, 69.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241995 s, 43.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169382 s, 61.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176164 s, 59.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297765 s, 35.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208222 s, 50.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738316 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110506 s, 94.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134074 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208179 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00258063 s, 406 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' PASS 77f (8s) == sanityn test 77g: Change TBF type directly ============ 08:32:02 (1764941522) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (4s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 08:32:07 (1764941527) oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg257-client: oleg257-server: ssh exited with exit code 2 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg257-client: oleg257-server: ssh exited with exit code 12 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg257-client: oleg257-server: ssh exited with exit code 12 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg257-client: oleg257-server: ssh exited with exit code 12 PASS 77h (4s) == sanityn test 77i: Change rank of TBF rule ============= 08:32:11 (1764941531) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (9s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 08:32:20 (1764941540) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.054812 s, 306 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166922 s, 62.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279554 s, 37.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304507 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0354307 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341972 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372493 s, 28.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.038308 s, 27.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0414748 s, 25.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0487576 s, 21.5 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0518121 s, 20.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272381 s, 38.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319639 s, 32.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.050435 s, 20.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287306 s, 36.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0405928 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364032 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203795 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190793 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219065 s, 47.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213448 s, 49.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231094 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202417 s, 51.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314783 s, 33.3 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186833 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00511691 s, 205 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308171 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671898 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131948 s, 79.5 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149589 s, 70.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00408983 s, 256 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375117 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191619 s, 54.7 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.94268 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.5847 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (61s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 08:33:21 (1764941601) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.729894 s, 23.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0579723 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0974851 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0943812 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.099985 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152199 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145894 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14843 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.132207 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.249144 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.269587 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.299045 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.290915 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.318873 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.326251 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.378657 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.425536 s, 2.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00239258 s, 438 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117254 s, 8.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103146 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0665291 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0845311 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0794162 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10204 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0973328 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0961347 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0894421 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0797048 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0645893 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0497067 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109112 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285896 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425459 s, 24.6 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9292 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9595 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.688092 s, 24.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133828 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141311 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186069 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172469 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171314 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154577 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.200194 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203667 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.334994 s, 3.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.39305 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.397689 s, 2.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.393678 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.411385 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.408076 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.418261 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.440939 s, 2.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0777549 s, 13.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0671573 s, 15.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0654063 s, 16.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0871967 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0720969 s, 14.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0908762 s, 11.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0704341 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.084002 s, 12.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0946991 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0857056 s, 12.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.086876 s, 12.1 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120426 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116463 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0986112 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0962477 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0975737 s, 10.7 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.7186 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9115 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (144s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 08:35:45 (1764941745) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.249368 s, 67.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309491 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0459455 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0458548 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383917 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361786 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634076 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101381 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0844327 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0935439 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0480055 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0644807 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0456221 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13276 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129296 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130353 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130723 s, 8.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323011 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701267 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275159 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288269 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00458083 s, 229 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589006 s, 178 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762475 s, 138 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00494278 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00516454 s, 203 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00499584 s, 210 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00526409 s, 199 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00483056 s, 217 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00523001 s, 200 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0451368 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375303 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0671847 s, 15.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.30192 s, 19.8 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.84652 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.202.57@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.202.57@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.212115 s, 79.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.038037 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350374 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406839 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0698203 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0815761 s, 12.9 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.093887 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0908266 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0801004 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118001 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12415 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152746 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143971 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201307 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.240046 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.261706 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.269462 s, 3.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108554 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034208 s, 30.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280378 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0393153 s, 26.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018917 s, 55.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00499931 s, 210 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210509 s, 49.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00493675 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268968 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288633 s, 36.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0388498 s, 27.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360667 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567406 s, 185 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316839 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00354223 s, 296 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010327 s, 102 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.17045 s, 20.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.84911 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.202.57@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.171246 s, 98.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119722 s, 87.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196402 s, 53.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0466576 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0595671 s, 17.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0817393 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0575867 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0584197 s, 17.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0679268 s, 15.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0916069 s, 11.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0658546 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0917114 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0738085 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113183 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104559 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108912 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148025 s, 7.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222081 s, 47.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027456 s, 38.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140335 s, 74.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300074 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00405409 s, 259 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265056 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.004389 s, 239 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149881 s, 70.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643812 s, 163 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00437424 s, 240 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0424114 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00467712 s, 224 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00412227 s, 254 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246444 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700464 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011905 s, 88.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 6.2266 s, 16.8 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.07056 s, 20.7 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.348415 s, 48.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017652 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0382255 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231413 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208464 s, 50.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0697542 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928205 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0599947 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287768 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406244 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0873224 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.20641 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14627 s, 7.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179216 s, 5.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.25587 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1965 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1965 s, 5.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0575484 s, 18.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333206 s, 31.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.061857 s, 17.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0485913 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0643805 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0616775 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0527263 s, 19.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0466434 s, 22.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0555154 s, 18.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0641834 s, 16.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0647423 s, 16.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0711246 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0554982 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0610935 s, 17.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0598592 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0797339 s, 13.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.1096 s, 10.4 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.8555 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.86473 s, 17.9 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.87996 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.486584 s, 34.5 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376948 s, 27.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328865 s, 31.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0809736 s, 12.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0551925 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0806648 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0567694 s, 18.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0748746 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0580097 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311709 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.293499 s, 3.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.34069 s, 3.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.351844 s, 3.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.364358 s, 2.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.355794 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.359264 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.369389 s, 2.8 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0471206 s, 22.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323425 s, 32.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383963 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0407511 s, 25.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0514711 s, 20.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0586507 s, 17.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0394889 s, 26.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0462272 s, 22.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0429626 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0466143 s, 22.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0480527 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0488902 s, 21.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0517954 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0544636 s, 19.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.049324 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0560522 s, 18.7 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.7681 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.5742 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.239395 s, 70.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0422336 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.044904 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0597355 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0545774 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105189 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0986865 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129634 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121228 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108873 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0922961 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103624 s, 10.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16789 s, 6.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148828 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133872 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151808 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165598 s, 6.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112835 s, 92.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00468659 s, 224 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00478875 s, 219 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406784 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0574009 s, 18.3 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0493024 s, 21.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0447293 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833697 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858762 s, 122 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00444548 s, 236 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308191 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.044328 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138113 s, 75.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217282 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263367 s, 39.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076697 s, 137 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.92632 s, 17.7 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.85229 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.304544 s, 55.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014584 s, 71.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0488848 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0835558 s, 12.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0925705 s, 11.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0768386 s, 13.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0576094 s, 18.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0410206 s, 25.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0876585 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0803635 s, 13.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0937649 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10587 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127729 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233417 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.274239 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.276048 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.354432 s, 3.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0047475 s, 221 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0467139 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0756681 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0670303 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00494694 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0814393 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798816 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837119 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0718242 s, 14.6 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0949294 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0663833 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.088705 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0463678 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380729 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323821 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260586 s, 40.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.1896 s, 10.3 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.90366 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.99474 s, 10.5 MB/s Write runtime is 12 s, speed is 8.333333 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.82578 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (398s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 08:42:23 (1764942143) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (5s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 08:42:28 (1764942148) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg257-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 3.89854 s, 269 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg257-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 40.0347 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (53s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 08:43:21 (1764942201) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.117774 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266223 s, 39.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035688 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026365 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335264 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259242 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415625 s, 25.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0631231 s, 16.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0613969 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0411617 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0702567 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330468 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.041771 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0514372 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.071367 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0908168 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0964021 s, 10.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9134c2bc3000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9134c2bc3000.lock_unused_count=3 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00433318 s, 242 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615604 s, 170 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0609118 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237153 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109739 s, 95.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00377993 s, 277 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621242 s, 169 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713668 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0043173 s, 243 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949476 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0558168 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.066614 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616157 s, 170 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00262398 s, 400 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0736579 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289019 s, 36.3 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg257-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg257-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.44761 s, 19.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.97311 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.236586 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227074 s, 46.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260581 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0530971 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266217 s, 39.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0682651 s, 15.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0701344 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140623 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115181 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142794 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145718 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133222 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124502 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217217 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255515 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.231125 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.266691 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030264 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370837 s, 28.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342033 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0528223 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0430054 s, 24.4 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0447171 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425506 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0354013 s, 29.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0433003 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368034 s, 28.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0514421 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0495663 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0410037 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0395311 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.042345 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0438904 s, 23.9 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg257-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg257-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.71626 s, 18.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.01099 s, 20.9 MB/s Read runtime is 7 s, speed is 14.285714 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (75s) == sanityn test 77o: Changing rank should not panic ====== 08:44:36 (1764942276) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (6s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 08:44:42 (1764942282) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (60s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 08:45:42 (1764942342) mds.MDS.mdt.nrs_policies=tbf oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg257-client: oleg257-server: ssh exited with exit code 36 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (19s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 08:46:01 (1764942361) oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device pdsh@oleg257-client: oleg257-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (5s) == sanityn test 79: xattr: intent error ================== 08:46:06 (1764942366) File: /mnt/lustre/d79.sanityn Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505430 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:46:07.000000000 -0500 Modify: 2025-12-05 08:46:07.000000000 -0500 Change: 2025-12-05 08:46:07.000000000 -0500 Birth: 2025-12-05 08:46:07.000000000 -0500 fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (14s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 08:46:20 (1764942380) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (2s) == sanityn test 80b: Accessing directory during migration ========================================================== 08:46:22 (1764942382) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 08:46:24 (1764942384) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 08:46:26 (1764942386) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (2s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 08:46:27 (1764942387) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (2s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 08:46:29 (1764942389) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7141 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7141 PASS 82 (3s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 08:46:32 (1764942392) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (2s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 08:46:35 (1764942395) fail_loc=0x8000060b PASS 84 (9s) == sanityn test 90: open/create and unlink striped directory ========================================================== 08:46:43 (1764942403) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (2s) == sanityn test 91: chmod and unlink striped directory === 08:46:45 (1764942405) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 08:46:46 (1764942406) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (2s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 08:46:48 (1764942408) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2644 0xa54 0 1 2626 0xa42 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2645 0xa55 0 1 2627 0xa43 0 rc1=0 and rc2=0 PASS 93 (10s) == sanityn test 94: signal vs CP callback race =========== 08:46:58 (1764942418) osc.lustre-OST0000-osc-ffff9134c2bc3000.idle_timeout=0 osc.lustre-OST0000-osc-ffff9134d13ea800.idle_timeout=0 osc.lustre-OST0001-osc-ffff9134c2bc3000.idle_timeout=0 osc.lustre-OST0001-osc-ffff9134d13ea800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0982551 s, 83.4 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 3.07498 s, 1.3 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5135: 283339 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0351601 s, 116 kB/s osc.lustre-OST0000-osc-ffff9134c2bc3000.idle_timeout=debug osc.lustre-OST0000-osc-ffff9134d13ea800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9134c2bc3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9134d13ea800.idle_timeout=debug PASS 94 (12s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 08:47:10 (1764942430) llite.lustre-ffff9134c2bc3000.fast_read=0 llite.lustre-ffff9134d13ea800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB, 12 KiB) copied, 0.0022257 s, 5.5 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff9134c2bc3000.fast_read=1 llite.lustre-ffff9134d13ea800.fast_read=1 PASS 95b (9s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 08:47:19 (1764942439) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 08:47:20 (1764942440) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00325331 s, 1.3 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (3s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 08:47:23 (1764942443) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0274941 s, 76.3 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (3s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 08:47:27 (1764942447) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0197321 s, 106 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (3s) == sanityn test 100e: DoM: read on open and file size ==== 08:47:29 (1764942449) 1+0 records in 1+0 records out 12000 bytes (12 kB, 12 KiB) copied, 0.00163072 s, 7.4 MB/s PASS 100e (3s) == sanityn test 101a: Discard DoM data on unlink ========= 08:47:32 (1764942452) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000540419 s, 7.6 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 08:47:34 (1764942454) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000609438 s, 6.7 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 08:47:37 (1764942457) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000556493 s, 7.4 MB/s PASS 101c (4s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 08:47:42 (1764942462) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1764942463 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1764942465 Finishing test test23 at 1764942465 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 08:47:49 (1764942469) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (2s) == sanityn test 105: Glimpse and lock cancel race ======== 08:47:51 (1764942471) fail_loc=0x416 PASS 105 (49s) == sanityn test 106a: Verify the btime via statx() ======= 08:48:40 (1764942520) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 08:48:41 (1764942521) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00468853 s, 218 kB/s File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:48:42.000000000 -0500 Modify: 2025-12-05 08:48:42.000000000 -0500 Change: 2025-12-05 08:48:42.000000000 -0500 Birth: 2025-12-05 08:48:42.000000000 -0500 /mnt/lustre/f106b.sanityn 144115205272505458 -rw-r--r-- 1 0 0 1764942522 1764942522 1764942522 File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:48:42.000000000 -0500 Modify: 2025-12-05 08:48:42.000000000 -0500 Change: 2025-12-05 08:48:42.000000000 -0500 Birth: 2025-12-05 08:48:42.000000000 -0500 1764942522 1024 1 PASS 106b (3s) == sanityn test 106c: Verify statx attributes mask ======= 08:48:44 (1764942524) PASS 106c (3s) == sanityn test 107a: Basic grouplock conflict =========== 08:48:47 (1764942527) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.049528 s, 212 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2653 0xa5d 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 First grouplock blocks second one PASS 107a (4s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 08:48:52 (1764942532) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.0692414 s, 151 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2632 0xa48 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7141 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) == sanityn test 108a: lseek: parallel updates ============ 08:49:00 (1764942540) 1+0 records in 1+0 records out 10000 bytes (10 kB, 9.8 KiB) copied, 0.00238471 s, 4.2 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 4.31147 s, 1.9 MB/s PASS 108a (7s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 08:49:07 (1764942547) 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre 192.168.202.157@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.157@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg257-client.virtnet /mnt/lustre (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: Force libcfs to create 2 CPU partitions Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre Starting client: oleg257-client.virtnet: -o user_xattr,flock oleg257-server@tcp:/lustre /mnt/lustre2 PASS 109 (605s) == sanityn test 110: do not grant another lock on resend ========================================================== 08:59:12 (1764943152) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: /mnt/lustre/f110.sanityn Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-12-05 08:59:13.000000000 -0500 Modify: 2025-12-05 08:59:13.000000000 -0500 Change: 2025-12-05 08:59:13.000000000 -0500 Birth: 2025-12-05 08:59:13.000000000 -0500 fail_loc=0 fail_val=0 Connected clients: oleg257-client.virtnet oleg257-client.virtnet PASS 110 (37s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 08:59:49 (1764943189) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 08:59:50 (1764943190) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 08:59:52 (1764943192) lustre-OST0000-osc-ffff9134c82d0000 active. lustre-OST0001-osc-ffff9134c82d0000 active. lustre-OST0000-osc-ffff9134c82d0000 active. lustre-OST0001-osc-ffff9134c82d0000 active. MGC192.168.202.157@tcp active. PASS 113 (2s) cleanup: ====================================================== == sanityn test complete, duration 6243 sec ============== 08:59:54 (1764943194) Stopping clients: oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 opts: