-----============= acceptance-small: sanityn ============----- Tue Apr 14 16:58:41 EDT 2026 oleg305-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Started clients oleg305-client.virtnet: 192.168.203.105@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) oleg305-client.virtnet: executing check_config_client /mnt/lustre oleg305-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg305-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8dc2456b5000.idle_timeout=debug osc.lustre-OST0000-osc-ffff8dc246946800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8dc2456b5000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8dc246946800.idle_timeout=debug disable quota as required oleg305-server: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0513913 s, 20.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7143] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 16:59:24 (1776200364) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (8s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 16:59:32 (1776200372) -rw-r--r-- 1 root root 0 Apr 14 16:59 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (8s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 16:59:40 (1776200380) -rw-r--r-- 1 root root 0 Apr 14 16:59 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (9s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 16:59:49 (1776200389) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (11s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 17:00:01 (1776200401) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (10s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 17:00:12 (1776200412) total 1 -rwxrwxrwx 1 root root 0 Apr 14 16:59 f2a -rwxrwxrwx 1 root root 0 Apr 14 16:59 f2b total 1 -rwxrwxrwx 1 root root 0 Apr 14 16:59 f2a -rwxrwxrwx 1 root root 0 Apr 14 16:59 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.00916849 s, 55.8 kB/s PASS 2e (7s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 17:00:19 (1776200419) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (4s) == sanityn test 2g: check blocks update on sync write ==== 17:00:23 (1776200423) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.399264 s, 5.3 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (7s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 17:00:30 (1776200430) PASS 3 (6s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 17:00:36 (1776200436) PASS 4 (8s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 17:00:44 (1776200444) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (5s) == sanityn test 6: remove of open file on other node ============================================================================ 17:00:50 (1776200450) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (6s) == sanityn test 7: remove of open directory on other node ======================================================================= 17:00:57 (1776200457) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (7s) == sanityn test 8: remove of open special file on other node ==================================================================== 17:01:04 (1776200464) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (6s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 17:01:10 (1776200470) PASS 9a (7s) == sanityn test 9b: append to striped sparse file ======== 17:01:17 (1776200477) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0637506 s, 16.4 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.0425012 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (8s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 17:01:25 (1776200485) 1+0 records in 1+0 records out 1 byte copied, 0.00850176 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.011461 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0114865 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0262664 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.022664 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0240414 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0134916 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0107491 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0219865 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00782828 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00774452 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.013452 s, 0.1 kB/s PASS 10a (8s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 17:01:34 (1776200494) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0347875 s, 88.3 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0968605 s, 42.3 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.000296956 s, 10.3 MB/s PASS 10b (8s) == sanityn test 11: execution of file opened for write should return error ============================================================== 17:01:41 (1776200501) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (8s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 17:01:49 (1776200509) warning: '-runtime' deprecated, use '-t runtime' instead - link 306 (time 1776200522.01 total 10.01 last 30.56) - link 620 (time 1776200532.01 total 20.02 last 31.38) - link 960 (time 1776200542.07 total 30.07 last 33.82) - link 1300 (time 1776200552.07 total 40.08 last 33.98) - link 1629 (time 1776200562.07 total 50.08 last 32.89) - link 1901 (time 1776200572.11 total 60.12 last 27.11) - link 2157 (time 1776200582.13 total 70.14 last 25.55) - link 2419 (time 1776200592.13 total 80.14 last 26.18) - link 2709 (time 1776200602.14 total 90.15 last 28.96) total: 2995 link in 100.01 seconds: 29.95 ops/second using seed 4015823528 running for 100 seconds - stat 8698 (time 1776200524 ; total 11 ; last 11) - stat 10000 (time 1776200525 ; total 12 ; last 1) - stat 19551 (time 1776200536 ; total 23 ; last 11) - stat 20000 (time 1776200536 ; total 23 ; last 0) - stat 29291 (time 1776200547 ; total 34 ; last 11) - stat 30000 (time 1776200547 ; total 34 ; last 0) - stat 39117 (time 1776200558 ; total 45 ; last 11) - stat 40000 (time 1776200559 ; total 46 ; last 1) - stat 45948 (time 1776200570 ; total 57 ; last 11) - stat 50000 (time 1776200580 ; total 67 ; last 10) - stat 54210 (time 1776200591 ; total 78 ; last 11) - stat 58693 (time 1776200602 ; total 89 ; last 11) - stat 60000 (time 1776200604 ; total 91 ; last 2) total: 63795 stats in 100 seconds: 637.950012 stats/second - unlinked 0 (time 1776200563 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile2995) error: No such file or directory total: 2994 unlinks in 84 seconds: 35.642857 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (19735) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (19737) - No such process PASS 12 (144s) == sanityn test 13: test directory page revocation ======= 17:04:13 (1776200653) f13 f13 PASS 13 (10s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 17:04:23 (1776200663) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4298: 20908 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (7s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 17:04:31 (1776200671) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4298: 21483 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (7s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 17:04:37 (1776200677) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 22055 Terminated $DIR1/$tdir/sleep 60 PASS 14b (6s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 17:04:43 (1776200683) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 22631 Terminated $DIR1/$tdir/sleep 60 PASS 14c (6s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 17:04:49 (1776200689) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 23207 Terminated $DIR1/$tdir/sleep 60 PASS 14d (8s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 17:04:57 (1776200697) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7519232 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7519232kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (22s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 17:05:19 (1776200719) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.419047 s, 5.0 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.349104 s, 6.0 MB/s Chance of close/open is 1 in 50 Seed set to 723 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002[1] 1776200723.875094 write 0x1f0f16 thru 0x1fc035 (0xb120 bytes) 000003[1] 1776200723.921994 write 0x8e21d0 thru 0x8f0b07 (0xe938 bytes) 000004[1] 1776200723.992285 read 0x3a7043 thru 0x3b3c0d (0xcbcb bytes) 000006[1] 1776200724.068999 mapread 0x307eb0 thru 0x30cc86 (0x4dd7 bytes) 000007[0] 1776200724.126176 mapwrite 0x151da8 thru 0x15da31 (0xbc8a bytes) truncating to largest ever: 0x7aa302 000009[1] 1776200724.414591 trunc from 0x8f0b08 to 0x7aa301 (0x146806 bytes) 000012[0] 1776200724.553232 write 0x36e4c0 thru 0x377c22 (0x9763 bytes) 000013[1] 1776200724.626057 mapread 0x28be13 thru 0x29389f (0x7a8d bytes) 000019[1] 1776200724.874461 write 0x76e88f thru 0x771ea2 (0x3614 bytes) 000020[0] 1776200724.923998 write 0x904c09 thru 0x914758 (0xfb50 bytes) 000021[1] 1776200725.013120 write 0x59ba5f thru 0x5a07ad (0x4d4f bytes) 000023[0] 1776200725.076067 mapread 0x6e1441 thru 0x6e14d0 (0x90 bytes) 000027[0] 1776200725.144270 read 0x5be27d thru 0x5c8614 (0xa398 bytes) 000030[1] 1776200725.205268 write 0x108bd3 thru 0x1114d6 (0x8904 bytes) 000031[1] 1776200725.277509 write 0x831126 thru 0x83b17f (0xa05a bytes) 000033[0] 1776200725.362152 read 0x5e09c8 thru 0x5ec546 (0xbb7f bytes) 000037[0] 1776200725.491183 read 0x0960ab thru 0x09f4c5 (0x941b bytes) 000038[0] 1776200725.619320 mapread 0x726ab6 thru 0x733d77 (0xd2c2 bytes) 000039[1] 1776200725.695664 mapwrite 0x1dc602 thru 0x1e3c5a (0x7659 bytes) truncating to largest ever: 0x98322d 000040[1] 1776200725.852594 trunc from 0x914759 to 0x98322c (0x6ead4 bytes) 000047[0] 1776200726.063696 write 0x204ab0 thru 0x2095ab (0x4afc bytes) 000052[0] 1776200726.236115 trunc from 0x98322d to 0x12ac6f (0x8585bd bytes) 000057[1] 1776200726.325003 mapread 0x0af20a thru 0x0b26eb (0x34e2 bytes) 000060[0] 1776200726.414548 read 0x08a089 thru 0x0946e4 (0xa65c bytes) 000061[1] 1776200726.452378 trunc from 0x12ac70 to 0x85fdaa (0x73513b bytes) 000062[1] 1776200726.509528 trunc from 0x85fdab to 0x782afd (0xdd2ad bytes) 000064[1] 1776200726.561691 write 0x1a1607 thru 0x1b0b5e (0xf558 bytes) 000065[0] 1776200726.584044 mapread 0x5b804d thru 0x5c5c4a (0xdbfe bytes) 000067[0] 1776200726.750035 trunc from 0x782afe to 0x28eaa5 (0x4f4058 bytes) 000068[1] 1776200726.803233 write 0x5470f3 thru 0x548459 (0x1367 bytes) 000073[1] 1776200726.888416 write 0x3dbfc3 thru 0x3e8d58 (0xcd96 bytes) 000074[0] 1776200726.910551 write 0x68b86c thru 0x691286 (0x5a1b bytes) 000075[1] 1776200726.927396 write 0x4f189e thru 0x4f7ead (0x6610 bytes) 000081[0] 1776200727.089185 trunc from 0x691287 to 0x43d250 (0x254036 bytes) 000082[0] 1776200727.153425 write 0x20e74a thru 0x2116f2 (0x2fa9 bytes) 000084[1] 1776200727.242912 write 0x9ab520 thru 0x9b6038 (0xab19 bytes) 000085[0] 1776200727.332270 mapwrite 0x72c674 thru 0x738f63 (0xc8f0 bytes) 000086[1] 1776200727.653232 write 0x6c98f7 thru 0x6d97c4 (0xfece bytes) 000087[1] 1776200727.740369 trunc from 0x9b6039 to 0x157da2 (0x85e296 bytes) 000088[1] 1776200727.817054 mapwrite 0x3c438b thru 0x3d1fce (0xdc44 bytes) 000089[0] 1776200727.910854 mapread 0x3a7024 thru 0x3ac8c2 (0x589f bytes) 000090[1] 1776200727.978584 write 0x1d6ea0 thru 0x1df5a1 (0x8702 bytes) 000093[1] 1776200728.047891 read 0x32d66f thru 0x3353b4 (0x7d46 bytes) 000094[1] 1776200728.067917 mapread 0x288244 thru 0x289ca8 (0x1a65 bytes) 000095[0] 1776200728.077507 read 0x0d09f7 thru 0x0d1f79 (0x1583 bytes) 000098[1] 1776200728.130251 write 0x022ea4 thru 0x031e27 (0xef84 bytes) 000099[0] 1776200728.157169 read 0x14bf92 thru 0x15936b (0xd3da bytes) 000100[0] 1776200728.212732 trunc from 0x3d1fcf to 0x4cb32e (0xf9360 bytes) 000102[1] 1776200728.330795 mapread 0x07476f thru 0x0819e2 (0xd274 bytes) 000103[0] 1776200728.472212 write 0x06e144 thru 0x06e31d (0x1da bytes) 000105[1] 1776200728.538407 mapwrite 0x3448af thru 0x3545e2 (0xfd34 bytes) 000107[1] 1776200728.932756 write 0x709be5 thru 0x710d03 (0x711f bytes) 000110[1] 1776200729.017541 read 0x039c86 thru 0x040b91 (0x6f0c bytes) 000111[0] 1776200729.197501 write 0x7326bb thru 0x73b2d0 (0x8c16 bytes) 000112[1] 1776200729.271097 read 0x6a5f02 thru 0x6b45dd (0xe6dc bytes) 000114[1] 1776200729.370124 read 0x027211 thru 0x029468 (0x2258 bytes) 000117[1] 1776200729.468907 mapread 0x7346b7 thru 0x73b2d0 (0x6c1a bytes) 000118[0] 1776200729.633909 mapwrite 0x65f421 thru 0x6672fd (0x7edd bytes) 000121[1] 1776200729.875889 read 0x2435bb thru 0x24fc95 (0xc6db bytes) 000126[0] 1776200729.966859 read 0x346be4 thru 0x34ca63 (0x5e80 bytes) 000128[1] 1776200730.037560 mapread 0x40860f thru 0x416d85 (0xe777 bytes) 000129[1] 1776200730.038328 write 0x8d44e0 thru 0x8d5a5e (0x157f bytes) 000130[1] 1776200730.070318 trunc from 0x8d5a5f to 0x8b2f8d (0x22ad1 bytes) 000131[1] 1776200730.191235 mapwrite 0x9fa0aa thru 0x9ffd8a (0x5ce1 bytes) 000132[0] 1776200730.405682 trunc from 0x9ffd8b to 0x1724f6 (0x88d894 bytes) 000133[0] 1776200730.502110 trunc from 0x1724f7 to 0x82e39c (0x6bbea6 bytes) 000134[1] 1776200730.585805 mapread 0x5523a9 thru 0x55a30f (0x7f67 bytes) 000135[1] 1776200730.681907 read 0x67ec64 thru 0x6826c7 (0x3a64 bytes) 000137[0] 1776200730.751701 read 0x3cd794 thru 0x3db824 (0xe091 bytes) 000138[0] 1776200730.816903 write 0x67699c thru 0x681126 (0xa78b bytes) 000139[0] 1776200730.881030 read 0x1fb44a thru 0x202aec (0x76a3 bytes) 000140[1] 1776200730.982104 mapread 0x10c84e thru 0x1127e9 (0x5f9c bytes) 000141[0] 1776200731.087434 trunc from 0x82e39d to 0x52d657 (0x300d45 bytes) 000143[0] 1776200731.246973 read 0x3ba4d7 thru 0x3c2a16 (0x8540 bytes) 000144[0] 1776200731.273411 trunc from 0x52d658 to 0x262684 (0x2cafd3 bytes) 000145[0] 1776200731.365700 mapwrite 0x12c2ff thru 0x137304 (0xb006 bytes) 000149[0] 1776200731.548563 trunc from 0x262685 to 0x016364 (0x24c320 bytes) 000150[0] 1776200731.581975 read 0x0155ef thru 0x016364 (0xd76 bytes) 000154[1] 1776200731.621888 mapread 0x00fbe7 thru 0x016364 (0x677e bytes) 000158[1] 1776200731.762557 read 0x011a0e thru 0x016364 (0x4957 bytes) 000159[0] 1776200731.778426 mapwrite 0x4f2bce thru 0x4fce9a (0xa2cd bytes) 000160[0] 1776200732.068958 trunc from 0x4fce9b to 0x5f932b (0xfc491 bytes) 000161[0] 1776200732.162898 mapread 0x5634fc thru 0x56f746 (0xc24b bytes) 000162[1] 1776200732.296544 write 0x03ab1b thru 0x0489cf (0xdeb5 bytes) 000163[0] 1776200732.437228 mapread 0x364419 thru 0x366460 (0x2048 bytes) 000164[1] 1776200732.495754 mapread 0x012abd thru 0x01715b (0x469f bytes) 000165[0] 1776200732.518415 read 0x271342 thru 0x27255f (0x121e bytes) 000168[1] 1776200732.679242 trunc from 0x5f932c to 0x5653a3 (0x93f88 bytes) 000171[1] 1776200732.760366 mapwrite 0x625e3c thru 0x630529 (0xa6ee bytes) 000172[1] 1776200732.943214 trunc from 0x63052a to 0x578f06 (0xb7623 bytes) 000174[0] 1776200733.020347 trunc from 0x578f07 to 0x80ca6d (0x293b67 bytes) 000175[0] 1776200733.067373 trunc from 0x80ca6e to 0x34261f (0x4ca44e bytes) 000179[0] 1776200733.211580 mapread 0x1b7f2d thru 0x1c088a (0x895e bytes) 000181[1] 1776200733.307474 write 0x17528d thru 0x183911 (0xe685 bytes) 000182[1] 1776200733.353094 read 0x2e94c6 thru 0x2e9fef (0xb2a bytes) 000185[0] 1776200733.402033 mapread 0x0df0d8 thru 0x0e1ce3 (0x2c0c bytes) 000187[1] 1776200733.425378 mapwrite 0x943d15 thru 0x952736 (0xea22 bytes) 000190[1] 1776200733.732632 mapread 0x8eb8b6 thru 0x8f7ea9 (0xc5f4 bytes) 000191[0] 1776200733.776328 mapwrite 0x2685e6 thru 0x27724b (0xec66 bytes) 000194[0] 1776200734.151388 write 0x112b20 thru 0x12074c (0xdc2d bytes) 000195[1] 1776200734.328101 trunc from 0x952737 to 0x54937f (0x4093b7 bytes) 000200[0] 1776200734.512929 read 0x07a687 thru 0x07d4ef (0x2e69 bytes) 000204[0] 1776200734.636046 write 0x5277ad thru 0x5301e0 (0x8a34 bytes) 000205[0] 1776200734.843587 mapread 0x51e82c thru 0x52861b (0x9df0 bytes) 000206[1] 1776200734.862337 read 0x3992dd thru 0x3a3284 (0x9fa8 bytes) 000207[1] 1776200734.935416 mapwrite 0x455c16 thru 0x46383c (0xdc27 bytes) 000208[0] 1776200735.217844 mapwrite 0x35b09f thru 0x35e423 (0x3385 bytes) 000214[0] 1776200735.423583 mapwrite 0x2bd4fc thru 0x2bf56c (0x2071 bytes) 000216[0] 1776200735.564592 trunc from 0x549380 to 0x35763b (0x1f1d44 bytes) 000218[0] 1776200735.594579 write 0x827704 thru 0x83748d (0xfd8a bytes) 000219[0] 1776200735.611050 mapwrite 0x861c30 thru 0x86f72f (0xdb00 bytes) 000220[0] 1776200736.049303 trunc from 0x86f730 to 0x042e0d (0x82c922 bytes) 000223[1] 1776200736.235944 trunc from 0x042e0e to 0x1fc98f (0x1b9b82 bytes) 000224[0] 1776200736.361406 mapwrite 0x32eb56 thru 0x33617f (0x762a bytes) 000228[0] 1776200736.748720 mapwrite 0x583a2c thru 0x58f02e (0xb603 bytes) 000229[0] 1776200736.933770 mapwrite 0x7c1e88 thru 0x7c353d (0x16b6 bytes) 000230[1] 1776200737.019811 mapread 0x18401f thru 0x18d4a3 (0x9485 bytes) 000232[0] 1776200737.134876 mapwrite 0x479661 thru 0x47dfb5 (0x4955 bytes) 000233[1] 1776200737.238370 mapread 0x7a34f6 thru 0x7a4a6b (0x1576 bytes) 000234[0] 1776200737.263283 trunc from 0x7c353e to 0x29d386 (0x5261b7 bytes) 000236[0] 1776200737.352107 trunc from 0x29d387 to 0x87a2db (0x5dcf55 bytes) 000239[0] 1776200737.439860 mapwrite 0x0eb336 thru 0x0ec45e (0x1129 bytes) 000240[1] 1776200737.526198 write 0x1638ed thru 0x16791b (0x402f bytes) 000241[0] 1776200737.606307 mapwrite 0x95dcee thru 0x96b028 (0xd33b bytes) 000245[0] 1776200737.864671 mapread 0x9597b8 thru 0x968c75 (0xf4be bytes) 000248[0] 1776200738.034425 mapread 0x5e5153 thru 0x5e79af (0x285d bytes) 000249[0] 1776200738.109491 trunc from 0x96b029 to 0x4b951a (0x4b1b0e bytes) 000250[0] 1776200738.149317 write 0x1ecb9b thru 0x1ed8bb (0xd21 bytes) 000253[0] 1776200738.220003 mapwrite 0x21776e thru 0x21f856 (0x80e9 bytes) 000256[0] 1776200738.380578 mapread 0x0b710e thru 0x0b9af5 (0x29e8 bytes) 000257[0] 1776200738.396960 mapwrite 0x6c897b thru 0x6d2ab5 (0xa13b bytes) 000258[0] 1776200738.537069 mapread 0x5d27fa thru 0x5d6bab (0x43b2 bytes) 000260[0] 1776200738.629250 write 0x1c727a thru 0x1d251a (0xb2a1 bytes) 000262[1] 1776200738.701238 trunc from 0x6d2ab6 to 0x6d1c91 (0xe24 bytes) 000264[1] 1776200738.801813 trunc from 0x6d1c92 to 0x7d582a (0x103b99 bytes) 000265[0] 1776200738.826836 write 0x008ffb thru 0x016ad3 (0xdad9 bytes) 000266[1] 1776200738.886852 mapread 0x63939c thru 0x64584f (0xc4b4 bytes) 000267[0] 1776200739.009987 read 0x669ab9 thru 0x66be87 (0x23cf bytes) 000269[0] 1776200739.076066 read 0x00582f thru 0x010aaa (0xb27c bytes) 000271[1] 1776200739.154111 mapwrite 0x9da33e thru 0x9e1eea (0x7bad bytes) 000275[1] 1776200739.489983 mapread 0x157974 thru 0x162c4a (0xb2d7 bytes) 000276[0] 1776200739.567746 mapread 0x9dd713 thru 0x9e08c0 (0x31ae bytes) 000277[0] 1776200739.727719 mapwrite 0x154394 thru 0x1611ab (0xce18 bytes) 000279[0] 1776200740.110728 write 0x396be3 thru 0x396eff (0x31d bytes) 000281[0] 1776200740.157789 read 0x2bae28 thru 0x2c3a33 (0x8c0c bytes) 000282[0] 1776200740.251950 trunc from 0x9e1eeb to 0x5601ac (0x481d3e bytes) 000285[1] 1776200740.437056 mapread 0x496cab thru 0x499100 (0x2456 bytes) 000286[0] 1776200740.535024 read 0x0be2f0 thru 0x0c99f8 (0xb709 bytes) 000287[0] 1776200740.627674 trunc from 0x5601ad to 0x7ae939 (0x24e78d bytes) 000292[1] 1776200740.717396 write 0x5c9d8b thru 0x5d96c3 (0xf939 bytes) 000293[1] 1776200740.788146 write 0x69fd4c thru 0x6a50e9 (0x539e bytes) 000295[1] 1776200740.825676 mapwrite 0x457059 thru 0x46216d (0xb115 bytes) 000297[1] 1776200741.100243 mapwrite 0x101bbf thru 0x10f7fd (0xdc3f bytes) 000304[0] 1776200741.419075 mapread 0x068b08 thru 0x075a6f (0xcf68 bytes) 000305[1] 1776200741.525650 mapread 0x4b6d20 thru 0x4b8036 (0x1317 bytes) 000306[1] 1776200741.561789 write 0x010fd2 thru 0x017e51 (0x6e80 bytes) 000307[1] 1776200741.642179 trunc from 0x7ae93a to 0x062663 (0x74c2d6 bytes) 000308[0] 1776200741.735036 mapread 0x048a5b thru 0x054122 (0xb6c8 bytes) 000309[1] 1776200741.808207 write 0x66ba9c thru 0x679267 (0xd7cc bytes) 000311[1] 1776200741.854017 write 0x2d0bb2 thru 0x2dbfcd (0xb41c bytes) 000312[0] 1776200741.889818 read 0x54fc40 thru 0x557b4b (0x7f0c bytes) 000313[0] 1776200741.948479 mapread 0x005616 thru 0x00975a (0x4145 bytes) 000314[1] 1776200741.996963 mapwrite 0x245b69 thru 0x2513c4 (0xb85c bytes) 000315[1] 1776200742.294204 read 0x5e9314 thru 0x5eca6f (0x375c bytes) 000318[0] 1776200742.378446 trunc from 0x679268 to 0x6a05d2 (0x2736b bytes) 000319[1] 1776200742.451857 mapread 0x27da52 thru 0x280e45 (0x33f4 bytes) 000320[1] 1776200742.537191 write 0x90a1b2 thru 0x916231 (0xc080 bytes) 000322[0] 1776200742.579353 mapwrite 0x9390ab thru 0x93abf7 (0x1b4d bytes) 000324[1] 1776200742.724900 mapwrite 0x875549 thru 0x8782cf (0x2d87 bytes) 000325[0] 1776200742.924519 trunc from 0x93abf8 to 0x814339 (0x1268be bytes) 000326[0] 1776200742.986060 read 0x2432bc thru 0x24f7e9 (0xc52e bytes) 000327[0] 1776200743.133331 write 0x1c990b thru 0x1cf434 (0x5b2a bytes) 000329[0] 1776200743.145817 write 0x851d92 thru 0x855d55 (0x3fc4 bytes) 000330[0] 1776200743.171826 mapwrite 0x9371b8 thru 0x938c24 (0x1a6d bytes) 000331[0] 1776200743.307755 mapread 0x0a023d thru 0x0aee42 (0xec06 bytes) 000332[0] 1776200743.458516 write 0x4ad32e thru 0x4af105 (0x1dd8 bytes) 000334[1] 1776200743.490333 mapread 0x0a4817 thru 0x0adb5d (0x9347 bytes) 000335[1] 1776200743.662560 mapread 0x29d06c thru 0x2a1286 (0x421b bytes) 000336[0] 1776200743.721522 read 0x6e81d8 thru 0x6eae71 (0x2c9a bytes) truncating to largest ever: 0x9a60ba 000337[1] 1776200743.775697 trunc from 0x938c25 to 0x9a60b9 (0x6d495 bytes) 000338[1] 1776200743.844503 write 0x463237 thru 0x46f7fb (0xc5c5 bytes) 000339[1] 1776200743.917703 write 0x344c64 thru 0x3516b2 (0xca4f bytes) 000340[0] 1776200743.930946 trunc from 0x9a60ba to 0x8962b8 (0x10fe01 bytes) 000342[1] 1776200744.057102 mapwrite 0x3e6230 thru 0x3f4ffb (0xedcc bytes) 000345[1] 1776200744.324844 write 0x0ea230 thru 0x0f7889 (0xd65a bytes) 000346[0] 1776200744.389232 mapread 0x329f41 thru 0x332d49 (0x8e09 bytes) 000347[1] 1776200744.500175 mapwrite 0x40a23b thru 0x40d28b (0x3051 bytes) 000348[0] 1776200744.648890 write 0x762065 thru 0x76ddc6 (0xbd62 bytes) 000349[0] 1776200744.718045 mapwrite 0x3e766b thru 0x3f38b4 (0xc24a bytes) 000350[1] 1776200744.983853 read 0x85d060 thru 0x864577 (0x7518 bytes) 000352[0] 1776200745.081226 read 0x35959f thru 0x35ff07 (0x6969 bytes) 000356[1] 1776200745.197357 read 0x07b0f6 thru 0x08388c (0x8797 bytes) 000357[1] 1776200745.263702 trunc from 0x8962b9 to 0x2f8488 (0x59de30 bytes) 000359[1] 1776200745.360500 trunc from 0x2f8489 to 0x2b8825 (0x3fc63 bytes) 000361[0] 1776200745.427034 mapwrite 0x167dff thru 0x16f47c (0x767e bytes) 000362[1] 1776200745.650999 read 0x1208b0 thru 0x1266e2 (0x5e33 bytes) 000363[1] 1776200745.745838 trunc from 0x2b8826 to 0x869c50 (0x5b142b bytes) 000364[0] 1776200745.857159 mapwrite 0x6eca77 thru 0x6ee091 (0x161b bytes) 000365[0] 1776200746.030865 write 0x486b04 thru 0x48d128 (0x6625 bytes) 000366[1] 1776200746.052784 trunc from 0x869c51 to 0x15e650 (0x70b600 bytes) 000369[0] 1776200746.188632 mapwrite 0x9d2b50 thru 0x9d87bb (0x5c6c bytes) 000370[0] 1776200746.449893 write 0x8e201b thru 0x8e4a72 (0x2a58 bytes) 000373[0] 1776200746.478409 mapread 0x03b9fe thru 0x045095 (0x9698 bytes) 000377[1] 1776200746.600699 read 0x488279 thru 0x4930b0 (0xae38 bytes) 000380[0] 1776200746.651991 trunc from 0x9d87bc to 0x563d5a (0x474a61 bytes) 000381[0] 1776200746.717138 read 0x3e2d49 thru 0x3e2f82 (0x23a bytes) 000382[1] 1776200746.752905 mapread 0x300119 thru 0x303a19 (0x3901 bytes) 000388[0] 1776200746.939403 mapwrite 0x41aa31 thru 0x41f5aa (0x4b7a bytes) 000389[1] 1776200747.049505 mapread 0x12f7a1 thru 0x139299 (0x9af9 bytes) 000393[1] 1776200747.236186 read 0x306c91 thru 0x3111ba (0xa52a bytes) 000401[0] 1776200747.351895 mapread 0x30a109 thru 0x30af85 (0xe7d bytes) 000407[1] 1776200747.401752 read 0x539f51 thru 0x544a42 (0xaaf2 bytes) 000409[0] 1776200747.402731 mapread 0x2b0334 thru 0x2b0e1b (0xae8 bytes) 000410[0] 1776200747.414033 write 0x634a4b thru 0x634bb3 (0x169 bytes) 000412[1] 1776200747.434042 read 0x007a6c thru 0x01482f (0xcdc4 bytes) 000414[0] 1776200747.553194 mapread 0x021fd4 thru 0x0260cd (0x40fa bytes) 000416[0] 1776200747.598590 write 0x3843ce thru 0x38456b (0x19e bytes) 000418[0] 1776200747.633241 write 0x783486 thru 0x790f91 (0xdb0c bytes) 000419[1] 1776200747.635285 trunc from 0x790f92 to 0x47f0d5 (0x311ebc bytes) 000422[0] 1776200747.886657 read 0x2faa62 thru 0x306650 (0xbbef bytes) 000423[0] 1776200748.007988 write 0x3a0a1e thru 0x3a5dfc (0x53df bytes) 000424[0] 1776200748.097821 read 0x3cfd9e thru 0x3d6eb1 (0x7114 bytes) 000426[1] 1776200748.141597 trunc from 0x47f0d6 to 0x92b5c9 (0x4ac4f4 bytes) 000427[0] 1776200748.265681 mapread 0x474453 thru 0x47d2b9 (0x8e67 bytes) 000430[1] 1776200748.524680 mapwrite 0x8a44a0 thru 0x8ab615 (0x7176 bytes) 000433[0] 1776200748.937026 write 0x32a6aa thru 0x3396cd (0xf024 bytes) 000435[0] 1776200749.053965 write 0x5ca2b7 thru 0x5cc805 (0x254f bytes) 000436[1] 1776200749.073323 mapread 0x2f8a46 thru 0x301d72 (0x932d bytes) 000437[1] 1776200749.155858 mapread 0x5bd3ac thru 0x5ccee0 (0xfb35 bytes) 000438[1] 1776200749.269503 trunc from 0x92b5ca to 0x443bdc (0x4e79ed bytes) 000439[1] 1776200749.396339 write 0x724bb5 thru 0x724f67 (0x3b3 bytes) 000441[1] 1776200749.434345 trunc from 0x724f68 to 0x9310f5 (0x20c18e bytes) 000442[0] 1776200749.470984 mapread 0x427573 thru 0x436dff (0xf88d bytes) 000445[0] 1776200749.831713 write 0x28cefd thru 0x2902a5 (0x33a9 bytes) 000449[0] 1776200749.953143 write 0x4cfcbf thru 0x4decbc (0xeffe bytes) 000451[0] 1776200750.024531 trunc from 0x9310f6 to 0x014d05 (0x91c3f0 bytes) 000452[0] 1776200750.073856 trunc from 0x014d06 to 0x6c317b (0x6ae476 bytes) 000453[0] 1776200750.132950 mapwrite 0x512f91 thru 0x51394b (0x9bb bytes) 000454[1] 1776200750.304901 mapwrite 0x4917bc thru 0x4983ee (0x6c33 bytes) 000457[1] 1776200750.600205 mapwrite 0x8bbe11 thru 0x8cab54 (0xed44 bytes) 000459[0] 1776200750.970802 mapwrite 0x4c0d8e thru 0x4cbdc4 (0xb037 bytes) 000461[1] 1776200751.274220 mapread 0x57e050 thru 0x58934c (0xb2fd bytes) 000463[0] 1776200751.466838 mapread 0x770422 thru 0x7780b9 (0x7c98 bytes) 000465[1] 1776200751.574716 write 0x051f3e thru 0x05b57a (0x963d bytes) 000467[0] 1776200751.619723 write 0x76879f thru 0x76dc82 (0x54e4 bytes) 000468[1] 1776200751.665080 mapwrite 0x07f6f8 thru 0x08489a (0x51a3 bytes) 000470[1] 1776200751.844997 read 0x517967 thru 0x5219f9 (0xa093 bytes) 000471[0] 1776200751.975470 read 0x303147 thru 0x3093d1 (0x628b bytes) 000473[0] 1776200752.033801 write 0x5d8769 thru 0x5e83a9 (0xfc41 bytes) 000475[1] 1776200752.155939 read 0x548bbd thru 0x54f0f2 (0x6536 bytes) 000480[0] 1776200752.373937 mapread 0x07301e thru 0x0792d5 (0x62b8 bytes) 000481[0] 1776200752.586787 mapread 0x428803 thru 0x42a129 (0x1927 bytes) 000483[0] 1776200752.587827 write 0x1e036e thru 0x1e9e58 (0x9aeb bytes) 000484[1] 1776200752.650822 trunc from 0x8cab55 to 0x60ebc0 (0x2bbf94 bytes) 000485[0] 1776200752.785928 read 0x160219 thru 0x16108a (0xe72 bytes) 000487[1] 1776200752.886914 write 0x003024 thru 0x006b50 (0x3b2d bytes) 000489[1] 1776200752.920075 write 0x6fc22a thru 0x6fc8d2 (0x6a9 bytes) 000490[1] 1776200752.923463 read 0x0e1efd thru 0x0e649b (0x459f bytes) 000491[0] 1776200753.084503 mapread 0x33ce19 thru 0x33f718 (0x2900 bytes) 000493[1] 1776200753.135449 mapwrite 0x7b8f7b thru 0x7bb8db (0x2961 bytes) 000496[0] 1776200753.361852 write 0x3ec2cf thru 0x3fbfa0 (0xfcd2 bytes) 000498[0] 1776200753.424876 mapwrite 0x486071 thru 0x487401 (0x1391 bytes) 000499[0] 1776200753.701575 write 0x546c23 thru 0x54cb90 (0x5f6e bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 753 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[0] 1776200755.073327 write 0x08f000 thru 0x08f558 (0x559 bytes) 000002[1] 1776200755.100549 mapread 0x064000 thru 0x069108 (0x5109 bytes) 000003[1] 1776200755.151322 mapwrite 0x257000 thru 0x25899b (0x199c bytes) 000005[1] 1776200755.246331 mapread 0x075000 thru 0x081687 (0xc688 bytes) 000007[1] 1776200755.271310 mapread 0x20a000 thru 0x20e71e (0x471f bytes) 000008[1] 1776200755.317846 read_OD 0x095000 thru 0x099fff (0x5000 bytes) 000009[0] 1776200755.365438 read 0x168000 thru 0x1747ce (0xc7cf bytes) 000010[1] 1776200755.392893 mapread 0x016000 thru 0x01988c (0x388d bytes) 000012[0] 1776200755.420676 mapread 0x1e6000 thru 0x1ece71 (0x6e72 bytes) 000016[1] 1776200755.453396 write_OD 0x0b3000 thru 0x0c0fff (0xe000 bytes) 000017[0] 1776200755.527698 read 0x122000 thru 0x127bf0 (0x5bf1 bytes) truncating to largest ever: 0x4976f2 000019[0] 1776200755.573801 trunc from 0x25899c to 0x4976f1 (0x23ed56 bytes) truncating to largest ever: 0x7fc49b 000020[1] 1776200755.657252 trunc from 0x4976f2 to 0x7fc49a (0x364da9 bytes) 000022[1] 1776200755.750234 read_OD 0x65c000 thru 0x667fff (0xc000 bytes) 000023[1] 1776200755.793829 read_OD 0x5d9000 thru 0x5e0fff (0x8000 bytes) 000024[1] 1776200755.822105 mapwrite 0x6c7000 thru 0x6d38a3 (0xc8a4 bytes) 000025[1] 1776200756.052755 mapwrite 0x7da000 thru 0x7df3a2 (0x53a3 bytes) 000028[0] 1776200756.333035 mapread 0x5c3000 thru 0x5c4553 (0x1554 bytes) 000033[0] 1776200756.693289 mapread 0x5ef000 thru 0x5f22fe (0x32ff bytes) 000034[1] 1776200756.694833 write_OD 0x18e000 thru 0x193fff (0x6000 bytes) 000036[0] 1776200756.790568 mapwrite 0x296000 thru 0x2a04da (0xa4db bytes) 000037[1] 1776200756.960033 write_OD 0x6fe000 thru 0x701fff (0x4000 bytes) 000039[0] 1776200757.015251 trunc from 0x7fc49b to 0x0adc10 (0x74e88a bytes) 000043[1] 1776200757.124861 read_OD 0x091000 thru 0x09efff (0xe000 bytes) 000044[0] 1776200757.160157 mapread 0x030000 thru 0x034eb9 (0x4eba bytes) 000045[0] 1776200757.191236 write 0x351000 thru 0x35cb23 (0xbb24 bytes) 000046[1] 1776200757.214533 read_OD 0x1a7000 thru 0x1b3fff (0xd000 bytes) 000047[1] 1776200757.246052 mapwrite 0x76c000 thru 0x7712c3 (0x52c4 bytes) 000049[1] 1776200757.612012 trunc from 0x7712c4 to 0x3dbe27 (0x39549c bytes) 000050[0] 1776200757.697208 trunc from 0x3dbe28 to 0x04458c (0x39789b bytes) 000054[0] 1776200757.932020 read 0x03f000 thru 0x043eff (0x4f00 bytes) 000055[1] 1776200757.950224 mapwrite 0x3c1000 thru 0x3c674f (0x5750 bytes) 000058[0] 1776200758.310507 write 0x246000 thru 0x24d31e (0x731f bytes) 000059[0] 1776200758.478146 mapread 0x1df000 thru 0x1e0446 (0x1447 bytes) 000060[0] 1776200758.543519 trunc from 0x3c6750 to 0x28e2d3 (0x13847c bytes) 000061[1] 1776200758.598470 read_OD 0x0f9000 thru 0x103fff (0xb000 bytes) 000062[1] 1776200758.643104 read_OD 0x00c000 thru 0x019fff (0xe000 bytes) 000063[0] 1776200758.662832 mapwrite 0x29c000 thru 0x2ab648 (0xf649 bytes) 000064[1] 1776200759.015370 read_OD 0x1f2000 thru 0x1fafff (0x9000 bytes) 000065[0] 1776200759.055188 write 0x0bc000 thru 0x0c626b (0xa26c bytes) 000068[0] 1776200759.128465 write 0x609000 thru 0x610806 (0x7807 bytes) 000069[0] 1776200759.152359 trunc from 0x610807 to 0x491784 (0x17f082 bytes) 000072[0] 1776200759.276423 write 0x92d000 thru 0x93924a (0xc24b bytes) 000073[1] 1776200759.322413 read_OD 0x2cb000 thru 0x2d3fff (0x9000 bytes) 000077[1] 1776200759.422714 mapread 0x459000 thru 0x468a08 (0xfa09 bytes) 000079[0] 1776200759.646209 trunc from 0x93924b to 0x71eb5b (0x21a6ef bytes) 000081[1] 1776200759.889707 write_OD 0x903000 thru 0x906fff (0x4000 bytes) 000084[1] 1776200759.999859 mapread 0x497000 thru 0x498fba (0x1fbb bytes) 000086[1] 1776200760.020553 mapwrite 0x7f6000 thru 0x7fc49e (0x649f bytes) 000087[1] 1776200760.182409 trunc from 0x907000 to 0x0456ef (0x8c1910 bytes) 000088[1] 1776200760.220367 mapread 0x017000 thru 0x020bee (0x9bef bytes) 000094[1] 1776200760.399844 mapwrite 0x56b000 thru 0x574b9b (0x9b9c bytes) 000099[1] 1776200760.747978 read_OD 0x419000 thru 0x41bfff (0x3000 bytes) 000100[1] 1776200760.778480 mapwrite 0x130000 thru 0x13168b (0x168c bytes) 000101[0] 1776200760.986898 read 0x227000 thru 0x2274f6 (0x4f7 bytes) 000103[0] 1776200761.114852 mapwrite 0x34a000 thru 0x35538b (0xb38c bytes) 000104[0] 1776200761.347255 read 0x268000 thru 0x275b3b (0xdb3c bytes) truncating to largest ever: 0x94be13 000106[0] 1776200761.438065 trunc from 0x574b9c to 0x94be12 (0x3d7277 bytes) 000107[0] 1776200761.532946 trunc from 0x94be13 to 0x932e6a (0x18fa8 bytes) 000108[0] 1776200761.631726 read 0x3ef000 thru 0x3f87b2 (0x97b3 bytes) 000110[0] 1776200761.662336 write 0x8a0000 thru 0x8a97ed (0x97ee bytes) 000112[1] 1776200761.813156 mapwrite 0x814000 thru 0x820378 (0xc379 bytes) 000115[0] 1776200762.201683 trunc from 0x932e6b to 0x4eba07 (0x447463 bytes) 000119[0] 1776200762.466414 read 0x222000 thru 0x2255b1 (0x35b2 bytes) 000120[0] 1776200762.582956 write 0x9b7000 thru 0x9bf1ee (0x81ef bytes) 000123[1] 1776200762.657086 mapwrite 0x533000 thru 0x541e0e (0xee0f bytes) 000124[1] 1776200763.134232 mapread 0x083000 thru 0x0899a5 (0x69a6 bytes) 000125[0] 1776200763.259525 mapread 0x17f000 thru 0x18624e (0x724f bytes) 000126[1] 1776200763.615742 write_OD 0x8bd000 thru 0x8c0fff (0x4000 bytes) 000127[1] 1776200763.709095 write_OD 0x72a000 thru 0x735fff (0xc000 bytes) 000128[1] 1776200763.785517 write_OD 0x05c000 thru 0x066fff (0xb000 bytes) 000129[1] 1776200763.881247 mapwrite 0x6c6000 thru 0x6d01a8 (0xa1a9 bytes) 000132[0] 1776200764.192105 trunc from 0x9bf1ef to 0x926ee8 (0x98306 bytes) 000134[0] 1776200764.392042 read 0x35b000 thru 0x365648 (0xa649 bytes) 000135[0] 1776200764.602501 write 0x93c000 thru 0x93e26e (0x226f bytes) 000136[1] 1776200764.607596 read_OD 0x76e000 thru 0x771fff (0x4000 bytes) 000138[0] 1776200764.679285 trunc from 0x93e26f to 0x4227c4 (0x51baaa bytes) 000140[0] 1776200764.789243 mapread 0x31a000 thru 0x322801 (0x8802 bytes) 000144[1] 1776200764.976396 mapwrite 0x2d8000 thru 0x2dd3ee (0x53ef bytes) 000145[0] 1776200765.152213 mapwrite 0x927000 thru 0x92b388 (0x4389 bytes) 000146[1] 1776200765.324659 mapread 0x60e000 thru 0x61439a (0x639b bytes) 000147[1] 1776200765.455256 mapread 0x885000 thru 0x88bc8b (0x6c8c bytes) 000151[1] 1776200765.472254 write_OD 0x0cc000 thru 0x0cefff (0x3000 bytes) 000152[1] 1776200765.597387 read_OD 0x3c7000 thru 0x3c9fff (0x3000 bytes) 000153[0] 1776200765.611868 trunc from 0x92b389 to 0x1c8b70 (0x762818 bytes) 000154[1] 1776200765.694097 write_OD 0x9e4000 thru 0x9f0fff (0xd000 bytes) 000156[1] 1776200765.742495 read_OD 0x52d000 thru 0x535fff (0x9000 bytes) 000162[0] 1776200765.757584 write 0x5d2000 thru 0x5dbcca (0x9ccb bytes) 000165[1] 1776200765.813184 read_OD 0x71a000 thru 0x722fff (0x9000 bytes) 000166[1] 1776200765.876689 mapread 0x577000 thru 0x57d244 (0x6245 bytes) 000168[1] 1776200765.981547 trunc from 0x9f1000 to 0x3edf5f (0x6030a0 bytes) truncating to largest ever: 0x9515a1 000170[0] 1776200766.046481 trunc from 0x3edf60 to 0x9515a0 (0x563641 bytes) 000171[0] 1776200766.084338 mapwrite 0x8fa000 thru 0x9012f9 (0x72fa bytes) 000172[1] 1776200766.172086 mapread 0x87f000 thru 0x88df0b (0xef0c bytes) 000174[0] 1776200766.306704 mapread 0x37d000 thru 0x37d66c (0x66d bytes) 000175[0] 1776200766.312520 mapwrite 0x90b000 thru 0x918d59 (0xdd5a bytes) 000176[1] 1776200766.528064 read_OD 0x3da000 thru 0x3e2fff (0x9000 bytes) 000179[1] 1776200766.592444 trunc from 0x9515a1 to 0x75960d (0x1f7f93 bytes) 000181[1] 1776200766.655555 mapwrite 0x10f000 thru 0x114b09 (0x5b0a bytes) 000183[1] 1776200766.931578 trunc from 0x75960e to 0x769c01 (0x105f4 bytes) 000184[0] 1776200766.953966 mapread 0x4ce000 thru 0x4d5892 (0x7893 bytes) 000187[1] 1776200767.116099 mapwrite 0x103000 thru 0x111de6 (0xede7 bytes) 000189[1] 1776200767.524472 read_OD 0x23f000 thru 0x243fff (0x5000 bytes) 000190[1] 1776200767.570397 mapread 0x2ee000 thru 0x2fb72c (0xd72d bytes) 000191[1] 1776200767.704220 mapread 0x72e000 thru 0x734ea9 (0x6eaa bytes) 000194[1] 1776200767.753565 trunc from 0x769c02 to 0x58dfec (0x1dbc15 bytes) 000197[0] 1776200767.958087 mapread 0x0d6000 thru 0x0df273 (0x9274 bytes) 000199[1] 1776200768.117705 trunc from 0x58dfed to 0x86ab66 (0x2dcb7a bytes) 000204[0] 1776200768.289727 write 0x4b2000 thru 0x4bf7f9 (0xd7fa bytes) 000205[0] 1776200768.398649 mapread 0x73b000 thru 0x742231 (0x7232 bytes) 000208[1] 1776200768.486060 write_OD 0x5d6000 thru 0x5e1fff (0xc000 bytes) 000209[1] 1776200768.589102 mapread 0x711000 thru 0x713e5b (0x2e5c bytes) 000214[0] 1776200768.628956 write 0x46b000 thru 0x46d7b8 (0x27b9 bytes) 000216[1] 1776200768.756515 trunc from 0x86ab67 to 0x92cb56 (0xc1ff0 bytes) 000217[0] 1776200768.889570 mapread 0x322000 thru 0x3293cc (0x73cd bytes) 000219[1] 1776200769.114335 trunc from 0x92cb57 to 0x1958f4 (0x797262 bytes) 000221[1] 1776200769.205094 mapread 0x109000 thru 0x10ea69 (0x5a6a bytes) 000222[0] 1776200769.236269 mapwrite 0x9b8000 thru 0x9c3d37 (0xbd38 bytes) 000223[1] 1776200769.419306 trunc from 0x9c3d38 to 0x11cb91 (0x8a71a6 bytes) 000224[0] 1776200769.474594 trunc from 0x11cb92 to 0x4c431b (0x3a778a bytes) 000225[1] 1776200769.501070 mapwrite 0x0f6000 thru 0x0f7468 (0x1469 bytes) 000227[1] 1776200769.666694 trunc from 0x4c431c to 0x793a43 (0x2cf728 bytes) 000228[1] 1776200769.711495 mapread 0x212000 thru 0x216f07 (0x4f08 bytes) 000229[0] 1776200769.760203 mapread 0x2b2000 thru 0x2bb35c (0x935d bytes) 000231[1] 1776200769.822920 mapread 0x022000 thru 0x0263d4 (0x43d5 bytes) 000232[1] 1776200769.849084 trunc from 0x793a44 to 0x4f31ea (0x2a0859 bytes) 000234[0] 1776200769.915896 write 0x441000 thru 0x4485ef (0x75f0 bytes) 000236[0] 1776200769.951592 read 0x0e8000 thru 0x0f7aba (0xfabb bytes) 000239[1] 1776200770.049413 mapwrite 0x625000 thru 0x628fa4 (0x3fa5 bytes) 000241[0] 1776200770.183889 write 0x0ed000 thru 0x0ed965 (0x966 bytes) 000242[0] 1776200770.307329 read 0x2b5000 thru 0x2bec3e (0x9c3f bytes) 000244[0] 1776200770.399384 trunc from 0x628fa5 to 0x6f9b67 (0xd0bc3 bytes) 000245[0] 1776200770.482635 mapwrite 0x255000 thru 0x25a646 (0x5647 bytes) 000246[0] 1776200770.765250 read 0x253000 thru 0x258eef (0x5ef0 bytes) 000248[0] 1776200770.859577 trunc from 0x6f9b68 to 0x3d68f3 (0x323274 bytes) 000249[1] 1776200770.950167 write_OD 0x130000 thru 0x13bfff (0xc000 bytes) 000251[1] 1776200771.089411 write_OD 0x35e000 thru 0x368fff (0xb000 bytes) 000253[1] 1776200771.242589 mapread 0x35c000 thru 0x36b064 (0xf065 bytes) 000254[0] 1776200771.423021 write 0x61b000 thru 0x625204 (0xa205 bytes) 000255[0] 1776200771.467038 read 0x09d000 thru 0x0a2839 (0x583a bytes) 000257[0] 1776200771.654597 mapread 0x54e000 thru 0x555c2b (0x7c2c bytes) 000259[0] 1776200771.656041 write 0x52f000 thru 0x53e798 (0xf799 bytes) 000260[0] 1776200771.677746 read 0x56b000 thru 0x572144 (0x7145 bytes) 000262[1] 1776200771.720708 mapwrite 0x21e000 thru 0x22dfde (0xffdf bytes) 000263[0] 1776200772.186392 mapwrite 0x42d000 thru 0x4348eb (0x78ec bytes) 000264[1] 1776200772.357790 write_OD 0x284000 thru 0x286fff (0x3000 bytes) 000265[1] 1776200772.424033 mapwrite 0x9fe000 thru 0x9ff697 (0x1698 bytes) 000266[1] 1776200772.523222 mapwrite 0x466000 thru 0x4684d2 (0x24d3 bytes) 000270[0] 1776200772.630229 mapwrite 0x1d8000 thru 0x1dda15 (0x5a16 bytes) 000272[0] 1776200772.971710 trunc from 0x9ff698 to 0x340d7a (0x6be91d bytes) 000276[0] 1776200773.049366 write 0x4ab000 thru 0x4b5ee2 (0xaee3 bytes) 000279[0] 1776200773.074926 mapread 0x0ef000 thru 0x0ef9a1 (0x9a2 bytes) 000280[0] 1776200773.112511 write 0x59e000 thru 0x59f213 (0x1214 bytes) 000282[0] 1776200773.115481 mapread 0x0fe000 thru 0x1026a6 (0x46a7 bytes) 000283[1] 1776200773.175509 mapwrite 0x2a3000 thru 0x2b2fa4 (0xffa5 bytes) 000285[1] 1776200773.392125 read_OD 0x503000 thru 0x50ffff (0xd000 bytes) 000287[1] 1776200773.421437 mapread 0x4fa000 thru 0x4ff4d1 (0x54d2 bytes) 000288[0] 1776200773.518919 trunc from 0x59f214 to 0x389159 (0x2160ba bytes) 000289[1] 1776200773.584553 read_OD 0x196000 thru 0x1a4fff (0xf000 bytes) 000293[0] 1776200773.627153 write 0x3a7000 thru 0x3b340e (0xc40f bytes) 000295[1] 1776200773.713928 mapread 0x151000 thru 0x156717 (0x5718 bytes) 000300[1] 1776200773.882889 read_OD 0x2a3000 thru 0x2a9fff (0x7000 bytes) 000302[1] 1776200773.896354 mapread 0x068000 thru 0x073cb9 (0xbcba bytes) 000303[1] 1776200774.003005 mapwrite 0x0c4000 thru 0x0c9e73 (0x5e74 bytes) 000305[0] 1776200774.132593 mapread 0x0b0000 thru 0x0b7de0 (0x7de1 bytes) 000306[1] 1776200774.235344 trunc from 0x3b340f to 0x5be5be (0x20b1b0 bytes) 000308[1] 1776200774.322963 mapwrite 0x868000 thru 0x876ce7 (0xece8 bytes) 000309[0] 1776200774.554977 read 0x7b0000 thru 0x7b99da (0x99db bytes) 000310[1] 1776200774.648391 mapwrite 0x453000 thru 0x46279e (0xf79f bytes) 000312[0] 1776200774.950754 trunc from 0x876ce8 to 0x55ed20 (0x317fc7 bytes) 000315[1] 1776200774.988850 read_OD 0x497000 thru 0x49ffff (0x9000 bytes) 000316[0] 1776200775.022460 trunc from 0x55ed21 to 0x7f5f44 (0x297224 bytes) 000317[1] 1776200775.078293 mapread 0x13a000 thru 0x144fd5 (0xafd6 bytes) 000320[1] 1776200775.223142 trunc from 0x7f5f45 to 0x17ee3e (0x677106 bytes) 000321[0] 1776200775.295357 read 0x009000 thru 0x014ccf (0xbcd0 bytes) 000323[1] 1776200775.339129 mapwrite 0x746000 thru 0x74aa35 (0x4a36 bytes) 000324[0] 1776200775.485581 read 0x6e8000 thru 0x6f661f (0xe620 bytes) 000327[1] 1776200775.566242 read_OD 0x68a000 thru 0x696fff (0xd000 bytes) 000328[1] 1776200775.594711 trunc from 0x74aa36 to 0x063295 (0x6e77a0 bytes) 000332[0] 1776200775.746349 trunc from 0x063296 to 0x866d23 (0x803a8e bytes) 000333[0] 1776200775.777461 write 0x39e000 thru 0x3ac935 (0xe936 bytes) 000334[1] 1776200775.805874 mapread 0x3ee000 thru 0x3f2281 (0x4282 bytes) 000335[0] 1776200775.893967 trunc from 0x866d24 to 0x3c93f7 (0x49d92c bytes) 000336[1] 1776200775.923143 trunc from 0x3c93f8 to 0x251387 (0x178070 bytes) 000337[0] 1776200775.956064 mapwrite 0x165000 thru 0x174303 (0xf304 bytes) 000339[1] 1776200776.135550 trunc from 0x251388 to 0x257dac (0x6a25 bytes) 000342[1] 1776200776.198082 write_OD 0x0b3000 thru 0x0bafff (0x8000 bytes) 000343[0] 1776200776.278022 write 0x615000 thru 0x61ab13 (0x5b14 bytes) 000345[1] 1776200776.292784 read_OD 0x070000 thru 0x070fff (0x1000 bytes) 000346[1] 1776200776.323542 write_OD 0x8ce000 thru 0x8d7fff (0xa000 bytes) 000349[1] 1776200776.409407 write_OD 0x204000 thru 0x204fff (0x1000 bytes) 000350[1] 1776200776.502905 read_OD 0x68f000 thru 0x694fff (0x6000 bytes) 000352[1] 1776200776.556088 mapwrite 0x2f5000 thru 0x2fdc97 (0x8c98 bytes) 000353[1] 1776200776.838035 mapread 0x06c000 thru 0x07975e (0xd75f bytes) 000354[0] 1776200776.931046 mapread 0x480000 thru 0x480782 (0x783 bytes) 000355[1] 1776200776.996095 read_OD 0x5fd000 thru 0x5fdfff (0x1000 bytes) 000356[0] 1776200777.003183 read 0x8d7000 thru 0x8d7585 (0x586 bytes) 000359[0] 1776200777.004548 write 0x727000 thru 0x7322a4 (0xb2a5 bytes) truncating to largest ever: 0x9ab8b4 000360[0] 1776200777.123967 trunc from 0x8d8000 to 0x9ab8b3 (0xd38b4 bytes) 000361[0] 1776200777.182317 read 0x295000 thru 0x298e55 (0x3e56 bytes) 000363[1] 1776200777.325975 mapwrite 0x60e000 thru 0x61d3be (0xf3bf bytes) 000365[0] 1776200777.695535 write 0x138000 thru 0x1417f4 (0x97f5 bytes) 000366[1] 1776200777.762088 write_OD 0x5a8000 thru 0x5affff (0x8000 bytes) 000367[0] 1776200777.841097 mapread 0x0be000 thru 0x0c6d06 (0x8d07 bytes) 000371[1] 1776200777.894458 mapwrite 0x1f9000 thru 0x1fd95f (0x4960 bytes) 000372[1] 1776200777.977267 mapwrite 0x9af000 thru 0x9b9885 (0xa886 bytes) 000373[1] 1776200778.153884 trunc from 0x9b9886 to 0x5ce149 (0x3eb73c bytes) 000375[0] 1776200778.195755 mapread 0x385000 thru 0x393b49 (0xeb4a bytes) 000378[0] 1776200778.395341 read 0x04b000 thru 0x05438b (0x938c bytes) 000379[0] 1776200778.491913 write 0x578000 thru 0x57b531 (0x3532 bytes) 000380[0] 1776200778.572806 mapwrite 0x0c5000 thru 0x0cac05 (0x5c06 bytes) 000382[0] 1776200778.683746 trunc from 0x5ce14a to 0x4ccfbc (0x10118d bytes) 000383[1] 1776200778.714789 write_OD 0x88c000 thru 0x88cfff (0x1000 bytes) 000385[0] 1776200778.774326 mapread 0x24b000 thru 0x25aee7 (0xfee8 bytes) 000386[0] 1776200778.960176 write 0x963000 thru 0x96ea8a (0xba8b bytes) 000388[1] 1776200779.020369 write_OD 0x27f000 thru 0x284fff (0x6000 bytes) 000390[0] 1776200779.077696 read 0x1e2000 thru 0x1f15b1 (0xf5b2 bytes) 000391[0] 1776200779.196884 read 0x78e000 thru 0x79019d (0x219e bytes) 000392[0] 1776200779.202015 mapread 0x7ef000 thru 0x7f3642 (0x4643 bytes) 000397[0] 1776200779.203454 mapread 0x864000 thru 0x87031a (0xc31b bytes) 000399[0] 1776200779.204282 write 0x7f8000 thru 0x7ff979 (0x797a bytes) 000401[1] 1776200779.317898 trunc from 0x96ea8b to 0x4b1879 (0x4bd211 bytes) 000403[0] 1776200779.405224 mapwrite 0x27c000 thru 0x27cdd7 (0xdd8 bytes) 000404[1] 1776200779.537317 write_OD 0x161000 thru 0x168fff (0x8000 bytes) 000407[1] 1776200779.653746 read_OD 0x39a000 thru 0x3a4fff (0xb000 bytes) 000408[1] 1776200779.682203 mapwrite 0x68a000 thru 0x697c0a (0xdc0b bytes) 000409[1] 1776200780.012295 write_OD 0x2c1000 thru 0x2c6fff (0x6000 bytes) 000410[1] 1776200780.092384 mapread 0x0f9000 thru 0x101d54 (0x8d55 bytes) 000411[1] 1776200780.160299 mapread 0x0c9000 thru 0x0ccb08 (0x3b09 bytes) 000413[0] 1776200780.198920 read 0x4bf000 thru 0x4c41c4 (0x51c5 bytes) 000414[1] 1776200780.276952 read_OD 0x5a1000 thru 0x5a7fff (0x7000 bytes) 000416[1] 1776200780.288768 trunc from 0x697c0b to 0x831082 (0x199478 bytes) 000419[0] 1776200780.366768 trunc from 0x831083 to 0x9aad1a (0x179c98 bytes) 000421[1] 1776200780.457041 mapread 0x727000 thru 0x727743 (0x744 bytes) 000422[1] 1776200780.621312 trunc from 0x9aad1b to 0x2fbd0a (0x6af010 bytes) 000424[1] 1776200780.731747 write_OD 0x08d000 thru 0x09afff (0xe000 bytes) 000425[1] 1776200780.808515 read_OD 0x0d0000 thru 0x0defff (0xf000 bytes) 000426[0] 1776200780.824303 mapwrite 0x73c000 thru 0x74ab53 (0xeb54 bytes) 000427[0] 1776200781.163252 write 0x90a000 thru 0x919bd5 (0xfbd6 bytes) 000428[0] 1776200781.191055 mapwrite 0x260000 thru 0x264295 (0x4296 bytes) 000429[1] 1776200781.432085 write_OD 0x3c9000 thru 0x3cafff (0x2000 bytes) 000432[0] 1776200781.527778 write 0x16f000 thru 0x170bcd (0x1bce bytes) 000435[0] 1776200781.585778 read 0x55e000 thru 0x56b948 (0xd949 bytes) 000438[0] 1776200781.767589 trunc from 0x919bd6 to 0x7b6785 (0x163450 bytes) 000440[0] 1776200781.835214 mapwrite 0x809000 thru 0x814da5 (0xbda6 bytes) 000444[0] 1776200782.084800 read 0x3b0000 thru 0x3b9dac (0x9dad bytes) 000446[0] 1776200782.157091 trunc from 0x814da6 to 0x0422ef (0x7d2ab6 bytes) 000447[1] 1776200782.215194 write_OD 0x0f2000 thru 0x0fefff (0xd000 bytes) 000448[0] 1776200782.282901 read 0x0d4000 thru 0x0e28fe (0xe8ff bytes) 000449[1] 1776200782.294137 read_OD 0x071000 thru 0x077fff (0x7000 bytes) 000451[0] 1776200782.311295 mapread 0x002000 thru 0x004775 (0x2776 bytes) 000454[1] 1776200782.360870 trunc from 0x0ff000 to 0x48bbc2 (0x38cbc3 bytes) 000455[0] 1776200782.413702 read 0x16a000 thru 0x16aefe (0xeff bytes) 000456[1] 1776200782.534324 read_OD 0x235000 thru 0x242fff (0xe000 bytes) 000458[1] 1776200782.585097 mapwrite 0x077000 thru 0x081671 (0xa672 bytes) 000459[0] 1776200782.878059 mapwrite 0x347000 thru 0x34f76e (0x876f bytes) 000460[1] 1776200783.152501 read_OD 0x29a000 thru 0x29dfff (0x4000 bytes) 000461[1] 1776200783.220300 write_OD 0x4c4000 thru 0x4cefff (0xb000 bytes) 000463[0] 1776200783.331411 trunc from 0x4cf000 to 0x233128 (0x29bed7 bytes) 000465[0] 1776200783.493142 write 0x84c000 thru 0x84cf2a (0xf2b bytes) 000466[0] 1776200783.568854 trunc from 0x84cf2b to 0x8ed9e6 (0xa0abc bytes) 000469[0] 1776200783.668044 write 0x746000 thru 0x74e2c5 (0x82c6 bytes) 000471[0] 1776200783.765109 write 0x4a6000 thru 0x4ad815 (0x7816 bytes) 000475[1] 1776200783.818327 mapwrite 0x121000 thru 0x126d37 (0x5d38 bytes) 000476[0] 1776200784.104102 write 0x755000 thru 0x75b227 (0x6228 bytes) 000477[1] 1776200784.174290 read_OD 0x035000 thru 0x040fff (0xc000 bytes) 000481[0] 1776200784.222696 mapread 0x197000 thru 0x1a1b24 (0xab25 bytes) 000482[1] 1776200784.314782 mapread 0x170000 thru 0x179703 (0x9704 bytes) 000483[1] 1776200784.483223 read_OD 0x337000 thru 0x33efff (0x8000 bytes) 000485[1] 1776200784.494519 mapread 0x63c000 thru 0x63f8d2 (0x38d3 bytes) 000486[0] 1776200784.495117 mapread 0x26e000 thru 0x274b77 (0x6b78 bytes) 000487[1] 1776200784.538130 trunc from 0x8ed9e7 to 0x96b94b (0x7df65 bytes) 000488[1] 1776200784.634739 mapread 0x7fc000 thru 0x8071c3 (0xb1c4 bytes) 000489[0] 1776200784.786836 mapread 0x216000 thru 0x2182b4 (0x22b5 bytes) 000492[0] 1776200784.932461 write 0x7ee000 thru 0x7f3429 (0x542a bytes) 000493[1] 1776200785.012322 mapwrite 0x254000 thru 0x2550ae (0x10af bytes) 000494[1] 1776200785.176287 read_OD 0x7a1000 thru 0x7affff (0xf000 bytes) 000495[0] 1776200785.197001 mapread 0x92c000 thru 0x933d05 (0x7d06 bytes) 000496[0] 1776200785.300903 trunc from 0x96b94c to 0x658e39 (0x312b12 bytes) 000498[1] 1776200785.417807 mapread 0x10e000 thru 0x119d6b (0xbd6c bytes) 000500[0] 1776200785.543328 read 0x024000 thru 0x02f077 (0xb078 bytes) All operations completed A-OK! PASS 16a (71s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 17:06:30 (1776200790) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.457761 s, 4.6 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.259157 s, 8.1 MB/s Chance of close/open is 1 in 50 Seed set to 793 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002[0] 1776200793.909910 write 0x12ae17 thru 0x12ccd4 (0x1ebe bytes) 000004[1] 1776200793.918881 read 0x0a2b1a thru 0x0a3a34 (0xf1b bytes) 000006[1] 1776200793.979341 write 0x49c0be thru 0x49d670 (0x15b3 bytes) 000007[1] 1776200794.029732 mapwrite 0x8bca52 thru 0x8bdd25 (0x12d4 bytes) truncating to largest ever: 0x6d5d7b 000010[0] 1776200794.324411 trunc from 0x8bdd26 to 0x6d5d7a (0x1e7fab bytes) 000011[1] 1776200794.420484 mapread 0x1caaa1 thru 0x1cc965 (0x1ec5 bytes) 000012[0] 1776200794.504242 read 0x1b3026 thru 0x1b4a78 (0x1a53 bytes) truncating to largest ever: 0x867205 000014[1] 1776200794.540397 trunc from 0x6d5d7b to 0x867204 (0x19148a bytes) 000015[1] 1776200794.649269 mapread 0x6b5ad1 thru 0x6b6d2f (0x125f bytes) truncating to largest ever: 0x929ecc 000016[0] 1776200794.673379 trunc from 0x867205 to 0x929ecb (0xc2cc7 bytes) 000018[1] 1776200794.747294 write 0x06ff1f thru 0x070674 (0x756 bytes) 000020[0] 1776200794.802538 mapread 0x358137 thru 0x3581e2 (0xac bytes) 000021[0] 1776200794.862260 trunc from 0x929ecc to 0x02662f (0x90389c bytes) 000023[0] 1776200794.958356 mapwrite 0x9e5d42 thru 0x9e74a6 (0x1765 bytes) 000025[1] 1776200795.103496 mapwrite 0x6a30e0 thru 0x6a38c0 (0x7e1 bytes) 000028[0] 1776200795.317943 write 0x07e817 thru 0x080334 (0x1b1e bytes) 000029[1] 1776200795.347541 trunc from 0x9e74a7 to 0x4102ea (0x5d71bc bytes) 000031[1] 1776200795.492240 write 0x378a67 thru 0x379153 (0x6ed bytes) 000033[0] 1776200795.504830 read 0x18f02c thru 0x18ffd1 (0xfa6 bytes) truncating to largest ever: 0x96b754 000034[1] 1776200795.556810 trunc from 0x4102eb to 0x96b753 (0x55b469 bytes) 000036[0] 1776200795.630623 mapread 0x924e5d thru 0x9260b2 (0x1256 bytes) 000037[1] 1776200795.703939 read 0x8f1bd2 thru 0x8f3915 (0x1d44 bytes) 000038[0] 1776200795.747716 write 0x01ba9b thru 0x01becd (0x433 bytes) 000039[1] 1776200795.940129 mapwrite 0x1f3c65 thru 0x1f557c (0x1918 bytes) 000040[0] 1776200796.110715 mapread 0x833ce3 thru 0x833e4a (0x168 bytes) 000042[1] 1776200796.162743 mapread 0x2f177a thru 0x2f318a (0x1a11 bytes) 000043[1] 1776200796.214754 write 0x2ae106 thru 0x2af459 (0x1354 bytes) 000044[1] 1776200796.242758 write 0x39ac5a thru 0x39c3cb (0x1772 bytes) 000045[1] 1776200796.275197 read 0x6b61db thru 0x6b7a54 (0x187a bytes) 000046[1] 1776200796.342332 read 0x1560db thru 0x157fb8 (0x1ede bytes) 000049[1] 1776200796.502927 trunc from 0x96b754 to 0x87197c (0xf9dd7 bytes) 000051[1] 1776200796.600147 mapread 0x75f474 thru 0x7600b2 (0xc3f bytes) 000052[1] 1776200796.601542 write 0x260e68 thru 0x261522 (0x6bb bytes) 000054[0] 1776200796.636476 mapwrite 0x7ae845 thru 0x7afc8d (0x1449 bytes) 000056[0] 1776200796.787064 trunc from 0x87197d to 0x6c1a09 (0x1aff73 bytes) 000058[1] 1776200796.872531 mapwrite 0x6583a7 thru 0x658766 (0x3c0 bytes) 000059[1] 1776200797.008971 mapread 0x1ed59a thru 0x1ee969 (0x13d0 bytes) 000060[1] 1776200797.092162 mapwrite 0x743706 thru 0x744768 (0x1063 bytes) 000061[0] 1776200797.210994 read 0x71bb2a thru 0x71bd27 (0x1fe bytes) 000062[0] 1776200797.258235 write 0x8e42c1 thru 0x8e5c30 (0x1970 bytes) 000064[0] 1776200797.314300 write 0x0f6cfe thru 0x0f8549 (0x184c bytes) 000069[1] 1776200797.387203 read 0x8b0555 thru 0x8b109d (0xb49 bytes) 000071[1] 1776200797.460916 mapwrite 0x02e1b3 thru 0x02f359 (0x11a7 bytes) 000073[1] 1776200797.658168 read 0x54a4a7 thru 0x54c1bb (0x1d15 bytes) 000074[1] 1776200797.743942 mapwrite 0x7f8937 thru 0x7fa2bb (0x1985 bytes) 000075[1] 1776200797.883818 write 0x655f32 thru 0x65603f (0x10e bytes) 000077[0] 1776200797.889991 trunc from 0x8e5c31 to 0x0f60ae (0x7efb82 bytes) 000078[0] 1776200798.000412 read 0x092fb6 thru 0x0939e9 (0xa34 bytes) 000079[1] 1776200798.064858 write 0x222817 thru 0x224570 (0x1d5a bytes) 000080[1] 1776200798.101877 read 0x0524b5 thru 0x053dd5 (0x1921 bytes) 000081[0] 1776200798.147735 mapread 0x0829d0 thru 0x083534 (0xb65 bytes) 000082[1] 1776200798.211297 write 0x1fcf68 thru 0x1fd11d (0x1b6 bytes) 000083[1] 1776200798.266146 mapread 0x00e4f8 thru 0x00ff4b (0x1a54 bytes) 000086[0] 1776200798.365859 trunc from 0x224571 to 0x1bf60a (0x64f66 bytes) 000089[1] 1776200798.493802 write 0x938b6b thru 0x939caf (0x1145 bytes) 000091[1] 1776200798.569201 mapwrite 0x822afc thru 0x82418a (0x168f bytes) 000093[0] 1776200798.819514 write 0x3d1317 thru 0x3d13a6 (0x90 bytes) 000094[0] 1776200798.894239 mapwrite 0x799b3d thru 0x79b4d3 (0x1997 bytes) 000096[1] 1776200799.013794 mapwrite 0x983a44 thru 0x984503 (0xac0 bytes) 000097[1] 1776200799.182852 trunc from 0x984504 to 0x903263 (0x812a0 bytes) 000099[1] 1776200799.306761 write 0x90df2d thru 0x90e982 (0xa56 bytes) truncating to largest ever: 0x9e2f23 000101[0] 1776200799.334380 trunc from 0x90e983 to 0x9e2f22 (0xd45a0 bytes) 000102[0] 1776200799.443959 write 0x7bb366 thru 0x7bbac7 (0x762 bytes) 000104[1] 1776200799.592139 mapwrite 0x289b29 thru 0x289d04 (0x1dc bytes) 000106[0] 1776200799.754759 read 0x455297 thru 0x4552d2 (0x3c bytes) 000108[0] 1776200799.897493 mapwrite 0x900850 thru 0x9027fb (0x1fac bytes) 000109[0] 1776200799.991244 mapwrite 0x56304c thru 0x563e69 (0xe1e bytes) 000112[1] 1776200800.084508 trunc from 0x9e2f23 to 0x4ce7f2 (0x514730 bytes) 000113[1] 1776200800.164271 read 0x183db1 thru 0x184488 (0x6d8 bytes) 000114[0] 1776200800.241315 mapwrite 0x3601b3 thru 0x36063f (0x48d bytes) 000115[0] 1776200800.318405 trunc from 0x4ce7f3 to 0x08c4a8 (0x44234a bytes) 000116[0] 1776200800.375779 mapwrite 0x0ce213 thru 0x0ce2c6 (0xb4 bytes) 000120[1] 1776200800.514893 read 0x0b206f thru 0x0b3716 (0x16a8 bytes) 000121[0] 1776200800.544343 write 0x0d3bd4 thru 0x0d4423 (0x850 bytes) truncating to largest ever: 0x9eab99 000124[1] 1776200800.585288 trunc from 0x0d4424 to 0x9eab98 (0x916775 bytes) 000128[1] 1776200800.674583 write 0x681fce thru 0x68212f (0x162 bytes) 000131[1] 1776200800.839884 mapread 0x391698 thru 0x391dd3 (0x73c bytes) 000133[1] 1776200800.842479 read 0x7a3b2c thru 0x7a59b0 (0x1e85 bytes) 000134[0] 1776200800.843527 trunc from 0x9eab99 to 0x99a7af (0x503e9 bytes) 000135[0] 1776200800.986008 mapread 0x476b59 thru 0x47811b (0x15c3 bytes) 000136[0] 1776200801.018198 write 0x37b084 thru 0x37b56b (0x4e8 bytes) 000137[0] 1776200801.025845 mapwrite 0x631348 thru 0x631798 (0x451 bytes) 000139[0] 1776200801.155280 mapwrite 0x889ff8 thru 0x88bb46 (0x1b4f bytes) 000142[0] 1776200801.368141 mapread 0x5698c5 thru 0x56a61b (0xd57 bytes) 000144[1] 1776200801.404753 read 0x69eaf9 thru 0x6a055a (0x1a62 bytes) 000145[0] 1776200801.458572 trunc from 0x99a7b0 to 0x960ee2 (0x398cd bytes) 000146[0] 1776200801.546817 write 0x70dcae thru 0x70ea48 (0xd9b bytes) 000147[1] 1776200801.575755 trunc from 0x960ee3 to 0x7637b2 (0x1fd730 bytes) 000148[0] 1776200801.670305 mapwrite 0x28a474 thru 0x28b978 (0x1505 bytes) 000152[1] 1776200801.826933 trunc from 0x7637b3 to 0x9870e8 (0x223936 bytes) 000154[0] 1776200801.945519 trunc from 0x9870e9 to 0x63a246 (0x34cea2 bytes) 000161[0] 1776200802.073937 read 0x0769b8 thru 0x07759b (0xbe4 bytes) 000166[1] 1776200802.280544 trunc from 0x63a247 to 0x73b71b (0x1014d5 bytes) 000167[0] 1776200802.433979 trunc from 0x73b71c to 0x90944a (0x1cdd2f bytes) 000170[0] 1776200802.583300 write 0x91fa25 thru 0x920600 (0xbdc bytes) 000171[1] 1776200802.628213 write 0x8f9a5d thru 0x8faeb5 (0x1459 bytes) 000173[0] 1776200802.712284 write 0x268588 thru 0x2695e4 (0x105d bytes) 000174[0] 1776200802.885031 mapread 0x4e3305 thru 0x4e42c8 (0xfc4 bytes) 000176[1] 1776200802.937244 mapwrite 0x02ef93 thru 0x030d30 (0x1d9e bytes) 000178[0] 1776200803.280584 write 0x82b62d thru 0x82bbd0 (0x5a4 bytes) 000179[0] 1776200803.296496 mapwrite 0x5170e7 thru 0x51813b (0x1055 bytes) 000180[0] 1776200803.399847 read 0x2ae58f thru 0x2af1a5 (0xc17 bytes) 000181[1] 1776200803.571162 mapread 0x33b1c8 thru 0x33d146 (0x1f7f bytes) 000184[1] 1776200803.695348 write 0x485ce5 thru 0x48658f (0x8ab bytes) 000186[0] 1776200803.800753 write 0x667abd thru 0x667d7e (0x2c2 bytes) 000187[0] 1776200803.851878 write 0x2dd7e6 thru 0x2de391 (0xbac bytes) 000188[1] 1776200803.875120 trunc from 0x920601 to 0x316d18 (0x6098e8 bytes) 000189[1] 1776200803.942652 trunc from 0x316d19 to 0x242c8b (0xd408d bytes) 000190[0] 1776200803.963406 write 0x3ba7fa thru 0x3bac93 (0x49a bytes) 000192[1] 1776200804.017542 write 0x855b1e thru 0x857067 (0x154a bytes) 000193[1] 1776200804.037920 trunc from 0x857068 to 0x458d8c (0x3fe2db bytes) 000194[0] 1776200804.104802 mapwrite 0x97a66a thru 0x97af38 (0x8cf bytes) 000195[1] 1776200804.231266 read 0x8e9afd thru 0x8eac21 (0x1125 bytes) 000197[0] 1776200804.278969 trunc from 0x97af39 to 0x8ae6f0 (0xcc848 bytes) 000200[0] 1776200804.369318 mapread 0x0ad5b4 thru 0x0af461 (0x1eae bytes) 000202[1] 1776200804.432170 mapread 0x5c2d79 thru 0x5c3d23 (0xfab bytes) 000203[0] 1776200804.471025 write 0x12ed62 thru 0x12fc4b (0xeea bytes) 000204[1] 1776200804.526499 read 0x3ef853 thru 0x3f0e12 (0x15c0 bytes) 000205[0] 1776200804.594225 write 0x600cd2 thru 0x6016e3 (0xa12 bytes) 000208[0] 1776200804.622868 trunc from 0x8ae6f1 to 0x18e5a1 (0x72014f bytes) 000211[0] 1776200804.736005 mapread 0x01afbf thru 0x01c1a5 (0x11e7 bytes) 000213[0] 1776200804.781795 mapwrite 0x1dc52b thru 0x1ddb10 (0x15e6 bytes) 000215[1] 1776200804.934409 mapwrite 0x61a7ab thru 0x61a9a5 (0x1fb bytes) 000216[1] 1776200805.107482 read 0x441f6d thru 0x44391e (0x19b2 bytes) 000218[1] 1776200805.137584 read 0x4131c9 thru 0x4132aa (0xe2 bytes) 000220[0] 1776200805.138858 read 0x53e6ef thru 0x53e867 (0x179 bytes) 000221[1] 1776200805.201444 read 0x400342 thru 0x4015bc (0x127b bytes) 000224[0] 1776200805.229686 read 0x0053a8 thru 0x0055dd (0x236 bytes) 000225[1] 1776200805.373517 mapwrite 0x351f39 thru 0x352647 (0x70f bytes) 000226[0] 1776200805.545833 read 0x50f8cd thru 0x511054 (0x1788 bytes) 000230[1] 1776200805.627510 read 0x4385dc thru 0x438de5 (0x80a bytes) 000231[0] 1776200805.628818 write 0x60b1b8 thru 0x60b731 (0x57a bytes) 000233[1] 1776200805.684460 trunc from 0x61a9a6 to 0x6d026c (0xb58c7 bytes) 000235[1] 1776200805.833216 mapread 0x3ec33b thru 0x3ec7b0 (0x476 bytes) 000237[0] 1776200805.916280 mapread 0x39f101 thru 0x39fd14 (0xc14 bytes) 000238[1] 1776200805.977674 mapread 0x58fbe9 thru 0x591769 (0x1b81 bytes) 000239[1] 1776200806.036465 trunc from 0x6d026d to 0x1f665f (0x4d9c0d bytes) 000244[1] 1776200806.124535 write 0x4968c9 thru 0x4981a6 (0x18de bytes) 000246[0] 1776200806.131723 mapread 0x2731bc thru 0x2747cb (0x1610 bytes) 000248[0] 1776200806.173845 mapread 0x472f7f thru 0x4735af (0x631 bytes) 000253[1] 1776200806.279765 write 0x7d1eb5 thru 0x7d3979 (0x1ac5 bytes) 000254[0] 1776200806.282206 trunc from 0x7d397a to 0x00c348 (0x7c7631 bytes) 000256[0] 1776200806.397891 trunc from 0x00c349 to 0x4c6092 (0x4b9d4a bytes) 000257[0] 1776200806.444465 read 0x00a454 thru 0x00c142 (0x1cef bytes) truncating to largest ever: 0x9fc54f 000260[0] 1776200806.473782 trunc from 0x4c6093 to 0x9fc54e (0x5364bc bytes) 000262[0] 1776200806.504647 write 0x89da16 thru 0x89de85 (0x470 bytes) 000264[1] 1776200806.532599 mapread 0x6a8285 thru 0x6a91f5 (0xf71 bytes) 000265[0] 1776200806.619497 read 0x735e9e thru 0x7374f0 (0x1653 bytes) 000267[0] 1776200806.686829 trunc from 0x9fc54f to 0x5f8a3a (0x403b14 bytes) 000268[1] 1776200806.738337 write 0x47de34 thru 0x47f9db (0x1ba8 bytes) 000269[1] 1776200806.787801 write 0x50227f thru 0x5041d0 (0x1f52 bytes) 000271[1] 1776200806.894127 mapread 0x31c7bf thru 0x31d469 (0xcab bytes) 000272[1] 1776200806.927857 mapwrite 0x55a89a thru 0x55ae3d (0x5a4 bytes) 000273[1] 1776200806.999398 write 0x90969e thru 0x90a7b3 (0x1116 bytes) 000279[0] 1776200807.207696 write 0x0372f2 thru 0x0373a1 (0xb0 bytes) 000281[0] 1776200807.357233 mapread 0x59ba6f thru 0x59d8b5 (0x1e47 bytes) 000285[1] 1776200807.522384 mapread 0x66da31 thru 0x66dff2 (0x5c2 bytes) 000286[1] 1776200807.575354 read 0x1f3c81 thru 0x1f56da (0x1a5a bytes) 000288[1] 1776200807.584194 mapwrite 0x676420 thru 0x67672b (0x30c bytes) 000289[1] 1776200807.655303 mapread 0x2c84cf thru 0x2c9e2a (0x195c bytes) 000290[0] 1776200807.676326 mapwrite 0x45db49 thru 0x45f82b (0x1ce3 bytes) 000291[0] 1776200807.822713 trunc from 0x90a7b4 to 0x4a54db (0x4652d8 bytes) 000292[1] 1776200807.891219 mapwrite 0x419faa thru 0x41be36 (0x1e8d bytes) 000293[0] 1776200807.998969 mapread 0x07b66d thru 0x07b77a (0x10e bytes) 000295[0] 1776200808.057937 trunc from 0x4a54dc to 0x310f96 (0x194545 bytes) 000296[1] 1776200808.108381 write 0x296881 thru 0x296e09 (0x589 bytes) 000299[0] 1776200808.294200 read 0x1ac86e thru 0x1ad11e (0x8b1 bytes) 000302[0] 1776200808.387929 trunc from 0x310f97 to 0x838e58 (0x527ec2 bytes) 000303[1] 1776200808.437236 mapwrite 0x9eaee7 thru 0x9ecbc1 (0x1cdb bytes) 000306[0] 1776200808.672293 mapread 0x3ba16c thru 0x3ba9d0 (0x865 bytes) 000308[0] 1776200808.730705 mapread 0x4e16a1 thru 0x4e1e94 (0x7f4 bytes) 000309[1] 1776200808.902846 read 0x69fe43 thru 0x6a1413 (0x15d1 bytes) 000310[1] 1776200809.042305 mapwrite 0x659cb5 thru 0x65b5c5 (0x1911 bytes) 000311[1] 1776200809.233354 write 0x0cd3c5 thru 0x0ce82c (0x1468 bytes) 000313[0] 1776200809.256351 trunc from 0x9ecbc2 to 0x9d08ff (0x1c2c2 bytes) 000314[1] 1776200809.447094 write 0x9393e8 thru 0x9399db (0x5f4 bytes) 000315[0] 1776200809.564584 mapwrite 0x7e54a6 thru 0x7e735a (0x1eb5 bytes) 000316[1] 1776200809.707069 mapwrite 0x06d49e thru 0x06da11 (0x574 bytes) 000319[0] 1776200809.893631 mapwrite 0x2141a1 thru 0x214d9c (0xbfc bytes) 000320[0] 1776200810.026689 read 0x162aa8 thru 0x162ea6 (0x3ff bytes) 000321[1] 1776200810.215128 write 0x0f5096 thru 0x0f5fa9 (0xf14 bytes) 000325[0] 1776200810.315694 write 0x444a2a thru 0x446068 (0x163f bytes) 000327[0] 1776200810.373090 trunc from 0x9d0900 to 0x03faff (0x990e00 bytes) 000328[1] 1776200810.427676 trunc from 0x03fb00 to 0x2081d8 (0x1c86d9 bytes) 000330[0] 1776200810.526940 trunc from 0x2081d9 to 0x7b4c06 (0x5aca2e bytes) 000331[1] 1776200810.596127 mapread 0x4d415a thru 0x4d50cf (0xf76 bytes) 000332[0] 1776200810.640176 mapwrite 0x28a2e1 thru 0x28af6e (0xc8e bytes) 000333[1] 1776200810.729216 mapwrite 0x742c9a thru 0x743190 (0x4f7 bytes) 000338[1] 1776200810.952264 trunc from 0x7b4c07 to 0x410fbc (0x3a3c4a bytes) 000339[0] 1776200811.039412 read 0x168228 thru 0x1694b0 (0x1289 bytes) 000341[1] 1776200811.125141 trunc from 0x410fbd to 0x5000d1 (0xef115 bytes) 000342[0] 1776200811.186257 mapwrite 0x5559a4 thru 0x55692e (0xf8b bytes) 000344[1] 1776200811.429534 read 0x2103a6 thru 0x210a03 (0x65e bytes) 000345[1] 1776200811.483329 mapwrite 0x1ed569 thru 0x1ee9ea (0x1482 bytes) 000346[0] 1776200811.646275 read 0x3e34d8 thru 0x3e4934 (0x145d bytes) 000352[1] 1776200811.721274 trunc from 0x55692f to 0x938d07 (0x3e23d9 bytes) 000354[0] 1776200811.793043 mapread 0x638a14 thru 0x63a8a1 (0x1e8e bytes) 000355[1] 1776200811.874747 read 0x8c614b thru 0x8c77f0 (0x16a6 bytes) 000357[1] 1776200811.923341 trunc from 0x938d08 to 0x1b2c5e (0x7860a9 bytes) 000358[1] 1776200812.015055 write 0x99c67c thru 0x99d8c8 (0x124d bytes) 000365[0] 1776200812.161123 mapread 0x961d80 thru 0x9635a2 (0x1823 bytes) 000366[1] 1776200812.343573 mapwrite 0x200eb3 thru 0x2019ec (0xb3a bytes) 000368[0] 1776200812.516470 read 0x452091 thru 0x452944 (0x8b4 bytes) 000369[1] 1776200812.605194 trunc from 0x99d8c9 to 0x8ea367 (0xb3561 bytes) 000370[1] 1776200812.692464 mapread 0x35914b thru 0x359c51 (0xb07 bytes) 000372[1] 1776200812.741154 write 0x568142 thru 0x56870d (0x5cc bytes) 000374[1] 1776200812.745369 read 0x3041ce thru 0x304de3 (0xc16 bytes) 000377[0] 1776200812.893183 write 0x85ab2c thru 0x85c4ea (0x19bf bytes) 000379[0] 1776200812.956263 trunc from 0x8ea368 to 0x9f5cc8 (0x10b961 bytes) 000381[1] 1776200813.047118 mapread 0x7f93c3 thru 0x7faa7f (0x16bd bytes) 000388[1] 1776200813.130064 trunc from 0x9f5cc9 to 0x4942c0 (0x561a08 bytes) 000390[0] 1776200813.187467 mapwrite 0x391498 thru 0x3916b4 (0x21d bytes) 000395[1] 1776200813.347026 mapwrite 0x7d3ba1 thru 0x7d59f0 (0x1e50 bytes) 000398[0] 1776200813.560797 read 0x626572 thru 0x62662f (0xbe bytes) 000402[0] 1776200813.729519 read 0x2641f3 thru 0x265495 (0x12a3 bytes) 000405[1] 1776200813.797259 mapread 0x78a7ab thru 0x78aead (0x703 bytes) 000406[0] 1776200813.804539 read 0x4f56ad thru 0x4f57c3 (0x117 bytes) 000410[0] 1776200813.840231 trunc from 0x7d59f1 to 0x6707fc (0x1651f4 bytes) 000412[0] 1776200813.970041 write 0x545405 thru 0x546796 (0x1392 bytes) 000413[1] 1776200814.071792 trunc from 0x6707fd to 0x9ce4db (0x35dcdf bytes) 000416[0] 1776200814.158135 read 0x44fba4 thru 0x45185a (0x1cb7 bytes) 000420[1] 1776200814.307259 mapwrite 0x56e491 thru 0x56f465 (0xfd5 bytes) 000423[0] 1776200814.473585 mapread 0x29a32e thru 0x29b7c8 (0x149b bytes) 000426[1] 1776200814.520876 mapwrite 0x24b13b thru 0x24c3bd (0x1283 bytes) 000427[0] 1776200814.768562 mapwrite 0x9569e7 thru 0x9581bc (0x17d6 bytes) 000428[1] 1776200814.971045 trunc from 0x9ce4dc to 0x64b776 (0x382d65 bytes) 000431[1] 1776200815.128466 mapread 0x30a7d2 thru 0x30b163 (0x992 bytes) 000432[0] 1776200815.188075 write 0x5aa9e6 thru 0x5ac16d (0x1788 bytes) 000436[0] 1776200815.362704 trunc from 0x64b777 to 0x432ef9 (0x21887d bytes) 000438[0] 1776200815.434342 trunc from 0x432efa to 0x17a0f6 (0x2b8e03 bytes) 000439[0] 1776200815.469520 mapwrite 0x798f8b thru 0x79a776 (0x17ec bytes) 000442[1] 1776200815.660146 write 0x18c391 thru 0x18db58 (0x17c8 bytes) 000443[0] 1776200815.704571 mapwrite 0x2521d0 thru 0x25260e (0x43f bytes) 000444[0] 1776200815.813449 write 0x627cea thru 0x629b57 (0x1e6e bytes) 000446[0] 1776200815.908446 mapwrite 0x4fc137 thru 0x4fd4e8 (0x13b2 bytes) 000447[0] 1776200816.133452 read 0x0a947e thru 0x0ab039 (0x1bbc bytes) 000448[1] 1776200816.209457 mapwrite 0x02fb13 thru 0x030730 (0xc1e bytes) 000450[1] 1776200816.500946 read 0x51180f thru 0x511fc0 (0x7b2 bytes) 000451[1] 1776200816.590533 read 0x410241 thru 0x410294 (0x54 bytes) 000452[1] 1776200816.657065 mapwrite 0x0c3dfc thru 0x0c4099 (0x29e bytes) 000454[1] 1776200816.767655 write 0x5ab9b5 thru 0x5ac78d (0xdd9 bytes) 000457[0] 1776200816.850046 trunc from 0x79a777 to 0x4b4d4e (0x2e5a28 bytes) 000458[0] 1776200816.978104 trunc from 0x4b4d4f to 0x0ef2cb (0x3c5a83 bytes) 000459[0] 1776200817.028574 read 0x03fbd3 thru 0x040b7c (0xfaa bytes) 000460[0] 1776200817.055539 trunc from 0x0ef2cc to 0x0efa81 (0x7b6 bytes) 000462[1] 1776200817.117597 read 0x0b511c thru 0x0b65f7 (0x14dc bytes) 000464[0] 1776200817.199693 read 0x01b5c2 thru 0x01d3f2 (0x1e31 bytes) 000465[1] 1776200817.273302 trunc from 0x0efa82 to 0x01e7bd (0xd12c4 bytes) 000470[0] 1776200817.458739 read 0x01e4d8 thru 0x01e7bd (0x2e6 bytes) 000471[1] 1776200817.504727 read 0x003a4a thru 0x005878 (0x1e2f bytes) 000472[0] 1776200817.523074 write 0x122c07 thru 0x1232da (0x6d4 bytes) 000475[1] 1776200817.567511 trunc from 0x1232db to 0x0b935c (0x69f7e bytes) 000476[1] 1776200817.633372 trunc from 0x0b935d to 0x5fd8e7 (0x54458b bytes) 000477[1] 1776200817.654293 trunc from 0x5fd8e8 to 0x4eae76 (0x112a71 bytes) 000478[0] 1776200817.691122 read 0x37ec90 thru 0x37fad2 (0xe43 bytes) 000479[1] 1776200817.721071 mapread 0x42c51f thru 0x42c5d4 (0xb6 bytes) 000483[1] 1776200817.863202 write 0x2a659a thru 0x2a6b85 (0x5ec bytes) 000484[1] 1776200817.867467 read 0x4c58af thru 0x4c6a56 (0x11a8 bytes) 000486[0] 1776200817.868587 mapwrite 0x65320d thru 0x6549b3 (0x17a7 bytes) 000487[1] 1776200818.099428 write 0x5c3869 thru 0x5c3cd0 (0x468 bytes) 000489[1] 1776200818.194495 trunc from 0x6549b4 to 0x0c352a (0x591489 bytes) 000490[1] 1776200818.299738 write 0x8d7a9d thru 0x8d82bc (0x820 bytes) 000491[1] 1776200818.348517 mapread 0x736915 thru 0x73763e (0xd2a bytes) 000494[1] 1776200818.424911 mapread 0x66e045 thru 0x66fbf1 (0x1bad bytes) 000495[0] 1776200818.491155 mapread 0x6b531f thru 0x6b66aa (0x138c bytes) 000497[0] 1776200818.608141 read 0x2e169d thru 0x2e1719 (0x7d bytes) 000499[1] 1776200818.709376 mapwrite 0x6c86a0 thru 0x6c8fcb (0x92c bytes) 000500[0] 1776200818.849733 write 0x3bee70 thru 0x3bf88e (0xa1f bytes) All operations completed A-OK! PASS 16b (35s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 17:07:06 (1776200826) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (5s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 17:07:12 (1776200832) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.639525 s, 3.3 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.667868 s, 3.1 MB/s ldlm.namespaces.MGC192.168.203.105@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8dc2456b5000.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8dc246946800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8dc246946800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8dc246946800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 15.1149 s, 6.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.37058 s, 31.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.1835 s, 32.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.00094 s, 15.0 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.7591 s, 10.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.87663 s, 27.0 MB/s PASS 16d (57s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 17:08:10 (1776200890) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.235211 s, 44.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112893 s, 9.3 MB/s PASS 16e (6s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 17:08:16 (1776200896) TIMEOUT PASS 16f (27s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 17:08:44 (1776200924) TIMEOUT PASS 16g (29s) == sanityn test 16i: read after truncate file ============ 17:09:13 (1776200953) ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16i (9s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 17:09:21 (1776200961) fail_loc=0x8000030a PASS 17 (11s) == sanityn test 18: mmap sanity check =========================================================================================== 17:09:33 (1776200973) mmap test1: basic mmap operation (PASS, 0.13411s) mmap test2: MAP_PRIVATE not write back (PASS, 0.093346s) mmap test3: concurrent mmap ops on two nodes (PASS, 4.7356s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.5746s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.20428s) mmap test6: check mmap write/read content on two nodes (PASS, 0.23383s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.1401s) PASS 18 (19s) == sanityn test 19: test concurrent uncached read races ========================================================================= 17:09:52 (1776200992) oleg305-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg305-client: oleg305-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (5s) == sanityn test 20: test extra readahead page left in cache ============================================================== 17:09:57 (1776200997) PASS 20 (7s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 17:10:05 (1776201005) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (6s) == sanityn test 23: others should see updated atime while another read============================================================== 17:10:11 (1776201011) now is 1776201014 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 new atime is 1776201075 PASS 23 (70s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 17:11:21 (1776201081) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.2K 374 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 374 115.0K 1% /mnt/lustre[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 374 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 374 115.0K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 7.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 4.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 11.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118006 374 117632 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118102 374 117728 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 374 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 374 115.0K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118006 374 117632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118102 374 117728 1% /mnt/lustre[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118006 374 117632 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118102 374 117728 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 PASS 24a (7s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 17:11:28 (1776201088) PASS 24b (6s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 17:11:34 (1776201094) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (7s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 17:11:41 (1776201101) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (3s) == sanityn test 26a: allow mtime to get older ============ 17:11:44 (1776201104) utime: good mknod times 1776201104 <= 1776201105 <= 1776201105 for /mnt/lustre/f26a utime: good mknod times 1776201104 <= 1776201105 <= 1776201105 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (7s) == sanityn test 26b: sync mtime between ost and mds ====== 17:11:52 (1776201112) PASS 26b (7s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 17:12:02 (1776201122) 0 PASS 30 (7s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 17:12:09 (1776201129) fail_loc=0x314 PASS 31a (7s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 17:12:16 (1776201136) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg305-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.203.105@tcp:/lustre 7542784 12288 7524352 1% /mnt/lustre2 PASS 31b (21s) == sanityn test 31r: open-rename(replace) race =========== 17:12:38 (1776201158) -rw-r--r-- 1 root root 0 Apr 14 17:12 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (10s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 17:12:49 (1776201169) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (4s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 17:12:52 (1776201172) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (2s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 17:12:54 (1776201174) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (3s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 17:12:58 (1776201178) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (3s) == sanityn test 34: no lock timeout under IO ============= 17:13:01 (1776201181) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8dc2456b5000.ost_server_uuid,osc.lustre-OST0000-osc-ffff8dc246946800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8dc2456b5000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff8dc246946800.ost_server_uuid in FULL state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8dc2456b5000.ost_server_uuid,osc.lustre-OST0001-osc-ffff8dc246946800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8dc2456b5000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8dc246946800.ost_server_uuid in IDLE state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8dc2456b5000.ost_server_uuid,osc.lustre-OST0000-osc-ffff8dc246946800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8dc2456b5000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff8dc246946800.ost_server_uuid in FULL state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8dc2456b5000.ost_server_uuid,osc.lustre-OST0001-osc-ffff8dc246946800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8dc2456b5000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8dc246946800.ost_server_uuid in IDLE state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8dc2456b5000.ost_server_uuid,osc.lustre-OST0000-osc-ffff8dc246946800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8dc2456b5000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff8dc246946800.ost_server_uuid in FULL state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8dc2456b5000.ost_server_uuid,osc.lustre-OST0001-osc-ffff8dc246946800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8dc2456b5000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8dc246946800.ost_server_uuid in IDLE state after 0 sec PASS 34 (122s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 17:15:03 (1776201303) fail_loc=0x80000317 Race attempt 0 Wait for 44728 44765 for 60 sec... /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1379: 44728 Killed createmany -o $MOUNT2/$tdir/a 4000 fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.203.105@tcp:/lustre 7.2G 13M 7.2G 1% /mnt/lustre 192.168.203.105@tcp:/lustre 7.2G 13M 7.2G 1% /mnt/lustre2 - open/close 594 (time 1776201319.33 total 10.00 last 59.40) - open/close 1150 (time 1776201329.34 total 20.00 last 55.58) - open/close 1818 (time 1776201339.35 total 30.02 last 66.70) - open/close 2444 (time 1776201349.36 total 40.03 last 62.54) - open/close 3105 (time 1776201359.37 total 50.04 last 66.06) - open/close 3817 (time 1776201369.37 total 60.04 last 71.16) total: 4000 open/close in 63.24 seconds: 63.25 ops/second PASS 35 (71s) == sanityn test 36: handle ESTALE/open-unlink correctly == 17:16:14 (1776201374) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg305-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.723464 s, 72.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7525376) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.580981 s, 90.2 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7498752) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.460653 s, 114 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7498752) after_dd(7456768) after(7507968) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.771308 s, 68.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7507968) after_dd(7457792) after(7508992) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.572918 s, 91.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7508992) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.715004 s, 73.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7498752) after_dd(7463936) after(7515136) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.759809 s, 69.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7515136) after_dd(7465984) after(7517184) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.33241 s, 158 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7517184) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.632694 s, 82.9 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7498752) after_dd(7455744) after(7506944) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.720099 s, 72.8 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7506944) after_dd(7464960) after(7516160) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.468526 s, 112 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7516160) after_dd(7457792) after(7508992) PASS 36 (290s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 17:21:05 (1776201665) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 - create 1375 (time 1776201678.22 total 10.01 last 137.41) - create 2660 (time 1776201688.23 total 20.02 last 128.37) - create 3937 (time 1776201698.24 total 30.02 last 127.64) - create 5132 (time 1776201708.24 total 40.02 last 119.47) - create 6318 (time 1776201718.25 total 50.03 last 118.53) - create 7564 (time 1776201728.25 total 60.03 last 124.55) - create 8737 (time 1776201738.25 total 70.03 last 117.29) - create 9963 (time 1776201748.26 total 80.04 last 122.55) total: 10000 create in 80.32 seconds: 124.51 ops/second PASS 37 (91s) == sanityn test 39a: test from 11063 ============================================================================================ 17:22:35 (1776201755) repeat after cancel_lru_locks PASS 39a (8s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 17:22:43 (1776201763) repeat after cancel_lru_locks PASS 39b (8s) == sanityn test 39c: check truncate mtime update ================================================================================ 17:22:51 (1776201771) repeat after cancel_lru_locks PASS 39c (8s) == sanityn test 39d: sync write should update mtime ====== 17:22:59 (1776201779) fail_loc=0x411 fail_loc=0 PASS 39d (6s) == sanityn test 40a: pdirops: create vs others ======================================================================== 17:23:05 (1776201785) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (18s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 17:23:23 (1776201803) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (18s) == sanityn test 40c: pdirops: link and others ======================================================================== 17:23:41 (1776201821) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (16s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 17:23:57 (1776201837) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (16s) == sanityn test 40e: pdirops: rename and others ======================================================================== 17:24:13 (1776201853) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (15s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 17:24:28 (1776201868) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (14s) == sanityn test 41b: pdirops: create vs create ======================================================================== 17:24:42 (1776201882) open: File exists Conflict PASS 41b (13s) == sanityn test 41c: pdirops: create vs link ======================================================================== 17:24:55 (1776201895) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (11s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 17:25:07 (1776201907) Conflict PASS 41d (12s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 17:25:18 (1776201918) Conflict PASS 41e (13s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 17:25:31 (1776201931) Conflict PASS 41f (14s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 17:25:45 (1776201945) Conflict PASS 41g (13s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 17:25:58 (1776201958) Conflict PASS 41h (14s) == sanityn test 41i: reint_open: create vs create ======== 17:26:12 (1776201972) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (1095s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 17:44:27 (1776203067) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (14s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 17:44:41 (1776203081) open: File exists Conflict PASS 42b (13s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 17:44:54 (1776203094) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (15s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 17:45:09 (1776203109) Conflict PASS 42d (15s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 17:45:24 (1776203124) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (15s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 17:45:39 (1776203139) Conflict PASS 42f (14s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 17:45:53 (1776203153) Conflict PASS 42g (14s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 17:46:08 (1776203168) Conflict PASS 42h (13s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 17:46:21 (1776203181) PASS 43a (56s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 17:47:18 (1776203238) Conflict PASS 43b (13s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 17:47:32 (1776203252) Conflict PASS 43c (15s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 17:47:46 (1776203266) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (15s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 17:48:01 (1776203281) Conflict PASS 43e (14s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 17:48:15 (1776203295) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (14s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 17:48:29 (1776203309) stat: cannot statx '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (13s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 17:48:42 (1776203322) Conflict PASS 43h (15s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 17:48:57 (1776203337) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (4s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 17:49:01 (1776203341) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (149s) == sanityn test 43k: unlink vs create ==================== 17:51:30 (1776203490) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (1246s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 18:12:16 (1776204736) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Tue Apr 14 18:12:24 EDT 2026 PASS 44a (13s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 18:12:29 (1776204749) open: File exists Conflict PASS 44b (13s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 18:12:42 (1776204762) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (12s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 18:12:54 (1776204774) Conflict PASS 44d (12s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 18:13:06 (1776204786) Conflict PASS 44e (13s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 18:13:19 (1776204799) Conflict PASS 44f (14s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 18:13:34 (1776204814) Conflict PASS 44g (14s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 18:13:48 (1776204828) Conflict PASS 44h (14s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 18:14:02 (1776204842) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (4s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 18:14:06 (1776204846) PASS 45a (113s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 18:15:59 (1776204959) Conflict PASS 45b (14s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 18:16:13 (1776204973) Conflict PASS 45c (14s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 18:16:27 (1776204987) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (15s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 18:16:42 (1776205002) Conflict PASS 45e (16s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 18:16:58 (1776205018) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (13s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 18:17:11 (1776205031) stat: cannot statx '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (15s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 18:17:26 (1776205046) Conflict PASS 45h (14s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 18:17:40 (1776205060) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (4s) == sanityn test 45j: read vs rename ====================== 18:17:44 (1776205064) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (1298s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 18:39:22 (1776206362) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (13s) == sanityn test 46b: pdirops: link vs create ======================================================================== 18:39:35 (1776206375) open: File exists Conflict PASS 46b (15s) == sanityn test 46c: pdirops: link vs link ======================================================================== 18:39:50 (1776206390) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (14s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 18:40:04 (1776206404) Conflict PASS 46d (13s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 18:40:17 (1776206417) Conflict PASS 46e (16s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 18:40:33 (1776206433) Conflict PASS 46f (14s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 18:40:47 (1776206447) Conflict PASS 46g (15s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 18:41:03 (1776206463) Conflict PASS 46h (16s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 18:41:18 (1776206478) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (3s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 18:41:21 (1776206481) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (3s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 18:41:24 (1776206484) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (3s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 18:41:27 (1776206487) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (4s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 18:41:31 (1776206491) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (3s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 18:41:34 (1776206494) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (3s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 18:41:37 (1776206497) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (3s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 18:41:41 (1776206501) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (3s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 18:41:44 (1776206504) 10+0 records in 10+0 records out 10240 bytes (10 kB, 10 KiB) copied, 0.0897607 s, 114 kB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (11s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 18:41:56 (1776206516) 0+1 records in 0+1 records out 158 bytes copied, 0.0157969 s, 10.0 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3146: kill: (242290) - No such process PASS 51a (9s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 18:42:05 (1776206525) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0430884 s, 23.8 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0608148 s, 17.2 MB/s 3145728 PASS 51b (19s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 18:42:24 (1776206544) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0590309 s, 17.3 kB/s PASS 51c (13s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 18:42:37 (1776206557) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252354 s, 41.6 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (8s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 18:42:45 (1776206565) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2435 0x983 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2435 0x983 0 read lease(1) has applied. PASS 51e (9s) == sanityn test 54: rename locking ======================= 18:42:54 (1776206574) llite.lustre-ffff8dc2456b5000.xattr_cache=1 llite.lustre-ffff8dc246946800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504962 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 18:42:56.000000000 -0400 Modify: 2026-04-14 18:42:56.000000000 -0400 Change: 2026-04-14 18:42:56.000000000 -0400 Birth: 2026-04-14 18:42:55.000000000 -0400 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504965 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 18:43:02.000000000 -0400 Modify: 2026-04-14 18:43:03.000000000 -0400 Change: 2026-04-14 18:43:03.000000000 -0400 Birth: 2026-04-14 18:43:02.000000000 -0400 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 18:43:08.000000000 -0400 Modify: 2026-04-14 18:43:08.000000000 -0400 Change: 2026-04-14 18:43:08.000000000 -0400 Birth: 2026-04-14 18:43:08.000000000 -0400 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504967 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 18:43:08.000000000 -0400 Modify: 2026-04-14 18:43:09.000000000 -0400 Change: 2026-04-14 18:43:09.000000000 -0400 Birth: 2026-04-14 18:43:08.000000000 -0400 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504970 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 18:43:15.000000000 -0400 Modify: 2026-04-14 18:43:16.000000000 -0400 Change: 2026-04-14 18:43:16.000000000 -0400 Birth: 2026-04-14 18:43:14.000000000 -0400 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 18:43:15.000000000 -0400 Modify: 2026-04-14 18:43:16.000000000 -0400 Change: 2026-04-14 18:43:16.000000000 -0400 Birth: 2026-04-14 18:43:14.000000000 -0400 PASS 54 (32s) == sanityn test 55a: rename vs unlink target dir ========= 18:43:26 (1776206606) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (14s) == sanityn test 55b: rename vs unlink source dir ========= 18:43:40 (1776206620) fail_loc=0x80000156 mv: cannot stat '/mnt/lustre/d55b.sanityn/d1/d2': No such file or directory PASS 55b (13s) == sanityn test 55c: rename vs unlink orphan target dir == 18:43:53 (1776206633) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (19s) == sanityn test 55d: rename file vs link ================= 18:44:12 (1776206652) fail_loc=0x155 mv: '/mnt/lustre/d55d.sanityn/f1' and '/mnt/lustre/d55d.sanityn/d55d.sanityn/f1' are the same file PASS 55d (14s) == sanityn test 60: Verify data_version behaviour ======== 18:44:26 (1776206666) PASS 60 (7s) == sanityn test 70a: cd directory && rm directory ======== 18:44:33 (1776206673) PASS 70a (6s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 18:44:40 (1776206680) PASS 70b (8s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 18:44:47 (1776206687) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.00631388 s, 10.4 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (4s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 18:44:52 (1776206692) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0129657 s, 5.1 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (5s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 18:44:57 (1776206697) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (6s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 18:45:03 (1776206703) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0260501 s, 2.5 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (5s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 18:45:07 (1776206707) llite.lustre-ffff8dc2456b5000.xattr_cache=1 llite.lustre-ffff8dc246946800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (9s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 18:45:16 (1776206716) llite.lustre-ffff8dc2456b5000.xattr_cache=1 llite.lustre-ffff8dc246946800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (7s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 18:45:23 (1776206723) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0190725 s, 53.7 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0139349 s, 73.5 kB/s 252346: get lock2 252347: get lock1 252347: done 252347: get lock2 252346: done 252346: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 252346: cannot get lock1: Resource deadlock avoided 252347: done 252347: exit rc=0 252346: done 252346: exit rc=0 PASS 74 (11s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 18:45:34 (1776206734) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0363115 s, 57.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355259 s, 29.5 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3714: 252921 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (15s) == sanityn test 76: Verify MDT open_files listing ======== 18:45:49 (1776206749) opening files: ........ closing files: ........ PASS 76 (61s) == sanityn test 77a: check FIFO NRS policy =============== 18:46:50 (1776206810) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.19111 s, 87.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0454518 s, 23.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0484047 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.090213 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0742359 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129926 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0682217 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0564507 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.059263 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139808 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0602542 s, 17.4 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137357 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0743916 s, 14.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=4 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122073 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110823 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119836 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226755 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0824211 s, 12.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586425 s, 179 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0660551 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0606507 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0483886 s, 21.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0747407 s, 14.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0753477 s, 13.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0766669 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0739079 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0530301 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0539322 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0840378 s, 12.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0678509 s, 15.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104353 s, 10.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0867107 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11014 s, 9.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=2 removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77a.sanityn' PASS 77a (8s) == sanityn test 77b: check CRR-N NRS policy ============== 18:46:59 (1776206819) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.201073 s, 83.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0445815 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0540829 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0533528 s, 19.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.066765 s, 15.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0367086 s, 28.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216949 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0529909 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199943 s, 52.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0548026 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105891 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0454906 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179025 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0814005 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0972566 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150195 s, 7.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=5 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.160219 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036398 s, 28.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0764638 s, 13.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0767842 s, 13.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0887953 s, 11.8 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0420069 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0855733 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0459847 s, 22.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0808692 s, 13.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0594347 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0545331 s, 19.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0551531 s, 19.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0888843 s, 11.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0891616 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0618782 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0631364 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0693674 s, 15.1 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.292405 s, 57.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389055 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426097 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0568308 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0559711 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349929 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0886956 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107228 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.056381 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155398 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163885 s, 6.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110042 s, 9.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134536 s, 7.8 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0802285 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153495 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131526 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252435 s, 4.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0709955 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0531026 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0676721 s, 15.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0848874 s, 12.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0596068 s, 17.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0647954 s, 16.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0591916 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0776343 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0815116 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0690535 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0655558 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0697318 s, 15.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0957523 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115692 s, 9.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0933489 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0889948 s, 11.8 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (12s) == sanityn test 77c: check ORR NRS policy ================ 18:47:11 (1776206831) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.232441 s, 72.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379442 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0589293 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0765849 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.045367 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10253 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110377 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0819492 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0917755 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142909 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15283 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115024 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180886 s, 5.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=3 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158063 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.185947 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.29028 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.2895 s, 3.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176415 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118868 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108382 s, 96.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00239833 s, 437 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0469832 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00244923 s, 428 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00249879 s, 420 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00235745 s, 445 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00255518 s, 410 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117596 s, 89.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946633 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133991 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214488 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127469 s, 82.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218579 s, 4.8 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115145 s, 9.1 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.218862 s, 76.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311062 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0393891 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0486268 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039054 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.090613 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133617 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123189 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130869 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177256 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179493 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182786 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22316 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223443 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211387 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215098 s, 4.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.378058 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345866 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361109 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383829 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0830837 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268182 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282483 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334428 s, 31.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0721183 s, 14.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0442222 s, 23.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.044123 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0750599 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0729443 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0882898 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0841874 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101353 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272021 s, 38.5 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.223587 s, 75.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0526461 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0604423 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138543 s, 75.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153073 s, 68.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0875547 s, 12.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0405546 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221636 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.24004 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.257627 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.264615 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.270701 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.247892 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.334781 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.349107 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.350247 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.369443 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129713 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.209814 s, 5.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143373 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232088 s, 4.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138128 s, 7.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128087 s, 8.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116522 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153626 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128386 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12607 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133979 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130122 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139122 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180465 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192742 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201013 s, 5.2 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (18s) == sanityn test 77d: check TRR nrs policy ================ 18:47:29 (1776206849) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.256669 s, 65.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023574 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332497 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340299 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0713206 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031007 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11533 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0580037 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124169 s, 8.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124808 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0510697 s, 20.5 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15727 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206539 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13985 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178714 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170123 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.18425 s, 5.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0816375 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0624397 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243492 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0409906 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119925 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0661558 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.091677 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0761047 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102975 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0757469 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0792204 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0761247 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149416 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0941434 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0825186 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148078 s, 70.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=2 removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.317372 s, 52.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030743 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348551 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0590901 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0662382 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398812 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129543 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287089 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0780185 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0434686 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0381628 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157932 s, 6.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0868951 s, 12.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110809 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136943 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0999816 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159386 s, 6.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0403646 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0882267 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0678492 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290672 s, 36.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031151 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032871 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703822 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0447397 s, 23.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0518166 s, 20.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0694629 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117677 s, 89.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0649711 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089672 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0743294 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279056 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281702 s, 37.2 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.20591 s, 81.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225967 s, 46.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329837 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0540512 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0606511 s, 17.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0809441 s, 13.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0587371 s, 17.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.060039 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.05806 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0905219 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131675 s, 8.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0861787 s, 12.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.162795 s, 6.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102299 s, 10.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139122 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128084 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19498 s, 5.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342198 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0405792 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333977 s, 31.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201248 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0480596 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258607 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0518757 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297199 s, 35.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036997 s, 28.3 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0845985 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0423588 s, 24.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655137 s, 160 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0437394 s, 24.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622845 s, 168 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019349 s, 54.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064214 s, 163 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (14s) == sanityn test 77e: check TBF NID nrs policy ============ 18:47:43 (1776206863) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.203.5@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.320499 s, 52.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.037381 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233103 s, 45.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104859 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165731 s, 63.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0744494 s, 14.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.082711 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0668118 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105051 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0433607 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147758 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199646 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127194 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173169 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197076 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.240564 s, 4.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.23455 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0891239 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0995504 s, 10.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992721 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00455802 s, 230 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772575 s, 136 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251948 s, 41.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114348 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0923112 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143843 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128302 s, 81.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144468 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157457 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0940471 s, 11.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.084918 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.041069 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0473526 s, 22.1 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.378523 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0438947 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250361 s, 41.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0507742 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265775 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02557 s, 41.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0444967 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0911088 s, 11.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129844 s, 80.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0669565 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107741 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140203 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0736223 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159721 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146437 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123998 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151697 s, 6.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0429297 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00366373 s, 286 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102052 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0484086 s, 21.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0550521 s, 19.0 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110613 s, 94.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1448 s, 7.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123601 s, 84.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.071492 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0974204 s, 10.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.078359 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167557 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925855 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0824245 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126824 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226474 s, 46.3 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.546034 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343287 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083388 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0450722 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0913977 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0495663 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0610914 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0703943 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0660085 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113664 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214159 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.279736 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0984319 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233492 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102358 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.238611 s, 4.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.230305 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307965 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282471 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368827 s, 28.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341482 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0682448 s, 15.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.092308 s, 11.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018523 s, 56.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.053209 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0627207 s, 16.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0469839 s, 22.3 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0510596 s, 20.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203612 s, 51.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949299 s, 110 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233445 s, 44.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139873 s, 75.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157932 s, 66.4 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.229916 s, 73.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0522607 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0623259 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117133 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147967 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0968932 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157372 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169593 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170085 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180572 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22503 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233028 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17844 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.246608 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187984 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.279032 s, 3.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.319987 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230001 s, 45.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024496 s, 42.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285603 s, 36.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.089597 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346926 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.049541 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147209 s, 7.1 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158348 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0435433 s, 24.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0631399 s, 16.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112763 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118172 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104337 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0785221 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0811073 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196102 s, 5.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=3 removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' PASS 77e (27s) == sanityn test 77f: check TBF JobID nrs policy ========== 18:48:10 (1776206890) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.299323 s, 56.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039661 s, 26.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210268 s, 49.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0536704 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0553593 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144873 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0727943 s, 14.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0902445 s, 11.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0732473 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0799966 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186213 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108948 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112623 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143916 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223573 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.185781 s, 5.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221455 s, 4.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258149 s, 40.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605608 s, 173 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0408258 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179037 s, 58.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759436 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679377 s, 154 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.08896 s, 11.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00294059 s, 357 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00821154 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017849 s, 58.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884606 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0608401 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107096 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338138 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0796705 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402746 s, 26.0 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.258737 s, 64.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0365503 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0631819 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0870482 s, 12.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123191 s, 8.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.132361 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161443 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0515028 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.18556 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118736 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.208571 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.231869 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.244315 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.264372 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13061 s, 8.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=4 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.251943 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176798 s, 5.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135364 s, 7.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124583 s, 84.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306081 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178675 s, 58.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221822 s, 47.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158831 s, 66.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00403046 s, 260 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147041 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847057 s, 124 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107251 s, 9.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151819 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0883022 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156084 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179316 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133937 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0674611 s, 15.5 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.289535 s, 57.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245986 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355411 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542149 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195897 s, 53.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0903615 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0913911 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0465163 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0649711 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134149 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113055 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161657 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152847 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0530843 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275934 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177483 s, 5.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190584 s, 5.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291137 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.064048 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0483553 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0472684 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311986 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349077 s, 30.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0587298 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0442958 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0431582 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0438917 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0451132 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0529939 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0570445 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0519694 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0807065 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0745882 s, 14.1 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.226839 s, 74.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232516 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268826 s, 39.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.060893 s, 17.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0544947 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0436754 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.063144 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0521736 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.075214 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0504501 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12938 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134019 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112895 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.160496 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123468 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158644 s, 6.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221503 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0423246 s, 24.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108371 s, 96.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034728 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0390853 s, 26.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0911325 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0796274 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0697642 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180656 s, 5.8 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0661377 s, 15.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979253 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0527353 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.044481 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337321 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298036 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219146 s, 47.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0668564 s, 15.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' PASS 77f (22s) == sanityn test 77g: Change TBF type directly ============ 18:48:32 (1776206912) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (12s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 18:48:44 (1776206924) oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg305-client: oleg305-server: ssh exited with exit code 2 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg305-client: oleg305-server: ssh exited with exit code 12 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg305-client: oleg305-server: ssh exited with exit code 12 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg305-client: oleg305-server: ssh exited with exit code 12 PASS 77h (14s) == sanityn test 77i: Change rank of TBF rule ============= 18:48:58 (1776206938) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (25s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 18:49:23 (1776206963) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.396443 s, 42.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333566 s, 31.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306036 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154611 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0519977 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293507 s, 35.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0907265 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0715113 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0593485 s, 17.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0551132 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.084021 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338136 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0877521 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0814404 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0457628 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402005 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153023 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578416 s, 181 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846583 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0754912 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344142 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.085729 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0879732 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060226 s, 174 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0401396 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440718 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0428045 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374567 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306555 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228514 s, 45.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309441 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0655733 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131604 s, 79.7 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.55074 s, 11.0 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.6029 s, 5.3 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (66s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 18:50:29 (1776207029) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.827084 s, 20.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0644907 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167707 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138195 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101823 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338144 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146706 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137786 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.207552 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188017 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.195104 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204463 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.2342 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226687 s, 4.6 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.344001 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.363192 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.256837 s, 4.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318084 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283051 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265679 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583506 s, 180 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0036134 s, 290 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166313 s, 63.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166685 s, 62.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0849104 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0515357 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938599 s, 112 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0493953 s, 21.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117287 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152519 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280043 s, 37.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182845 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247136 s, 42.4 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 21.0506 s, 5.0 MB/s Write runtime is 22 s, speed is 4.545454 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9807 s, 5.2 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.834145 s, 20.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0506505 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0976406 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147817 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120214 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174271 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149514 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148326 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153381 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.256628 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.342216 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.33705 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.374118 s, 2.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.387219 s, 2.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.44077 s, 2.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.42749 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.474471 s, 2.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00237089 s, 442 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00243882 s, 430 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264425 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229289 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117219 s, 89.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00228798 s, 458 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179456 s, 58.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00238548 s, 440 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00240135 s, 437 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147301 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00227037 s, 462 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173075 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.205728 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.227253 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0626624 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187483 s, 5.6 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 20.7903 s, 5.0 MB/s Write runtime is 22 s, speed is 4.545454 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9803 s, 5.2 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (150s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 18:53:00 (1776207180) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.382438 s, 43.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303058 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282577 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0636743 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140302 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136672 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177162 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171013 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179504 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.208643 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198344 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193854 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.207688 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.234347 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211699 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.2782 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.28324 s, 3.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0514083 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263711 s, 39.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0600059 s, 17.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220643 s, 47.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0612339 s, 17.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199345 s, 52.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00376855 s, 278 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0671452 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0025732 s, 407 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00298093 s, 352 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113516 s, 9.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122713 s, 85.4 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233576 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0455367 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116905 s, 89.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263263 s, 39.8 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.47587 s, 11.1 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.92341 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.203.5@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.203.5@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.331421 s, 50.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0540536 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.058617 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0373159 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10601 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0580677 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314018 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116989 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12406 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0550316 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0949807 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.242269 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0941429 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239239 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119434 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156008 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.245603 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00248057 s, 423 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00233569 s, 449 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0737001 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185201 s, 56.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106735 s, 98.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00237403 s, 442 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0762326 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111078 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131186 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238116 s, 44.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318949 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129471 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115356 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.09893 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258486 s, 40.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116806 s, 89.8 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.4537 s, 10.0 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.994 s, 10.5 MB/s Read runtime is 12 s, speed is 8.333333 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.203.5@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.42438 s, 39.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0711104 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0741167 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0918676 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177874 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134862 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172285 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178873 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239988 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161159 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182663 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.291102 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199666 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.277441 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.315868 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.317935 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.34365 s, 3.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00250986 s, 418 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942325 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00246434 s, 425 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00257735 s, 407 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0815345 s, 12.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178702 s, 58.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110085 s, 95.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109885 s, 95.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0771023 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102766 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127381 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109695 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150145 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0947992 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0676965 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0435043 s, 24.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.68589 s, 12.1 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.51723 s, 19.0 MB/s Read runtime is 7 s, speed is 14.285714 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.4739 s, 35.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266113 s, 39.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145805 s, 71.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0475581 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134273 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0712569 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134337 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155012 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105374 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163816 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113876 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144374 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133027 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114362 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149592 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189133 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.247926 s, 4.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149822 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.279465 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199993 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22735 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084963 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139723 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223063 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120977 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129474 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125132 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111449 s, 9.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131725 s, 8.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0839276 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0739313 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0623489 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0719442 s, 14.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 11.2811 s, 9.3 MB/s Write runtime is 13 s, speed is 7.692307 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.91241 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.7831 s, 11.9 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.97722 s, 10.5 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.7698 s, 21.8 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0901519 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258637 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100797 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100307 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113213 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193572 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137263 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255429 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.269179 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157922 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170039 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191414 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.324115 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.27906 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311218 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320808 s, 3.3 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0796749 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683505 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352902 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112092 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.05216 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155951 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0582301 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119711 s, 87.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104432 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0679891 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0878795 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0846069 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368835 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122572 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020294 s, 51.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323534 s, 32.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 20.202 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.6392 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.35374 s, 47.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329619 s, 31.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0520313 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0664417 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312246 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144849 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166669 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180109 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196739 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155589 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.195041 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131868 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.20341 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154067 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156855 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163879 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191477 s, 5.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0649447 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00212903 s, 493 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00287682 s, 364 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905634 s, 116 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708008 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715444 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.078863 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0810883 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0082074 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0531176 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0656484 s, 16.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162958 s, 64.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.050263 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0437002 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012126 s, 86.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012692 s, 82.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.22589 s, 11.4 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.90449 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.419381 s, 40.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329992 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0841452 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0489167 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111115 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106323 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146059 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107235 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135223 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.208607 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197267 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.162013 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201869 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.242802 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190946 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.248529 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241148 s, 4.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875987 s, 120 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205701 s, 51.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376085 s, 27.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0590747 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0587095 s, 17.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139067 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0397223 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358107 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565662 s, 185 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705255 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684715 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843772 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00399627 s, 262 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700006 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100596 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00509676 s, 206 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.7462 s, 9.8 MB/s Write runtime is 12 s, speed is 8.333333 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.90977 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 11.1057 s, 9.4 MB/s Write runtime is 12 s, speed is 8.333333 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.9968 s, 10.5 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (438s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 19:00:17 (1776207617) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (10s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 19:00:28 (1776207628) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg305-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 3.24349 s, 323 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg305-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 40.0051 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (57s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 19:01:25 (1776207685) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.262898 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0435739 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.091976 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116535 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13254 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0468473 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128304 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0645993 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0534182 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0446122 s, 23.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8dc2456b5000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117579 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154452 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.205449 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211943 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176018 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.263119 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.28543 s, 3.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0832858 s, 12.6 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415331 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192801 s, 54.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0847038 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034967 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0877509 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229201 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266669 s, 39.3 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033877 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0555062 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101232 s, 10.4 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0642839 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805731 s, 130 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0660771 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0724961 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692213 s, 151 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8dc2456b5000.lock_unused_count=4 removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.89571 s, 11.8 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.12162 s, 20.5 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.346748 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10155 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0891576 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.079342 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.207944 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236451 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106036 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141189 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.289528 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166452 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.249982 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.281086 s, 3.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.310264 s, 3.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.249737 s, 4.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.238898 s, 4.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199891 s, 5.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206708 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107078 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711201 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107841 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186896 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0483577 s, 21.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0593577 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158298 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156577 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0731927 s, 14.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.160387 s, 6.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114227 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0790324 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.088322 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0924495 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0941329 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116855 s, 89.7 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg305-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.74236 s, 10.8 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.09673 s, 20.6 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (94s) == sanityn test 77o: Changing rank should not panic ====== 19:02:59 (1776207779) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (10s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 19:03:09 (1776207789) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_policies=fifo PASS 77q (112s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 19:05:01 (1776207901) mds.MDS.mdt.nrs_policies=tbf oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg305-client: oleg305-server: ssh exited with exit code 36 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (36s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 19:05:37 (1776207937) oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: Resource temporarily unavailable pdsh@oleg305-client: oleg305-server: ssh exited with exit code 11 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (9s) == sanityn test 79: xattr: intent error ================== 19:05:46 (1776207946) File: /mnt/lustre/d79.sanityn Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505430 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 19:05:48.000000000 -0400 Modify: 2026-04-14 19:05:48.000000000 -0400 Change: 2026-04-14 19:05:48.000000000 -0400 Birth: 2026-04-14 19:05:47.000000000 -0400 fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (19s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 19:06:05 (1776207965) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (4s) == sanityn test 80b: Accessing directory during migration ========================================================== 19:06:09 (1776207969) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (4s) == sanityn test 81a: rename and stat under striped directory ========================================================== 19:06:14 (1776207974) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (3s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 19:06:17 (1776207977) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (2s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 19:06:19 (1776207979) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (4s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 19:06:23 (1776207983) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7143 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7143 PASS 82 (7s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 19:06:30 (1776207990) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (3s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 19:06:34 (1776207994) fail_loc=0x8000060b PASS 84 (14s) == sanityn test 90: open/create and unlink striped directory ========================================================== 19:06:47 (1776208007) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (4s) == sanityn test 91: chmod and unlink striped directory === 19:06:51 (1776208011) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (4s) == sanityn test 92: create remote directory under orphan directory ========================================================== 19:06:55 (1776208015) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (4s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 19:06:59 (1776208019) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2644 0xa54 0 1 2629 0xa45 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2630 0xa46 0 0 2645 0xa55 0 rc1=0 and rc2=0 PASS 93 (17s) == sanityn test 94: signal vs CP callback race =========== 19:07:16 (1776208036) osc.lustre-OST0000-osc-ffff8dc2456b5000.idle_timeout=0 osc.lustre-OST0000-osc-ffff8dc246946800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8dc2456b5000.idle_timeout=0 osc.lustre-OST0001-osc-ffff8dc246946800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.336111 s, 24.4 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 3.0124 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5135: 282407 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.104223 s, 39.3 kB/s osc.lustre-OST0000-osc-ffff8dc2456b5000.idle_timeout=debug osc.lustre-OST0000-osc-ffff8dc246946800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8dc2456b5000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8dc246946800.idle_timeout=debug PASS 94 (16s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 19:07:32 (1776208052) llite.lustre-ffff8dc2456b5000.fast_read=0 llite.lustre-ffff8dc246946800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB, 12 KiB) copied, 0.0159051 s, 773 kB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8dc2456b5000.fast_read=1 llite.lustre-ffff8dc246946800.fast_read=1 PASS 95b (13s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 19:07:45 (1776208065) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (4s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 19:07:49 (1776208069) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0158703 s, 258 kB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (7s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 19:07:56 (1776208076) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.149896 s, 14.0 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (9s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 19:08:05 (1776208085) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0776182 s, 27.0 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (9s) == sanityn test 100e: DoM: read on open and file size ==== 19:08:14 (1776208094) 1+0 records in 1+0 records out 12000 bytes (12 kB, 12 KiB) copied, 0.0114038 s, 1.1 MB/s PASS 100e (8s) == sanityn test 101a: Discard DoM data on unlink ========= 19:08:22 (1776208102) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00444029 s, 922 kB/s PASS 101a (7s) == sanityn test 101b: Discard DoM data on rename ========= 19:08:29 (1776208109) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00994712 s, 412 kB/s PASS 101b (8s) == sanityn test 101c: Discard DoM data on close-unlink === 19:08:37 (1776208117) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0136081 s, 301 kB/s PASS 101c (9s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 19:08:48 (1776208128) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1776208130 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1776208133 Finishing test test23 at 1776208134 PASS 103 (13s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 19:09:00 (1776208140) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (4s) == sanityn test 105: Glimpse and lock cancel race ======== 19:09:04 (1776208144) fail_loc=0x416 PASS 105 (52s) == sanityn test 106a: Verify the btime via statx() ======= 19:09:56 (1776208196) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (4s) == sanityn test 106b: Glimpse RPCs test for statx ======== 19:10:00 (1776208200) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0148406 s, 69.0 kB/s File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 19:10:02.000000000 -0400 Modify: 2026-04-14 19:10:02.000000000 -0400 Change: 2026-04-14 19:10:02.000000000 -0400 Birth: 2026-04-14 19:10:01.000000000 -0400 /mnt/lustre/f106b.sanityn 144115205272505458 -rw-r--r-- 1 0 0 1776208201 1776208202 1776208202 File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 19:10:02.000000000 -0400 Modify: 2026-04-14 19:10:02.000000000 -0400 Change: 2026-04-14 19:10:02.000000000 -0400 Birth: 2026-04-14 19:10:01.000000000 -0400 1776208202 1024 1 PASS 106b (7s) == sanityn test 106c: Verify statx attributes mask ======= 19:10:07 (1776208207) PASS 106c (7s) == sanityn test 107a: Basic grouplock conflict =========== 19:10:15 (1776208215) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.154872 s, 67.7 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2636 0xa4c 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 First grouplock blocks second one PASS 107a (11s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 19:10:26 (1776208226) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.254446 s, 41.2 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2652 0xa5c 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7143 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (14s) == sanityn test 108a: lseek: parallel updates ============ 19:10:40 (1776208240) 1+0 records in 1+0 records out 10000 bytes (10 kB, 9.8 KiB) copied, 0.0300061 s, 333 kB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 5.17324 s, 1.6 MB/s PASS 108a (13s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 19:10:53 (1776208253) 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Iteration 19 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: Force libcfs to create 2 CPU partitions Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock oleg305-server@tcp:/lustre /mnt/lustre2 PASS 109 (1297s) == sanityn test 110: do not grant another lock on resend ========================================================== 19:32:30 (1776209550) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: /mnt/lustre/f110.sanityn Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 19:32:32.000000000 -0400 Modify: 2026-04-14 19:32:32.000000000 -0400 Change: 2026-04-14 19:32:32.000000000 -0400 Birth: 2026-04-14 19:32:31.000000000 -0400 fail_loc=0 fail_val=0 Connected clients: oleg305-client.virtnet oleg305-client.virtnet PASS 110 (41s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 19:33:11 (1776209591) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (3s) == sanityn test 112: update max-inherit in default LMV === 19:33:14 (1776209594) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (3s) == sanityn test 113: check servers of specified fs ======= 19:33:17 (1776209597) lustre-OST0000-osc-ffff8dc2500d1000 active. lustre-OST0001-osc-ffff8dc2500d1000 active. lustre-OST0000-osc-ffff8dc2500d1000 active. lustre-OST0001-osc-ffff8dc2500d1000 active. MGC192.168.203.105@tcp active. PASS 113 (6s) cleanup: ====================================================== == sanityn test complete, duration 9282 sec ============== 19:33:24 (1776209604) Stopping clients: oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 opts: