-----============= acceptance-small: sanityn ============----- Fri Oct 24 10:13:20 EDT 2025 oleg439-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Started clients oleg439-client.virtnet: 192.168.204.139@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) oleg439-client.virtnet: executing check_config_client /mnt/lustre oleg439-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg439-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9d3ac752c000.idle_timeout=debug osc.lustre-OST0000-osc-ffff9d3ae00bf000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9d3ac752c000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9d3ae00bf000.idle_timeout=debug disable quota as required oleg439-server: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288695 s, 36.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7119] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 10:13:57 (1761315237) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (5s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 10:14:02 (1761315242) -rw-r--r-- 1 root root 0 Oct 24 10:14 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (5s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 10:14:07 (1761315247) -rw-r--r-- 1 root root 0 Oct 24 10:14 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (5s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 10:14:12 (1761315252) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (5s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 10:14:17 (1761315257) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (5s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 10:14:22 (1761315262) total 1 -rwxrwxrwx 1 root root 0 Oct 24 10:14 f2a -rwxrwxrwx 1 root root 0 Oct 24 10:14 f2b total 1 -rwxrwxrwx 1 root root 0 Oct 24 10:14 f2a -rwxrwxrwx 1 root root 0 Oct 24 10:14 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.00704901 s, 72.6 kB/s PASS 2e (5s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 10:14:28 (1761315268) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (2s) == sanityn test 2g: check blocks update on sync write ==== 10:14:31 (1761315271) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.33539 s, 6.3 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (5s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 10:14:37 (1761315277) PASS 3 (5s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 10:14:42 (1761315282) PASS 4 (6s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 10:14:48 (1761315288) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (5s) == sanityn test 6: remove of open file on other node ============================================================================ 10:14:53 (1761315293) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (5s) == sanityn test 7: remove of open directory on other node ======================================================================= 10:14:58 (1761315298) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (5s) == sanityn test 8: remove of open special file on other node ==================================================================== 10:15:03 (1761315303) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (5s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 10:15:08 (1761315308) PASS 9a (5s) == sanityn test 9b: append to striped sparse file ======== 10:15:13 (1761315313) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0436359 s, 24.0 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.0521707 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (6s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 10:15:19 (1761315319) 1+0 records in 1+0 records out 1 byte copied, 0.00728076 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0144127 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0124618 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0148552 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0191972 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00491342 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00700756 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.004339 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00479781 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0100993 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00872923 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00892333 s, 0.1 kB/s PASS 10a (6s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 10:15:25 (1761315325) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0195921 s, 157 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.048223 s, 84.9 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0002101 s, 14.6 MB/s PASS 10b (6s) == sanityn test 11: execution of file opened for write should return error ============================================================== 10:15:31 (1761315331) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (6s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 10:15:38 (1761315338) warning: '-runtime' deprecated, use '-t runtime' instead - link 425 (time 1761315349.92 total 10.01 last 42.47) - link 847 (time 1761315359.94 total 20.03 last 42.12) - link 1236 (time 1761315369.96 total 30.04 last 38.83) - link 1633 (time 1761315379.96 total 40.05 last 39.69) - link 2012 (time 1761315389.98 total 50.06 last 37.84) - link 2373 (time 1761315400.02 total 60.10 last 35.97) - link 2691 (time 1761315410.04 total 70.12 last 31.72) - link 3024 (time 1761315420.04 total 80.13 last 33.29) - link 3341 (time 1761315430.08 total 90.17 last 31.57) total: 3664 link in 100.01 seconds: 36.64 ops/second using seed 3308988155 running for 100 seconds - stat 10000 (time 1761315349 ; total 8 ; last 8) - stat 20000 (time 1761315356 ; total 15 ; last 7) - stat 30000 (time 1761315364 ; total 23 ; last 8) - stat 40000 (time 1761315372 ; total 31 ; last 8) - stat 50000 (time 1761315380 ; total 39 ; last 8) - stat 60000 (time 1761315389 ; total 48 ; last 9) - stat 66316 (time 1761315400 ; total 59 ; last 11) - stat 70000 (time 1761315405 ; total 64 ; last 5) - stat 75474 (time 1761315416 ; total 75 ; last 11) - stat 80000 (time 1761315423 ; total 82 ; last 7) - stat 86234 (time 1761315434 ; total 93 ; last 11) - stat 90000 (time 1761315440 ; total 99 ; last 6) total: 90466 stats in 100 seconds: 904.659973 stats/second - unlinked 0 (time 1761315391 ; total 1 ; last 1) unlink(/mnt/lustre2/lockdir/lockfile3664) error: No such file or directory total: 3663 unlinks in 95 seconds: 38.557896 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (19689) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (19691) - No such process PASS 12 (152s) == sanityn test 13: test directory page revocation ======= 10:18:10 (1761315490) f13 f13 PASS 13 (8s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 10:18:18 (1761315498) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4298: 20863 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (6s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 10:18:24 (1761315504) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4298: 21437 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (6s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 10:18:30 (1761315510) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 22010 Terminated $DIR1/$tdir/sleep 60 PASS 14b (6s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 10:18:37 (1761315517) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 22588 Terminated $DIR1/$tdir/sleep 60 PASS 14c (7s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 10:18:43 (1761315523) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 23164 Terminated $DIR1/$tdir/sleep 60 PASS 14d (8s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 10:18:51 (1761315531) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7519232 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7519232kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (24s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 10:19:15 (1761315555) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.286547 s, 7.3 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.294042 s, 7.1 MB/s Chance of close/open is 1 in 50 Seed set to 5558 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x78a973 000005[0] 1761315559.472416 trunc from 00000000 to 0x78a972 (0x78a973 bytes) 000006[1] 1761315559.562873 read 0x2e6403 thru 0x2e8a5f (0x265d bytes) 000008[0] 1761315559.616108 mapread 0x25d507 thru 0x25e94b (0x1445 bytes) truncating to largest ever: 0x9ca150 000009[0] 1761315559.642172 trunc from 0x78a973 to 0x9ca14f (0x23f7dd bytes) 000011[0] 1761315559.691797 write 0x366912 thru 0x36eb6d (0x825c bytes) 000012[0] 1761315559.715773 read 0x49a00d thru 0x49db7b (0x3b6f bytes) 000013[0] 1761315559.754357 read 0x25bf02 thru 0x260950 (0x4a4f bytes) 000015[0] 1761315559.941348 trunc from 0x9ca150 to 0x8d40c5 (0xf608a bytes) 000018[1] 1761315560.064997 write 0x4bbead thru 0x4c5148 (0x929c bytes) 000019[1] 1761315560.113758 write 0x98e4a8 thru 0x99793b (0x9494 bytes) 000020[0] 1761315560.159774 write 0x281df3 thru 0x28620c (0x441a bytes) 000021[1] 1761315560.201762 read 0x48251b thru 0x48e240 (0xbd26 bytes) 000023[0] 1761315560.330419 write 0x653293 thru 0x6618da (0xe648 bytes) 000024[1] 1761315560.363338 mapread 0x615db9 thru 0x6213b1 (0xb5f9 bytes) 000028[0] 1761315560.572925 write 0x8d3f49 thru 0x8e2885 (0xe93d bytes) 000029[1] 1761315560.630369 mapread 0x21bed7 thru 0x224682 (0x87ac bytes) 000033[1] 1761315560.887864 read 0x8058d3 thru 0x80a021 (0x474f bytes) 000034[1] 1761315560.925736 read 0x385b9e thru 0x385c1e (0x81 bytes) 000036[1] 1761315561.026994 write 0x2e9438 thru 0x2f0271 (0x6e3a bytes) 000040[0] 1761315561.107336 write 0x2c01a4 thru 0x2c5b40 (0x599d bytes) 000042[1] 1761315561.244628 mapwrite 0x6ffb91 thru 0x70156e (0x19de bytes) 000045[1] 1761315561.602710 read 0x849fae thru 0x84a249 (0x29c bytes) 000046[1] 1761315561.635533 mapread 0x32e362 thru 0x32f5b3 (0x1252 bytes) 000048[1] 1761315561.651872 trunc from 0x99793c to 0x60a457 (0x38d4e4 bytes) 000049[0] 1761315561.711161 trunc from 0x60a458 to 0x5c09ed (0x49a6a bytes) 000050[0] 1761315561.809521 mapwrite 0x38a12a thru 0x398070 (0xdf47 bytes) 000052[0] 1761315562.011843 mapwrite 0x82f997 thru 0x83972e (0x9d98 bytes) 000054[1] 1761315562.160033 mapwrite 0x8e71b2 thru 0x8edbca (0x6a19 bytes) 000055[0] 1761315562.300323 read 0x4aec27 thru 0x4b630c (0x76e6 bytes) 000057[0] 1761315562.374153 mapwrite 0x5b4449 thru 0x5b9df4 (0x59ac bytes) 000058[0] 1761315562.576948 mapread 0x032992 thru 0x03be9c (0x950b bytes) 000059[0] 1761315562.635735 trunc from 0x8edbcb to 0x2fe3bd (0x5ef80d bytes) 000060[0] 1761315562.690657 read 0x2eea09 thru 0x2f8be7 (0xa1df bytes) 000061[1] 1761315562.727892 read 0x265335 thru 0x269a20 (0x46ec bytes) 000063[0] 1761315562.788509 write 0x33470d thru 0x33b8b9 (0x71ad bytes) 000064[0] 1761315562.789660 mapwrite 0x89d4c0 thru 0x8a849d (0xafde bytes) 000065[1] 1761315563.008389 trunc from 0x8a849e to 0x7edf19 (0xba584 bytes) 000067[0] 1761315563.164954 mapread 0x5dd698 thru 0x5e88ad (0xb216 bytes) 000068[1] 1761315563.392350 read 0x42e148 thru 0x43cd2e (0xebe7 bytes) 000069[1] 1761315563.525167 mapwrite 0x369c4e thru 0x371bd1 (0x7f84 bytes) 000070[1] 1761315563.743218 trunc from 0x7edf1a to 0x90bd57 (0x11de3e bytes) 000072[1] 1761315563.793843 read 0x880327 thru 0x880a58 (0x732 bytes) 000074[1] 1761315563.863710 mapread 0x4c7040 thru 0x4d4b2f (0xdaf0 bytes) 000076[0] 1761315563.864738 mapread 0x48590a thru 0x49308c (0xd783 bytes) 000077[1] 1761315564.077926 mapread 0x83d2df thru 0x843997 (0x66b9 bytes) 000078[0] 1761315564.131057 mapwrite 0x4d36bd thru 0x4e2500 (0xee44 bytes) 000079[1] 1761315564.340428 write 0x4db2a6 thru 0x4dd228 (0x1f83 bytes) 000083[1] 1761315564.438558 write 0x810b8c thru 0x81407e (0x34f3 bytes) 000084[1] 1761315564.500220 mapwrite 0x464b1f thru 0x46cacd (0x7faf bytes) 000086[1] 1761315564.676493 mapwrite 0x93f8f2 thru 0x945a8a (0x6199 bytes) 000088[1] 1761315564.795300 write 0x8186ed thru 0x82774b (0xf05f bytes) 000089[1] 1761315564.808948 trunc from 0x945a8b to 0x17544e (0x7d063c bytes) 000090[0] 1761315564.852507 mapread 0x10fe4f thru 0x11edb0 (0xef62 bytes) 000092[0] 1761315564.982627 trunc from 0x17544f to 0x873622 (0x6fe1d4 bytes) 000094[1] 1761315565.080199 mapwrite 0x229b8f thru 0x23877b (0xebed bytes) 000097[0] 1761315565.346366 mapread 0x2d7a52 thru 0x2d8629 (0xbd8 bytes) 000102[0] 1761315565.406676 write 0x60f517 thru 0x61f44a (0xff34 bytes) 000103[1] 1761315565.489322 mapread 0x5c3700 thru 0x5c3a8f (0x390 bytes) 000106[1] 1761315565.602357 mapwrite 0x35dee9 thru 0x35fcaf (0x1dc7 bytes) 000111[0] 1761315565.921715 mapwrite 0x01fcc2 thru 0x02d617 (0xd956 bytes) 000113[0] 1761315566.302361 read 0x672896 thru 0x679cce (0x7439 bytes) 000116[1] 1761315566.432848 trunc from 0x873623 to 0x007ccb (0x86b957 bytes) 000117[1] 1761315566.496917 mapwrite 0x1fe915 thru 0x209ec3 (0xb5af bytes) 000120[1] 1761315566.889853 read 0x02df80 thru 0x036512 (0x8593 bytes) 000122[0] 1761315567.010581 write 0x6707c5 thru 0x678867 (0x80a3 bytes) 000123[1] 1761315567.044015 write 0x159b7f thru 0x15a457 (0x8d9 bytes) 000126[0] 1761315567.108373 write 0x4b975a thru 0x4c2405 (0x8cac bytes) 000128[1] 1761315567.174367 write 0x278963 thru 0x27f4d7 (0x6b75 bytes) 000131[1] 1761315567.273322 write 0x9f0c00 thru 0x9fd516 (0xc917 bytes) 000135[1] 1761315567.350428 read 0x4144dc thru 0x4227b7 (0xe2dc bytes) 000136[0] 1761315567.411993 trunc from 0x9fd517 to 0x66b435 (0x3920e1 bytes) 000138[1] 1761315567.532667 mapread 0x4eb844 thru 0x4f355d (0x7d1a bytes) 000139[1] 1761315567.628072 write 0x3473e8 thru 0x348768 (0x1381 bytes) 000140[1] 1761315567.649951 mapwrite 0x4b7f79 thru 0x4bc81d (0x48a5 bytes) 000141[1] 1761315567.788601 read 0x4c91f0 thru 0x4cf697 (0x64a8 bytes) 000147[0] 1761315568.052013 write 0x08da8f thru 0x09727e (0x97f0 bytes) 000148[1] 1761315568.123775 write 0x6db59a thru 0x6decdc (0x3743 bytes) 000150[1] 1761315568.159842 mapwrite 0x62751a thru 0x636ea1 (0xf988 bytes) 000153[0] 1761315568.522301 mapwrite 0x7d776b thru 0x7e1b6c (0xa402 bytes) 000156[1] 1761315568.763971 write 0x9227fa thru 0x927359 (0x4b60 bytes) 000157[0] 1761315568.801645 mapwrite 0x1c093d thru 0x1c8246 (0x790a bytes) 000158[0] 1761315568.943166 mapread 0x3167e1 thru 0x316c90 (0x4b0 bytes) 000160[1] 1761315568.949313 mapwrite 0x0e8852 thru 0x0ea972 (0x2121 bytes) 000161[0] 1761315569.086779 write 0x7f67ef thru 0x7fc79e (0x5fb0 bytes) 000162[0] 1761315569.154894 write 0x588085 thru 0x597ac5 (0xfa41 bytes) 000164[1] 1761315569.250699 trunc from 0x92735a to 0x9bc137 (0x94dde bytes) 000165[1] 1761315569.309060 read 0x652960 thru 0x65de6f (0xb510 bytes) 000167[1] 1761315569.409372 write 0x8d6966 thru 0x8e4f98 (0xe633 bytes) 000168[0] 1761315569.435537 trunc from 0x9bc138 to 0x301e2b (0x6ba30c bytes) 000171[1] 1761315569.591828 trunc from 0x301e2c to 0x544c1e (0x242df3 bytes) 000173[1] 1761315569.669629 write 0x244474 thru 0x247f64 (0x3af1 bytes) 000174[0] 1761315569.681880 read 0x5134e9 thru 0x5196c7 (0x61df bytes) 000178[0] 1761315569.780571 mapwrite 0x30c45b thru 0x316f76 (0xab1c bytes) 000179[1] 1761315569.973839 trunc from 0x544c1f to 0x65c3b8 (0x11779a bytes) 000181[0] 1761315570.014397 mapread 0x017923 thru 0x01beca (0x45a8 bytes) 000182[1] 1761315570.082630 mapread 0x07e030 thru 0x080e7b (0x2e4c bytes) 000184[1] 1761315570.124420 mapread 0x28f4b9 thru 0x29c313 (0xce5b bytes) 000188[1] 1761315570.228910 write 0x0ca661 thru 0x0d9274 (0xec14 bytes) 000189[0] 1761315570.250870 read 0x114a27 thru 0x121dc3 (0xd39d bytes) 000191[1] 1761315570.317179 mapread 0x278bf4 thru 0x27c970 (0x3d7d bytes) 000193[1] 1761315570.342540 read 0x44dfb7 thru 0x45c581 (0xe5cb bytes) 000194[0] 1761315570.403657 read 0x4102a6 thru 0x41129e (0xff9 bytes) 000195[0] 1761315570.490457 read 0x200ec5 thru 0x20e630 (0xd76c bytes) 000196[1] 1761315570.551485 mapwrite 0x5a1168 thru 0x5a89d8 (0x7871 bytes) 000197[0] 1761315570.695776 read 0x1dad53 thru 0x1de0b2 (0x3360 bytes) 000198[0] 1761315570.780226 mapread 0x43bc46 thru 0x446c27 (0xafe2 bytes) 000199[1] 1761315570.780981 trunc from 0x65c3b9 to 0x8db3b4 (0x27effc bytes) 000207[0] 1761315570.970629 mapwrite 0x1a8599 thru 0x1b0278 (0x7ce0 bytes) 000213[1] 1761315571.171898 mapread 0x2c0aea thru 0x2ce1f3 (0xd70a bytes) 000216[1] 1761315571.358472 mapwrite 0x074c79 thru 0x075506 (0x88e bytes) 000217[1] 1761315571.454772 mapwrite 0x81d917 thru 0x82a19b (0xc885 bytes) 000218[1] 1761315571.651884 trunc from 0x8db3b5 to 0x325898 (0x5b5b1c bytes) 000222[1] 1761315571.810995 write 0x3d9b82 thru 0x3e91e4 (0xf663 bytes) 000224[1] 1761315571.836432 mapread 0x316776 thru 0x323754 (0xcfdf bytes) 000225[0] 1761315571.957482 read 0x00ab85 thru 0x011b06 (0x6f82 bytes) 000226[1] 1761315572.021348 trunc from 0x3e91e5 to 0x829348 (0x440164 bytes) 000228[0] 1761315572.132104 trunc from 0x829349 to 0x0bd4b7 (0x76be91 bytes) 000229[0] 1761315572.186946 trunc from 0x0bd4b8 to 0x909494 (0x84bfdd bytes) 000230[1] 1761315572.216604 mapwrite 0x51cdbf thru 0x520c5b (0x3e9d bytes) 000231[1] 1761315572.330609 mapread 0x6638c2 thru 0x666c44 (0x3383 bytes) 000232[0] 1761315572.407032 read 0x58196b thru 0x58eff0 (0xd686 bytes) 000234[1] 1761315572.538465 mapwrite 0x4bc9fe thru 0x4c8901 (0xbf04 bytes) 000237[1] 1761315572.701615 trunc from 0x909495 to 0x431ccb (0x4d77c9 bytes) 000238[1] 1761315572.752164 trunc from 0x431ccc to 0x7fef41 (0x3cd276 bytes) 000241[0] 1761315572.802097 mapread 0x57caaa thru 0x58697e (0x9ed5 bytes) 000242[1] 1761315572.892787 write 0x1ae562 thru 0x1ae9af (0x44e bytes) 000243[0] 1761315572.913929 mapread 0x5333a2 thru 0x541d56 (0xe9b5 bytes) 000246[0] 1761315573.020751 trunc from 0x7fef42 to 0x26a4a9 (0x594a98 bytes) 000247[0] 1761315573.080537 trunc from 0x26a4aa to 0x497454 (0x22cfab bytes) 000248[0] 1761315573.123952 mapread 0x10e18a thru 0x1119ee (0x3865 bytes) 000249[0] 1761315573.149626 write 0x698268 thru 0x6a35a0 (0xb339 bytes) 000253[0] 1761315573.262288 trunc from 0x6a35a1 to 0x3da156 (0x2c944a bytes) 000255[0] 1761315573.310722 trunc from 0x3da157 to 0x366878 (0x738de bytes) 000258[0] 1761315573.369079 read 0x3434d7 thru 0x3521ee (0xed18 bytes) 000259[0] 1761315573.409865 mapread 0x14913b thru 0x157238 (0xe0fe bytes) 000260[0] 1761315573.533139 trunc from 0x366879 to 0x95fa62 (0x5f91ea bytes) 000261[1] 1761315573.566449 mapread 0x332a7e thru 0x33f33e (0xc8c1 bytes) 000262[1] 1761315573.676467 write 0x0c8786 thru 0x0d51df (0xca5a bytes) 000265[0] 1761315573.770496 trunc from 0x95fa63 to 0x302394 (0x65d6ce bytes) 000266[0] 1761315573.843615 trunc from 0x302395 to 0x40a1b7 (0x107e23 bytes) 000267[1] 1761315573.864995 read 0x3c28c3 thru 0x3d2178 (0xf8b6 bytes) 000268[1] 1761315573.940195 write 0x46847c thru 0x471ee7 (0x9a6c bytes) 000269[1] 1761315573.952759 mapread 0x0e32d4 thru 0x0f021f (0xcf4c bytes) 000270[0] 1761315574.077849 mapread 0x2b24da thru 0x2b8379 (0x5ea0 bytes) 000271[0] 1761315574.185852 read 0x083f1d thru 0x08e122 (0xa206 bytes) truncating to largest ever: 0x9d565d 000272[1] 1761315574.273398 trunc from 0x471ee8 to 0x9d565c (0x563775 bytes) 000273[1] 1761315574.390280 trunc from 0x9d565d to 0x8f2dfa (0xe2862 bytes) 000275[1] 1761315574.436366 mapread 0x8b2e80 thru 0x8bef83 (0xc104 bytes) 000276[0] 1761315574.528877 mapwrite 0x49ef1b thru 0x4a8450 (0x9536 bytes) 000278[1] 1761315574.678562 mapread 0x650150 thru 0x652733 (0x25e4 bytes) 000280[1] 1761315574.753620 write 0x8d7edb thru 0x8d99da (0x1b00 bytes) 000281[1] 1761315574.774157 trunc from 0x8f2dfb to 0x4f62f3 (0x3fcb07 bytes) 000282[1] 1761315574.833676 mapread 0x26c537 thru 0x27905b (0xcb25 bytes) 000283[0] 1761315575.008448 trunc from 0x4f62f4 to 0x01ad31 (0x4db5c2 bytes) 000284[0] 1761315575.067968 read 0x0120b0 thru 0x015350 (0x32a1 bytes) 000286[1] 1761315575.112880 write 0x8412a9 thru 0x84db7a (0xc8d2 bytes) 000290[1] 1761315575.277028 mapwrite 0x51b9e8 thru 0x522166 (0x677f bytes) 000291[1] 1761315575.482528 trunc from 0x84db7b to 0x5e807b (0x265aff bytes) 000292[0] 1761315575.513361 mapwrite 0x31bf71 thru 0x31d133 (0x11c3 bytes) 000293[0] 1761315575.619740 write 0x723695 thru 0x7246b7 (0x1023 bytes) 000295[1] 1761315575.672855 read 0x0c894b thru 0x0d309c (0xa752 bytes) 000297[0] 1761315575.759432 write 0x512419 thru 0x515f82 (0x3b6a bytes) 000298[1] 1761315575.800621 read 0x63dfd8 thru 0x647de0 (0x9e09 bytes) 000301[0] 1761315575.981809 mapread 0x5d08a7 thru 0x5ddba0 (0xd2fa bytes) 000303[0] 1761315576.102581 mapwrite 0x689a42 thru 0x68ba1e (0x1fdd bytes) 000304[0] 1761315576.326554 trunc from 0x7246b8 to 0x3df022 (0x345695 bytes) 000305[1] 1761315576.400337 read 0x3695ec thru 0x377ff6 (0xea0b bytes) 000306[1] 1761315576.497981 write 0x562113 thru 0x570bb3 (0xeaa1 bytes) 000308[0] 1761315576.572907 write 0x50ce69 thru 0x5144f6 (0x768e bytes) 000309[0] 1761315576.632000 mapread 0x18661c thru 0x190f21 (0xa906 bytes) 000310[1] 1761315576.755630 mapwrite 0x495363 thru 0x49b445 (0x60e3 bytes) 000314[0] 1761315577.141911 trunc from 0x570bb4 to 0x423fbc (0x14cbf7 bytes) 000322[0] 1761315577.260409 mapwrite 0x44786a thru 0x452682 (0xae19 bytes) 000323[0] 1761315577.453710 mapwrite 0x2382b1 thru 0x23c404 (0x4154 bytes) 000325[1] 1761315577.620310 trunc from 0x452683 to 0x9d3382 (0x580d00 bytes) 000326[0] 1761315577.721751 mapread 0x6c5300 thru 0x6d0102 (0xae03 bytes) 000328[0] 1761315577.846691 mapwrite 0x82f968 thru 0x83047a (0xb13 bytes) 000330[1] 1761315578.015168 mapwrite 0x0af73b thru 0x0b53f8 (0x5cbe bytes) 000332[0] 1761315578.340196 write 0x8a024d thru 0x8a4667 (0x441b bytes) 000333[0] 1761315578.383228 read 0x6fd420 thru 0x6fd727 (0x308 bytes) 000336[0] 1761315578.440569 write 0x86aae4 thru 0x877ce0 (0xd1fd bytes) 000339[0] 1761315578.500184 read 0x3e8285 thru 0x3f7316 (0xf092 bytes) 000341[0] 1761315578.641859 read 0x71a4cb thru 0x722c44 (0x877a bytes) 000344[0] 1761315578.685675 mapwrite 0x00e070 thru 0x013e2f (0x5dc0 bytes) 000346[1] 1761315578.818192 read 0x53f6a8 thru 0x5403a0 (0xcf9 bytes) 000347[1] 1761315578.874183 trunc from 0x9d3383 to 0x73338e (0x29fff4 bytes) 000348[0] 1761315578.986284 trunc from 0x73338f to 0x9b14a4 (0x27e116 bytes) 000351[0] 1761315579.109023 trunc from 0x9b14a5 to 0x0d00a4 (0x8e1400 bytes) 000353[1] 1761315579.187673 read 0x008bc1 thru 0x0189a6 (0xfde6 bytes) 000355[1] 1761315579.238607 write 0x1c45a5 thru 0x1c6ab3 (0x250f bytes) 000357[1] 1761315579.270986 trunc from 0x1c6ab4 to 0x53fa48 (0x378f95 bytes) 000358[1] 1761315579.329100 trunc from 0x53fa49 to 0x959886 (0x419e3e bytes) 000361[1] 1761315579.416512 write 0x6d825c thru 0x6de1ac (0x5f51 bytes) 000364[1] 1761315579.573987 trunc from 0x959887 to 0x6c7fcf (0x2918b7 bytes) 000365[0] 1761315579.627297 trunc from 0x6c7fd0 to 0x492d66 (0x235269 bytes) 000370[0] 1761315579.793757 write 0x61b525 thru 0x621965 (0x6441 bytes) 000371[0] 1761315579.823822 mapwrite 0x9b851f thru 0x9bfdb7 (0x7899 bytes) 000372[1] 1761315579.963538 read 0x7b7391 thru 0x7c3f62 (0xcbd2 bytes) 000375[1] 1761315580.001241 trunc from 0x9bfdb8 to 0x321c02 (0x69e1b5 bytes) 000376[1] 1761315580.073956 write 0x75d84b thru 0x762559 (0x4d0f bytes) 000378[0] 1761315580.110474 write 0x84e431 thru 0x84e6a3 (0x273 bytes) 000380[0] 1761315580.154999 trunc from 0x84e6a4 to 0x3dca39 (0x471c6a bytes) 000383[0] 1761315580.198785 trunc from 0x3dca3a to 0x60097b (0x223f42 bytes) 000384[0] 1761315580.223807 mapwrite 0x50b1a2 thru 0x50e617 (0x3476 bytes) 000385[1] 1761315580.326019 read 0x46eba7 thru 0x47c408 (0xd862 bytes) 000386[0] 1761315580.373535 trunc from 0x60097c to 0x08feba (0x570ac1 bytes) 000387[1] 1761315580.430763 trunc from 0x08febb to 0x62160d (0x591753 bytes) 000388[1] 1761315580.506923 mapread 0x27f1a0 thru 0x283d64 (0x4bc5 bytes) 000390[0] 1761315580.619074 mapwrite 0x2be5d2 thru 0x2c81f3 (0x9c22 bytes) 000392[0] 1761315580.992964 mapread 0x483b4e thru 0x48505d (0x1510 bytes) 000395[1] 1761315581.162061 trunc from 0x62160e to 0x44798d (0x1d9c80 bytes) 000396[0] 1761315581.219772 trunc from 0x44798e to 0x94f333 (0x5079a6 bytes) 000400[0] 1761315581.303497 mapread 0x47d057 thru 0x48c2e2 (0xf28c bytes) 000401[0] 1761315581.500893 mapwrite 0x73fa52 thru 0x74dbef (0xe19e bytes) 000403[0] 1761315581.726812 trunc from 0x94f334 to 0x2eed85 (0x6605ae bytes) 000405[0] 1761315581.782078 read 0x24c8f8 thru 0x24d23a (0x943 bytes) 000406[1] 1761315581.851293 write 0x27e851 thru 0x27fa6f (0x121f bytes) 000407[1] 1761315581.895369 write 0x2fe770 thru 0x30d7ee (0xf07f bytes) 000408[1] 1761315581.949563 trunc from 0x30d7ef to 0x982e61 (0x675673 bytes) 000409[1] 1761315581.999952 mapread 0x0b8a02 thru 0x0c3ff7 (0xb5f6 bytes) 000412[1] 1761315582.217384 trunc from 0x982e62 to 0x280ce0 (0x702181 bytes) 000414[0] 1761315582.282422 read 0x1b6b28 thru 0x1be60e (0x7ae7 bytes) 000415[0] 1761315582.311107 mapread 0x09726d thru 0x0a41aa (0xcf3e bytes) 000416[1] 1761315582.475058 trunc from 0x280ce1 to 0x0373c4 (0x24991c bytes) 000417[1] 1761315582.572717 read 0x024f43 thru 0x02df98 (0x9056 bytes) 000419[0] 1761315582.674010 write 0x2c489f thru 0x2ca7c3 (0x5f25 bytes) 000420[0] 1761315582.726106 mapwrite 0x03385d thru 0x03c627 (0x8dcb bytes) 000422[1] 1761315583.064311 mapwrite 0x55aa8d thru 0x56589f (0xae13 bytes) 000424[1] 1761315583.410039 trunc from 0x5658a0 to 0x96e384 (0x408ae5 bytes) 000425[0] 1761315583.444300 mapwrite 0x500c82 thru 0x50e76d (0xdaec bytes) 000426[0] 1761315583.774092 mapwrite 0x0e1319 thru 0x0f0fb6 (0xfc9e bytes) 000427[1] 1761315584.278354 mapwrite 0x6b573c thru 0x6bcb41 (0x7406 bytes) 000428[1] 1761315584.573895 write 0x6b2b31 thru 0x6b5890 (0x2d60 bytes) 000429[0] 1761315584.648673 trunc from 0x96e385 to 0x57f694 (0x3eecf0 bytes) 000430[1] 1761315584.781330 mapwrite 0x9f2ca6 thru 0x9fe4b8 (0xb813 bytes) 000433[1] 1761315585.032889 mapread 0x783dcb thru 0x78a9b0 (0x6be6 bytes) 000434[0] 1761315585.136062 read 0x0bcbec thru 0x0c7f8c (0xb3a1 bytes) 000436[1] 1761315585.180048 mapwrite 0x37908b thru 0x379de1 (0xd57 bytes) 000440[0] 1761315585.298375 mapread 0x1813b9 thru 0x18bce3 (0xa92b bytes) 000442[1] 1761315585.474952 mapread 0x3c956f thru 0x3d0bb1 (0x7643 bytes) 000443[1] 1761315585.634516 mapread 0x9551b0 thru 0x955bc4 (0xa15 bytes) 000445[1] 1761315585.644297 mapread 0x6d25e8 thru 0x6e1fe8 (0xfa01 bytes) 000447[1] 1761315585.832581 mapread 0x6ffbbf thru 0x70bb8a (0xbfcc bytes) 000448[1] 1761315585.948539 write 0x4b7038 thru 0x4c5ea5 (0xee6e bytes) 000451[1] 1761315586.029880 trunc from 0x9fe4b9 to 0x04decb (0x9b05ed bytes) 000453[1] 1761315586.131112 mapread 0x00a4e2 thru 0x0103b8 (0x5ed7 bytes) 000454[0] 1761315586.203882 trunc from 0x04decc to 0x9d1cdd (0x983e12 bytes) 000455[1] 1761315586.297190 mapread 0x5ceb57 thru 0x5d6b4b (0x7ff5 bytes) 000456[0] 1761315586.380835 write 0x1020ee thru 0x102944 (0x857 bytes) 000457[0] 1761315586.426439 write 0x1af1ee thru 0x1b13cc (0x21df bytes) 000458[0] 1761315586.455323 mapwrite 0x165963 thru 0x16818f (0x282d bytes) 000459[0] 1761315586.540867 read 0x659d1c thru 0x664bca (0xaeaf bytes) 000460[1] 1761315586.605627 mapwrite 0x8fe481 thru 0x8fe82d (0x3ad bytes) 000461[1] 1761315586.692565 write 0x91f692 thru 0x92b7e1 (0xc150 bytes) 000465[1] 1761315586.772022 mapwrite 0x5dbbc2 thru 0x5eafea (0xf429 bytes) 000466[1] 1761315587.154874 read 0x08e38a thru 0x09a4ea (0xc161 bytes) 000467[0] 1761315587.411607 read 0x4abe0f thru 0x4b5f75 (0xa167 bytes) 000468[1] 1761315587.502889 mapread 0x3a7266 thru 0x3ab1d7 (0x3f72 bytes) 000469[0] 1761315587.531166 write 0x3e0961 thru 0x3eede3 (0xe483 bytes) 000472[1] 1761315587.675836 mapwrite 0x7ca827 thru 0x7cfffe (0x57d8 bytes) 000475[0] 1761315587.925684 mapread 0x3475c6 thru 0x34e959 (0x7394 bytes) 000476[0] 1761315588.013130 write 0x6cdc43 thru 0x6cf660 (0x1a1e bytes) 000477[1] 1761315588.058692 read 0x47d8e9 thru 0x47f726 (0x1e3e bytes) 000479[0] 1761315588.191465 trunc from 0x9d1cde to 0x659501 (0x3787dc bytes) 000480[1] 1761315588.295291 mapwrite 0x085f58 thru 0x08d084 (0x712d bytes) 000482[1] 1761315588.448851 mapwrite 0x9ed776 thru 0x9fcaeb (0xf376 bytes) 000485[0] 1761315588.592302 mapread 0x30ec99 thru 0x317685 (0x89ed bytes) 000486[1] 1761315588.736995 trunc from 0x9fcaec to 0x446c5a (0x5b5e91 bytes) 000487[1] 1761315588.828767 read 0x2105e8 thru 0x218fbf (0x89d8 bytes) 000488[0] 1761315588.883139 trunc from 0x446c5b to 0x4a53c7 (0x5e76d bytes) 000489[0] 1761315589.014142 mapread 0x10f538 thru 0x11e9d6 (0xf49f bytes) 000490[0] 1761315589.167415 mapwrite 0x7d5e87 thru 0x7ded90 (0x8f0a bytes) 000491[1] 1761315589.359715 trunc from 0x7ded91 to 0x85de2a (0x7f09a bytes) 000492[0] 1761315589.433032 mapread 0x1274ce thru 0x1336ea (0xc21d bytes) 000493[1] 1761315589.631558 mapread 0x7fc2fc thru 0x8016c4 (0x53c9 bytes) 000494[1] 1761315589.799452 read 0x324ce9 thru 0x32f5b6 (0xa8ce bytes) 000495[0] 1761315589.856043 mapread 0x074fb4 thru 0x0766d7 (0x1724 bytes) 000497[1] 1761315589.964112 write 0x66d7cc thru 0x6725d1 (0x4e06 bytes) 000498[0] 1761315590.022595 mapwrite 0x7f068f thru 0x7f8374 (0x7ce6 bytes) 000499[0] 1761315590.178890 write 0x8c58e3 thru 0x8ce455 (0x8b73 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 5590 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003[1] 1761315591.084733 write 0x9f3000 thru 0x9f9dfc (0x6dfd bytes) 000005[0] 1761315591.143795 mapread 0x318000 thru 0x327503 (0xf504 bytes) 000006[0] 1761315591.234717 read_OD 0x5c6000 thru 0x5c6fff (0x1000 bytes) 000007[1] 1761315591.260223 write 0x539000 thru 0x542acb (0x9acc bytes) 000008[1] 1761315591.290467 mapwrite 0x5e1000 thru 0x5e1ed2 (0xed3 bytes) truncating to largest ever: 0x30f7a4 000009[1] 1761315591.466215 trunc from 0x9f9dfd to 0x30f7a3 (0x6ea659 bytes) 000012[0] 1761315591.533479 read_OD 0x292000 thru 0x298fff (0x7000 bytes) 000015[1] 1761315591.581540 read 0x26a000 thru 0x27916e (0xf16f bytes) 000016[1] 1761315591.590314 write 0x534000 thru 0x53aee1 (0x6ee2 bytes) 000017[0] 1761315591.606594 write_OD 0x600000 thru 0x60dfff (0xe000 bytes) 000019[1] 1761315591.744058 mapread 0x2b5000 thru 0x2bf410 (0xa411 bytes) 000021[1] 1761315591.781028 read 0x3ed000 thru 0x3f5389 (0x838a bytes) 000023[0] 1761315591.816121 mapread 0x5a8000 thru 0x5aff5a (0x7f5b bytes) 000024[1] 1761315591.855423 mapread 0x151000 thru 0x15bc86 (0xac87 bytes) truncating to largest ever: 0x4a2bfe 000025[0] 1761315591.910597 trunc from 0x60e000 to 0x4a2bfd (0x16b402 bytes) truncating to largest ever: 0x61a189 000028[1] 1761315592.000215 trunc from 0x4a2bfe to 0x61a188 (0x17758b bytes) 000029[0] 1761315592.068237 mapread 0x0d7000 thru 0x0df51d (0x851e bytes) 000031[0] 1761315592.179420 read_OD 0x229000 thru 0x236fff (0xe000 bytes) 000032[1] 1761315592.189808 mapwrite 0x2d3000 thru 0x2dcf4b (0x9f4c bytes) 000033[1] 1761315592.399220 read 0x099000 thru 0x0a23de (0x93df bytes) 000034[1] 1761315592.537001 read 0x18a000 thru 0x1929c6 (0x89c7 bytes) 000035[0] 1761315592.574186 trunc from 0x61a189 to 0x045da8 (0x5d43e0 bytes) 000037[1] 1761315592.652164 mapread 0x003000 thru 0x00404a (0x104b bytes) 000038[1] 1761315592.699597 write 0x40c000 thru 0x41a108 (0xe109 bytes) 000039[0] 1761315592.756761 mapwrite 0x795000 thru 0x79e9fc (0x99fd bytes) 000041[1] 1761315593.236294 mapwrite 0x7f2000 thru 0x7fc1e9 (0xa1ea bytes) 000042[0] 1761315593.526532 mapread 0x385000 thru 0x38e317 (0x9318 bytes) truncating to largest ever: 0x642fa4 000044[0] 1761315593.589653 trunc from 0x7fc1ea to 0x642fa3 (0x1b9246 bytes) 000046[1] 1761315593.732608 mapread 0x159000 thru 0x168c27 (0xfc28 bytes) 000047[1] 1761315593.933438 mapwrite 0x5dd000 thru 0x5e25f8 (0x55f9 bytes) 000048[1] 1761315594.056571 write 0x516000 thru 0x518e3c (0x2e3d bytes) 000049[0] 1761315594.064222 mapread 0x4fe000 thru 0x50d351 (0xf352 bytes) 000050[0] 1761315594.245904 mapread 0x569000 thru 0x574f13 (0xbf14 bytes) 000051[0] 1761315594.357514 mapwrite 0x308000 thru 0x3089ec (0x9ed bytes) 000052[1] 1761315594.467407 read 0x3f5000 thru 0x3fe756 (0x9757 bytes) 000053[1] 1761315594.560204 mapwrite 0x107000 thru 0x115ccf (0xecd0 bytes) 000054[0] 1761315594.730447 read_OD 0x248000 thru 0x24afff (0x3000 bytes) 000059[1] 1761315594.766388 write 0x3f8000 thru 0x3fc6de (0x46df bytes) 000060[1] 1761315594.793224 trunc from 0x642fa4 to 0x1880da (0x4baec9 bytes) 000063[0] 1761315594.899015 write_OD 0x601000 thru 0x601fff (0x1000 bytes) 000065[0] 1761315594.973077 mapwrite 0x9fe000 thru 0x9ffa15 (0x1a16 bytes) 000066[1] 1761315595.342986 write 0x285000 thru 0x28b9aa (0x69ab bytes) 000067[0] 1761315595.455016 mapread 0x6bc000 thru 0x6c7fb6 (0xbfb7 bytes) 000068[0] 1761315595.595506 mapwrite 0x586000 thru 0x58f91b (0x991c bytes) 000069[1] 1761315595.750907 read 0x214000 thru 0x21b291 (0x7292 bytes) 000071[0] 1761315595.900190 write_OD 0x587000 thru 0x58cfff (0x6000 bytes) 000073[1] 1761315596.048619 mapread 0x8cb000 thru 0x8ce980 (0x3981 bytes) 000074[1] 1761315596.086550 mapwrite 0x93b000 thru 0x947963 (0xc964 bytes) 000076[1] 1761315596.249713 read 0x6c9000 thru 0x6d3e61 (0xae62 bytes) 000080[1] 1761315596.387129 write 0x140000 thru 0x14366b (0x366c bytes) 000081[1] 1761315596.409851 read 0x434000 thru 0x43cbbe (0x8bbf bytes) 000082[0] 1761315596.480459 read_OD 0x5a5000 thru 0x5aafff (0x6000 bytes) 000083[1] 1761315596.541149 read 0x9c8000 thru 0x9cf549 (0x754a bytes) 000084[1] 1761315596.567954 mapread 0x943000 thru 0x949692 (0x6693 bytes) 000087[0] 1761315596.630756 mapread 0x708000 thru 0x70b591 (0x3592 bytes) 000088[0] 1761315596.698012 read_OD 0x126000 thru 0x12cfff (0x7000 bytes) 000089[0] 1761315596.706501 trunc from 0x9ffa16 to 0x1361f8 (0x8c981d bytes) 000091[1] 1761315596.761660 read 0x0cd000 thru 0x0d88db (0xb8dc bytes) 000093[0] 1761315596.814959 mapwrite 0x693000 thru 0x6a0e0f (0xde10 bytes) 000094[1] 1761315597.040910 write 0x4f8000 thru 0x503b29 (0xbb2a bytes) 000095[0] 1761315597.170532 mapwrite 0x830000 thru 0x837de3 (0x7de4 bytes) 000096[1] 1761315597.391438 read 0x05a000 thru 0x05f7f9 (0x57fa bytes) 000097[0] 1761315597.586907 write_OD 0x202000 thru 0x205fff (0x4000 bytes) 000099[1] 1761315597.689120 mapread 0x53b000 thru 0x5491e5 (0xe1e6 bytes) 000100[0] 1761315597.756659 write_OD 0x4cf000 thru 0x4d2fff (0x4000 bytes) 000101[0] 1761315597.805211 mapread 0x3c4000 thru 0x3cfacf (0xbad0 bytes) 000102[0] 1761315597.861018 read_OD 0x488000 thru 0x48ffff (0x8000 bytes) 000103[0] 1761315597.872240 mapwrite 0x338000 thru 0x3479b6 (0xf9b7 bytes) 000104[0] 1761315598.317667 trunc from 0x837de4 to 0x2a37b8 (0x59462b bytes) 000105[0] 1761315598.377985 read_OD 0x1b4000 thru 0x1c2fff (0xf000 bytes) 000106[1] 1761315598.422437 trunc from 0x2a37b9 to 0x3d1afb (0x12e343 bytes) 000107[0] 1761315598.486225 write_OD 0x5da000 thru 0x5e1fff (0x8000 bytes) 000108[0] 1761315598.547748 mapwrite 0x654000 thru 0x661b77 (0xdb78 bytes) 000110[1] 1761315598.699195 trunc from 0x661b78 to 0x1b032b (0x4b184c bytes) 000112[1] 1761315598.787759 mapread 0x057000 thru 0x05dfb0 (0x6fb1 bytes) 000113[1] 1761315598.875070 mapread 0x19d000 thru 0x1a21dc (0x51dd bytes) 000118[1] 1761315599.035752 mapread 0x07f000 thru 0x08a027 (0xb028 bytes) 000119[0] 1761315599.123469 write_OD 0x7a2000 thru 0x7a6fff (0x5000 bytes) 000120[0] 1761315599.232944 write_OD 0x253000 thru 0x259fff (0x7000 bytes) 000122[0] 1761315599.369680 mapread 0x2f8000 thru 0x2f82bf (0x2c0 bytes) 000123[1] 1761315599.422950 read 0x61e000 thru 0x61f3ce (0x13cf bytes) 000124[0] 1761315599.461382 mapread 0x60e000 thru 0x610302 (0x2303 bytes) 000127[1] 1761315599.489520 mapwrite 0x511000 thru 0x512b4a (0x1b4b bytes) 000129[1] 1761315599.640026 write 0x8b4000 thru 0x8b6fa6 (0x2fa7 bytes) 000133[0] 1761315599.687641 read_OD 0x4cf000 thru 0x4dafff (0xc000 bytes) 000134[0] 1761315599.720734 mapread 0x19a000 thru 0x19f06b (0x506c bytes) 000138[0] 1761315599.827662 mapread 0x52e000 thru 0x536d13 (0x8d14 bytes) truncating to largest ever: 0x72420f 000139[0] 1761315599.828350 trunc from 0x8b6fa7 to 0x72420e (0x192d98 bytes) 000140[0] 1761315599.910142 write_OD 0x06c000 thru 0x079fff (0xe000 bytes) 000142[1] 1761315600.011381 trunc from 0x72420f to 0x3114fc (0x412d12 bytes) 000144[1] 1761315600.078362 mapwrite 0x77c000 thru 0x788a39 (0xca3a bytes) 000145[0] 1761315600.283534 mapread 0x22e000 thru 0x23298b (0x498c bytes) 000150[1] 1761315600.386381 read 0x494000 thru 0x4986ff (0x4700 bytes) 000152[0] 1761315600.445770 trunc from 0x788a3a to 0x2a5a57 (0x4e2fe2 bytes) 000153[0] 1761315600.518632 write_OD 0x9ae000 thru 0x9affff (0x2000 bytes) 000155[1] 1761315600.602673 write 0x069000 thru 0x0772a1 (0xe2a2 bytes) 000156[1] 1761315600.668183 write 0x5a8000 thru 0x5b0e94 (0x8e95 bytes) 000160[0] 1761315600.708993 trunc from 0x9b0000 to 0x16de8f (0x842170 bytes) 000162[0] 1761315600.806778 write_OD 0x40a000 thru 0x40efff (0x5000 bytes) 000164[1] 1761315600.873043 mapread 0x1c5000 thru 0x1d4997 (0xf998 bytes) 000165[0] 1761315600.981349 mapwrite 0x605000 thru 0x60c269 (0x726a bytes) 000166[1] 1761315601.187941 mapread 0x042000 thru 0x042a95 (0xa96 bytes) 000169[1] 1761315601.241221 mapread 0x249000 thru 0x24be17 (0x2e18 bytes) 000182[0] 1761315601.338905 mapwrite 0x735000 thru 0x73d1e6 (0x81e7 bytes) 000184[0] 1761315601.490190 mapread 0x34a000 thru 0x34c521 (0x2522 bytes) 000187[1] 1761315601.570380 read 0x1a2000 thru 0x1a666f (0x4670 bytes) 000188[1] 1761315601.680366 mapread 0x56c000 thru 0x571316 (0x5317 bytes) truncating to largest ever: 0x8dbde7 000189[0] 1761315601.681482 trunc from 0x73d1e7 to 0x8dbde6 (0x19ec00 bytes) 000191[0] 1761315601.747847 mapwrite 0x5de000 thru 0x5e73fb (0x93fc bytes) 000192[1] 1761315601.816536 mapread 0x79b000 thru 0x7a9c39 (0xec3a bytes) 000195[0] 1761315601.944760 mapread 0x041000 thru 0x047eaf (0x6eb0 bytes) 000196[1] 1761315601.967222 mapread 0x2a7000 thru 0x2b487f (0xd880 bytes) 000197[1] 1761315602.066899 read 0x464000 thru 0x464fad (0xfae bytes) 000203[0] 1761315602.164602 trunc from 0x8dbde7 to 0x5bd15e (0x31ec88 bytes) 000207[0] 1761315602.282745 trunc from 0x5bd15f to 0x877ac8 (0x2ba96a bytes) 000209[0] 1761315602.330676 write_OD 0x123000 thru 0x130fff (0xe000 bytes) 000215[0] 1761315602.383554 read_OD 0x40d000 thru 0x412fff (0x6000 bytes) 000216[0] 1761315602.391752 mapwrite 0x7c2000 thru 0x7c504f (0x3050 bytes) 000217[1] 1761315602.469862 trunc from 0x877ac9 to 0x285b0a (0x5f1fbe bytes) 000219[1] 1761315602.552892 read 0x1f6000 thru 0x1ffe86 (0x9e87 bytes) 000220[1] 1761315602.592753 write 0x4c6000 thru 0x4cf3f7 (0x93f8 bytes) 000222[1] 1761315602.624706 mapread 0x2e2000 thru 0x2e3418 (0x1419 bytes) 000223[0] 1761315602.692859 write_OD 0x08a000 thru 0x098fff (0xf000 bytes) 000224[1] 1761315602.816501 mapwrite 0x2bb000 thru 0x2c8b88 (0xdb89 bytes) 000230[0] 1761315603.105720 mapread 0x2f6000 thru 0x2fdb9e (0x7b9f bytes) 000233[0] 1761315603.157485 mapread 0x09d000 thru 0x0a0654 (0x3655 bytes) 000235[1] 1761315603.193002 mapread 0x0fd000 thru 0x1080d0 (0xb0d1 bytes) 000237[1] 1761315603.264862 write 0x56e000 thru 0x573f66 (0x5f67 bytes) 000238[0] 1761315603.288404 read_OD 0x414000 thru 0x421fff (0xe000 bytes) 000239[1] 1761315603.342887 mapread 0x4f6000 thru 0x4f6d37 (0xd38 bytes) 000241[0] 1761315603.366576 read_OD 0x1b8000 thru 0x1c2fff (0xb000 bytes) 000243[1] 1761315603.386900 mapwrite 0x3d7000 thru 0x3e4828 (0xd829 bytes) 000244[0] 1761315603.603422 mapread 0x344000 thru 0x3461e2 (0x21e3 bytes) 000249[1] 1761315603.733785 read 0x2e1000 thru 0x2e82c6 (0x72c7 bytes) 000250[1] 1761315603.787043 write 0x0be000 thru 0x0c36f2 (0x56f3 bytes) 000251[1] 1761315603.850089 mapread 0x0c3000 thru 0x0cebdf (0xbbe0 bytes) 000252[0] 1761315603.906825 write_OD 0x2fd000 thru 0x308fff (0xc000 bytes) 000253[0] 1761315603.990052 write_OD 0x936000 thru 0x944fff (0xf000 bytes) 000254[0] 1761315604.078605 trunc from 0x945000 to 0x43c4fe (0x508b01 bytes) 000260[0] 1761315604.143069 mapwrite 0x5b8000 thru 0x5c3c37 (0xbc38 bytes) 000263[1] 1761315604.297167 mapread 0x299000 thru 0x29a3b5 (0x13b6 bytes) 000264[1] 1761315604.357346 mapread 0x26f000 thru 0x27d710 (0xe711 bytes) 000265[0] 1761315604.478540 write_OD 0x987000 thru 0x995fff (0xf000 bytes) 000268[1] 1761315604.586008 mapwrite 0x31a000 thru 0x31bb3c (0x1b3d bytes) 000273[1] 1761315604.746761 write 0x9de000 thru 0x9e3bdc (0x5bdd bytes) 000275[1] 1761315604.770568 write 0x6dc000 thru 0x6dc214 (0x215 bytes) 000276[0] 1761315604.793102 mapwrite 0x0dc000 thru 0x0dfc6c (0x3c6d bytes) 000277[1] 1761315604.927967 write 0x514000 thru 0x51736c (0x336d bytes) 000281[1] 1761315604.993979 trunc from 0x9e3bdd to 0x573b9b (0x470041 bytes) 000284[1] 1761315605.019583 trunc from 0x573b9c to 0x578add (0x4f42 bytes) 000285[0] 1761315605.038391 mapread 0x272000 thru 0x27bc7c (0x9c7d bytes) 000287[0] 1761315605.166929 read_OD 0x057000 thru 0x057fff (0x1000 bytes) 000293[0] 1761315605.181916 trunc from 0x578ade to 0x4aeea6 (0xc9c37 bytes) 000294[0] 1761315605.235374 write_OD 0x5a5000 thru 0x5abfff (0x7000 bytes) 000295[0] 1761315605.304476 read_OD 0x159000 thru 0x15efff (0x6000 bytes) 000298[1] 1761315605.315142 read 0x223000 thru 0x2301f8 (0xd1f9 bytes) 000301[1] 1761315605.367359 mapwrite 0x5ae000 thru 0x5b0feb (0x2fec bytes) 000303[1] 1761315605.539685 mapwrite 0x7d6000 thru 0x7d651e (0x51f bytes) 000304[1] 1761315605.636041 mapwrite 0x45d000 thru 0x45d3bc (0x3bd bytes) 000305[1] 1761315605.746938 mapread 0x556000 thru 0x55cc1c (0x6c1d bytes) 000307[1] 1761315605.772144 write 0x278000 thru 0x27f822 (0x7823 bytes) 000308[1] 1761315605.813538 write 0x684000 thru 0x6891b1 (0x51b2 bytes) 000309[0] 1761315605.836304 mapread 0x1da000 thru 0x1e9717 (0xf718 bytes) 000310[0] 1761315605.942600 trunc from 0x7d651f to 0x72bb51 (0xaa9cd bytes) 000312[1] 1761315606.053126 write 0x0e2000 thru 0x0eb040 (0x9041 bytes) 000314[1] 1761315606.078521 read 0x42a000 thru 0x433849 (0x984a bytes) truncating to largest ever: 0x9d9ace 000315[1] 1761315606.154884 trunc from 0x72bb52 to 0x9d9acd (0x2adf7c bytes) 000317[0] 1761315606.210857 write_OD 0x977000 thru 0x97afff (0x4000 bytes) 000319[1] 1761315606.333071 write 0x18f000 thru 0x197455 (0x8456 bytes) 000321[0] 1761315606.451201 mapread 0x7f9000 thru 0x803876 (0xa877 bytes) 000322[0] 1761315606.543212 read_OD 0x657000 thru 0x65ffff (0x9000 bytes) 000323[0] 1761315606.554480 read_OD 0x57f000 thru 0x58cfff (0xe000 bytes) 000325[0] 1761315606.577097 mapread 0x7ae000 thru 0x7bb385 (0xd386 bytes) 000327[1] 1761315606.689643 mapread 0x357000 thru 0x361f3f (0xaf40 bytes) 000328[1] 1761315606.774709 mapwrite 0x349000 thru 0x34df03 (0x4f04 bytes) 000329[0] 1761315606.954448 write_OD 0x7de000 thru 0x7ecfff (0xf000 bytes) 000330[0] 1761315607.062482 read_OD 0x01a000 thru 0x028fff (0xf000 bytes) 000331[1] 1761315607.085167 read 0x82f000 thru 0x835888 (0x6889 bytes) 000332[0] 1761315607.167521 read_OD 0x898000 thru 0x898fff (0x1000 bytes) 000335[0] 1761315607.175140 trunc from 0x9d9ace to 0x462dbd (0x576d10 bytes) 000336[1] 1761315607.238076 mapwrite 0x98d000 thru 0x999fc1 (0xcfc2 bytes) 000337[0] 1761315607.491681 mapread 0x8e7000 thru 0x8ede65 (0x6e66 bytes) 000338[1] 1761315607.618365 write 0x16d000 thru 0x175a47 (0x8a48 bytes) 000339[1] 1761315607.671986 mapwrite 0x2b3000 thru 0x2ba29a (0x729b bytes) 000341[1] 1761315607.806605 read 0x55c000 thru 0x567dee (0xbdef bytes) 000342[1] 1761315607.952611 write 0x733000 thru 0x7422d0 (0xf2d1 bytes) 000343[0] 1761315607.953988 mapwrite 0x8e2000 thru 0x8e8d87 (0x6d88 bytes) 000347[0] 1761315608.207195 read_OD 0x464000 thru 0x471fff (0xe000 bytes) 000349[1] 1761315608.228234 write 0x0d9000 thru 0x0e6162 (0xd163 bytes) 000350[1] 1761315608.247567 mapwrite 0x0ef000 thru 0x0ef063 (0x64 bytes) 000351[1] 1761315608.299145 mapread 0x0d7000 thru 0x0d91c0 (0x21c1 bytes) 000353[0] 1761315608.325596 write_OD 0x7b3000 thru 0x7b9fff (0x7000 bytes) 000355[0] 1761315608.410462 mapread 0x2d2000 thru 0x2d7e79 (0x5e7a bytes) 000356[1] 1761315608.549711 write 0x0d6000 thru 0x0e43f7 (0xe3f8 bytes) 000358[0] 1761315608.600456 mapwrite 0x8e1000 thru 0x8e42be (0x32bf bytes) 000359[0] 1761315608.704475 read_OD 0x285000 thru 0x290fff (0xc000 bytes) 000362[1] 1761315608.727036 trunc from 0x999fc2 to 0x131bc6 (0x8683fb bytes) 000365[1] 1761315608.782646 read 0x0bb000 thru 0x0c91be (0xe1bf bytes) 000367[0] 1761315608.829392 read_OD 0x0e8000 thru 0x0e9fff (0x2000 bytes) 000368[1] 1761315608.866465 mapwrite 0x43f000 thru 0x446a10 (0x7a11 bytes) 000369[1] 1761315609.066977 read 0x129000 thru 0x12aabd (0x1abe bytes) 000371[0] 1761315609.081514 mapread 0x05a000 thru 0x05c951 (0x2952 bytes) 000373[1] 1761315609.207923 mapread 0x169000 thru 0x16b75a (0x275b bytes) 000374[0] 1761315609.224707 trunc from 0x446a11 to 0x86185b (0x41ae4b bytes) 000376[0] 1761315609.283427 mapread 0x1e3000 thru 0x1e54a5 (0x24a6 bytes) 000377[1] 1761315609.417099 write 0x22f000 thru 0x23e054 (0xf055 bytes) 000381[1] 1761315609.561548 mapwrite 0x632000 thru 0x63a16c (0x816d bytes) 000382[1] 1761315609.657407 mapread 0x71b000 thru 0x71facd (0x4ace bytes) 000385[0] 1761315609.676164 trunc from 0x86185c to 0x91b203 (0xb99a8 bytes) 000386[1] 1761315609.721730 mapread 0x74b000 thru 0x74fabc (0x4abd bytes) 000389[1] 1761315609.773669 mapwrite 0x35b000 thru 0x3627e5 (0x77e6 bytes) 000391[0] 1761315609.941628 mapread 0x8f3000 thru 0x8fc6d8 (0x96d9 bytes) 000392[0] 1761315610.010982 write_OD 0x961000 thru 0x966fff (0x6000 bytes) 000393[0] 1761315610.073929 read_OD 0x29d000 thru 0x2a8fff (0xc000 bytes) 000394[0] 1761315610.112982 mapread 0x401000 thru 0x406c8b (0x5c8c bytes) 000395[0] 1761315610.275467 mapread 0x91e000 thru 0x92d7ba (0xf7bb bytes) 000396[0] 1761315610.313425 read_OD 0x359000 thru 0x367fff (0xf000 bytes) 000397[0] 1761315610.326055 read_OD 0x254000 thru 0x257fff (0x4000 bytes) 000398[1] 1761315610.332294 trunc from 0x967000 to 0x72a424 (0x23cbdb bytes) 000403[1] 1761315610.441437 trunc from 0x72a425 to 0x672bce (0xb7856 bytes) 000404[0] 1761315610.463063 trunc from 0x672bcf to 0x57b96a (0xf7264 bytes) 000405[0] 1761315610.501009 trunc from 0x57b96b to 0x0c792d (0x4b403d bytes) 000406[0] 1761315610.537385 write_OD 0x707000 thru 0x708fff (0x2000 bytes) 000412[0] 1761315610.622896 write_OD 0x84f000 thru 0x85dfff (0xf000 bytes) 000413[0] 1761315610.675959 trunc from 0x85e000 to 0x4c5a15 (0x3985ea bytes) 000415[1] 1761315610.743813 mapwrite 0x915000 thru 0x9189e9 (0x39ea bytes) 000416[1] 1761315610.847017 write 0x8a1000 thru 0x8a5e75 (0x4e76 bytes) 000417[1] 1761315610.874406 write 0x591000 thru 0x594253 (0x3254 bytes) 000419[1] 1761315610.904673 read 0x059000 thru 0x063806 (0xa807 bytes) 000428[1] 1761315611.154890 mapwrite 0x424000 thru 0x42d62e (0x962f bytes) 000431[1] 1761315611.224955 trunc from 0x9189ea to 0x1ffd97 (0x718c52 bytes) 000433[1] 1761315611.316367 read 0x05b000 thru 0x06ac4b (0xfc4c bytes) 000435[0] 1761315611.355620 write_OD 0x781000 thru 0x78afff (0xa000 bytes) 000436[1] 1761315611.432701 write 0x78a000 thru 0x799749 (0xf74a bytes) 000437[1] 1761315611.459869 mapwrite 0x55c000 thru 0x5690fd (0xd0fe bytes) 000440[0] 1761315611.661162 mapwrite 0x3fc000 thru 0x40b4af (0xf4b0 bytes) 000441[1] 1761315611.859776 read 0x50e000 thru 0x51abf9 (0xcbfa bytes) 000442[0] 1761315611.950031 mapread 0x1dd000 thru 0x1e6ffb (0x9ffc bytes) 000455[1] 1761315612.015387 read 0x0d7000 thru 0x0d7547 (0x548 bytes) 000459[1] 1761315612.097166 mapwrite 0x5ee000 thru 0x5effaf (0x1fb0 bytes) 000463[0] 1761315612.282655 mapread 0x55a000 thru 0x5673ec (0xd3ed bytes) 000464[0] 1761315612.383915 mapread 0x4db000 thru 0x4e4dce (0x9dcf bytes) 000465[0] 1761315612.465998 trunc from 0x79974a to 0x9944ec (0x1fada3 bytes) 000467[1] 1761315612.511639 mapwrite 0x31b000 thru 0x31d261 (0x2262 bytes) 000468[1] 1761315612.595500 write 0x811000 thru 0x818d3b (0x7d3c bytes) 000469[1] 1761315612.620481 read 0x74c000 thru 0x75716c (0xb16d bytes) 000471[0] 1761315612.667765 mapread 0x14e000 thru 0x15a733 (0xc734 bytes) 000472[0] 1761315612.790207 mapread 0x4f3000 thru 0x4fbeb2 (0x8eb3 bytes) 000473[1] 1761315612.847339 trunc from 0x9944ed to 0x5a159a (0x3f2f52 bytes) 000476[1] 1761315612.930129 trunc from 0x5a159b to 0x41ec21 (0x182979 bytes) 000479[1] 1761315613.006020 mapread 0x23c000 thru 0x24768f (0xb690 bytes) 000481[0] 1761315613.152226 write_OD 0x48f000 thru 0x496fff (0x8000 bytes) 000482[1] 1761315613.208283 read 0x0c0000 thru 0x0c1213 (0x1214 bytes) 000485[0] 1761315613.305080 mapread 0x112000 thru 0x11323f (0x1240 bytes) 000487[1] 1761315613.341434 mapread 0x331000 thru 0x3324c4 (0x14c5 bytes) 000488[1] 1761315613.342010 trunc from 0x497000 to 0x2aceef (0x1ea110 bytes) 000490[0] 1761315613.437063 read_OD 0x09f000 thru 0x0a3fff (0x5000 bytes) 000491[1] 1761315613.474411 mapread 0x153000 thru 0x16096e (0xd96f bytes) 000492[1] 1761315613.544092 mapread 0x118000 thru 0x11ce3a (0x4e3b bytes) 000493[1] 1761315613.568880 mapwrite 0x342000 thru 0x3462b1 (0x42b2 bytes) 000495[0] 1761315613.755033 trunc from 0x3462b2 to 0x11c84a (0x229a67 bytes) 000496[0] 1761315613.798472 mapwrite 0x79f000 thru 0x7ad0ad (0xe0ae bytes) 000499[0] 1761315614.012969 write_OD 0x0e0000 thru 0x0e5fff (0x6000 bytes) All operations completed A-OK! PASS 16a (63s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 10:20:18 (1761315618) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.310468 s, 6.8 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.169653 s, 12.4 MB/s Chance of close/open is 1 in 50 Seed set to 5620 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x5ffc37 000001[0] 1761315620.850013 trunc from 00000000 to 0x5ffc36 (0x5ffc37 bytes) 000002[0] 1761315620.882948 write 0x909095 thru 0x909f4a (0xeb6 bytes) 000003[1] 1761315620.892517 mapread 0x3ef3d3 thru 0x3f0dda (0x1a08 bytes) 000004[1] 1761315620.967639 read 0x5ef091 thru 0x5f0af8 (0x1a68 bytes) 000005[1] 1761315620.979043 mapwrite 0x453393 thru 0x454afc (0x176a bytes) 000006[0] 1761315621.115680 trunc from 0x909f4b to 0x40ce15 (0x4fd135 bytes) 000007[1] 1761315621.175871 trunc from 0x40ce16 to 0x4394d1 (0x2c6bc bytes) 000010[0] 1761315621.223841 read 0x229ab9 thru 0x229df8 (0x340 bytes) 000012[1] 1761315621.292800 trunc from 0x4394d2 to 0x0b04dc (0x388ff5 bytes) 000014[0] 1761315621.378944 mapread 0x05aecb thru 0x05c054 (0x118a bytes) 000015[1] 1761315621.438287 mapwrite 0x0c4b10 thru 0x0c69cc (0x1ebd bytes) 000016[1] 1761315621.533189 mapwrite 0x59e430 thru 0x59e45e (0x2f bytes) 000020[1] 1761315621.644204 mapread 0x1414f7 thru 0x142d4e (0x1858 bytes) 000022[1] 1761315621.691479 read 0x129949 thru 0x129e21 (0x4d9 bytes) 000024[0] 1761315621.828649 trunc from 0x59e45f to 0x56603a (0x38424 bytes) truncating to largest ever: 0x6d4949 000025[0] 1761315621.917045 trunc from 0x56603b to 0x6d4948 (0x16e90e bytes) 000026[1] 1761315621.957508 write 0x75bf42 thru 0x75db8a (0x1c49 bytes) 000028[0] 1761315621.998656 read 0x5b8446 thru 0x5ba204 (0x1dbf bytes) 000030[1] 1761315622.059873 trunc from 0x75db8b to 0x28e24c (0x4cf93e bytes) 000031[1] 1761315622.128492 mapwrite 0x2f11d6 thru 0x2f2086 (0xeb1 bytes) 000032[0] 1761315622.236326 read 0x15475c thru 0x156315 (0x1bba bytes) 000036[0] 1761315622.316019 read 0x144430 thru 0x144ba7 (0x778 bytes) 000037[0] 1761315622.326229 trunc from 0x2f2087 to 0x65549b (0x363415 bytes) 000039[0] 1761315622.428151 write 0x889078 thru 0x88a94a (0x18d3 bytes) 000040[1] 1761315622.449077 write 0x87ad7a thru 0x87ccdc (0x1f63 bytes) 000043[0] 1761315622.520511 read 0x2dc391 thru 0x2dc8c5 (0x535 bytes) 000046[1] 1761315622.648793 read 0x4dfb44 thru 0x4e0059 (0x516 bytes) 000047[0] 1761315622.681611 mapwrite 0x70a5cc thru 0x70b3e2 (0xe17 bytes) 000048[0] 1761315622.753217 trunc from 0x88a94b to 0x5f6c48 (0x293d02 bytes) 000050[1] 1761315622.810897 mapread 0x02038a thru 0x021ba9 (0x1820 bytes) 000051[0] 1761315622.851115 mapread 0x0880f0 thru 0x088b4d (0xa5e bytes) 000053[0] 1761315622.857151 trunc from 0x5f6c49 to 0x678f51 (0x82309 bytes) 000058[1] 1761315622.973896 mapread 0x497d30 thru 0x4990ef (0x13c0 bytes) 000059[0] 1761315623.026050 write 0x6d060a thru 0x6d0745 (0x13c bytes) 000060[0] 1761315623.055466 mapread 0x36c7cf thru 0x36d2e8 (0xb1a bytes) truncating to largest ever: 0x6d908e 000062[0] 1761315623.088778 trunc from 0x6d0746 to 0x6d908d (0x8948 bytes) 000063[1] 1761315623.110179 mapwrite 0x899ff3 thru 0x89acf0 (0xcfe bytes) 000064[0] 1761315623.281469 write 0x611a01 thru 0x612aa8 (0x10a8 bytes) 000065[0] 1761315623.339040 write 0x68643d thru 0x687af2 (0x16b6 bytes) 000066[1] 1761315623.382124 mapwrite 0x008994 thru 0x00909f (0x70c bytes) 000067[0] 1761315623.513605 mapread 0x5c59ea thru 0x5c6288 (0x89f bytes) 000069[1] 1761315623.600836 mapread 0x7a001c thru 0x7a1af3 (0x1ad8 bytes) 000071[0] 1761315623.613706 trunc from 0x89acf1 to 0x2b34df (0x5e7811 bytes) 000075[1] 1761315623.817959 write 0x0fc6b0 thru 0x0fdd64 (0x16b5 bytes) 000076[1] 1761315623.870182 mapread 0x1b412a thru 0x1b5dde (0x1cb5 bytes) 000077[0] 1761315623.920780 mapread 0x07427a thru 0x075bbf (0x1946 bytes) 000078[1] 1761315623.984508 mapwrite 0x2aa343 thru 0x2aa7b9 (0x477 bytes) 000080[0] 1761315624.155038 read 0x1c7fc9 thru 0x1c8a9a (0xad2 bytes) 000084[0] 1761315624.191501 read 0x100e08 thru 0x1014c5 (0x6be bytes) 000086[0] 1761315624.219656 mapwrite 0x4ce5cc thru 0x4cf4bc (0xef1 bytes) 000087[1] 1761315624.477343 mapread 0x341494 thru 0x341b1d (0x68a bytes) 000088[1] 1761315624.532036 mapread 0x3eccc2 thru 0x3ee20c (0x154b bytes) 000089[1] 1761315624.576618 mapwrite 0x8c1cb6 thru 0x8c246a (0x7b5 bytes) 000090[1] 1761315624.782393 trunc from 0x8c246b to 0x3a3bb8 (0x51e8b2 bytes) 000091[0] 1761315624.826520 read 0x2b82ac thru 0x2b9348 (0x109d bytes) 000093[1] 1761315624.888942 mapread 0x2ea70f thru 0x2ebfcc (0x18be bytes) 000094[0] 1761315624.934560 trunc from 0x3a3bb9 to 0x34048e (0x6372a bytes) 000098[0] 1761315625.043135 write 0x779864 thru 0x77b041 (0x17de bytes) 000101[1] 1761315625.081668 mapread 0x1a316b thru 0x1a480f (0x16a5 bytes) 000103[1] 1761315625.184133 write 0x24a5c4 thru 0x24b55b (0xf98 bytes) 000104[1] 1761315625.212908 mapread 0x2919a9 thru 0x292514 (0xb6c bytes) 000106[0] 1761315625.264456 mapread 0x44c3ab thru 0x44cc51 (0x8a7 bytes) 000109[1] 1761315625.385075 mapwrite 0x1b8099 thru 0x1b9ae6 (0x1a4e bytes) 000110[1] 1761315625.466556 trunc from 0x77b042 to 0x6c303d (0xb8004 bytes) 000111[1] 1761315625.542985 mapread 0x3f323a thru 0x3f494f (0x1716 bytes) 000115[0] 1761315625.615628 mapwrite 0x1a6732 thru 0x1a6fae (0x87d bytes) 000117[0] 1761315625.742484 write 0x17dd08 thru 0x17e488 (0x781 bytes) 000119[1] 1761315625.807022 trunc from 0x6c303e to 0x6642e6 (0x5ed57 bytes) 000120[1] 1761315625.880770 mapread 0x499838 thru 0x499e27 (0x5f0 bytes) 000121[1] 1761315625.908866 write 0x8a55c8 thru 0x8a5c83 (0x6bc bytes) 000122[1] 1761315625.915070 read 0x4594c4 thru 0x45a18a (0xcc7 bytes) 000123[0] 1761315626.025331 mapwrite 0x118093 thru 0x118af1 (0xa5f bytes) 000124[0] 1761315626.142610 mapwrite 0x3b9ab4 thru 0x3ba160 (0x6ad bytes) 000125[0] 1761315626.232501 trunc from 0x8a5c84 to 0x45d7f9 (0x44848a bytes) 000127[0] 1761315626.297555 mapread 0x33aef9 thru 0x33cdd5 (0x1edd bytes) 000129[0] 1761315626.341818 write 0x9220da thru 0x923b45 (0x1a6c bytes) 000131[0] 1761315626.369622 mapwrite 0x8103b3 thru 0x810bc1 (0x80f bytes) 000132[0] 1761315626.496004 mapwrite 0x92f6fe thru 0x930133 (0xa36 bytes) 000133[1] 1761315626.609286 write 0x298ae8 thru 0x298c76 (0x18f bytes) 000134[1] 1761315626.656821 mapwrite 0x7dca59 thru 0x7dd77f (0xd27 bytes) 000135[1] 1761315626.738890 trunc from 0x930134 to 0x4e1a44 (0x44e6ef bytes) 000136[0] 1761315626.765687 mapwrite 0x8527f5 thru 0x853f89 (0x1795 bytes) 000137[1] 1761315626.870899 mapread 0x5e4f88 thru 0x5e5425 (0x49e bytes) 000139[0] 1761315626.928439 mapread 0x80d919 thru 0x80e0b7 (0x79f bytes) 000140[1] 1761315626.953235 write 0x3fa526 thru 0x3fb741 (0x121c bytes) 000142[0] 1761315627.015632 mapread 0x8090f1 thru 0x809fad (0xebd bytes) 000144[0] 1761315627.067702 mapwrite 0x946f0c thru 0x947e74 (0xf69 bytes) 000145[1] 1761315627.212473 read 0x484f6e thru 0x4858cf (0x962 bytes) 000151[0] 1761315627.382148 write 0x993f01 thru 0x993fd3 (0xd3 bytes) 000153[0] 1761315627.410362 trunc from 0x993fd4 to 0x0d19c3 (0x8c2610 bytes) 000155[1] 1761315627.493013 read 0x0834f7 thru 0x084774 (0x127e bytes) 000156[0] 1761315627.523562 mapread 0x0739ee thru 0x073df9 (0x40c bytes) 000160[1] 1761315627.570372 write 0x7bc66b thru 0x7bdc54 (0x15ea bytes) 000164[0] 1761315627.596571 mapwrite 0x07755f thru 0x078a0c (0x14ae bytes) 000165[1] 1761315627.704228 mapwrite 0x7808bd thru 0x782590 (0x1cd4 bytes) 000171[1] 1761315627.929894 write 0x72825d thru 0x72a241 (0x1fe5 bytes) 000174[0] 1761315628.004313 write 0x419535 thru 0x41b24e (0x1d1a bytes) 000175[0] 1761315628.019998 write 0x11f49f thru 0x11f5b4 (0x116 bytes) 000178[0] 1761315628.058454 write 0x6889d9 thru 0x68a0f4 (0x171c bytes) 000181[0] 1761315628.135647 mapwrite 0x2bed94 thru 0x2beef8 (0x165 bytes) 000184[0] 1761315628.238360 read 0x249075 thru 0x24a2fa (0x1286 bytes) 000185[1] 1761315628.327441 write 0x13b38f thru 0x13b551 (0x1c3 bytes) 000187[0] 1761315628.395572 mapread 0x01f0ac thru 0x01febb (0xe10 bytes) 000190[0] 1761315628.473473 trunc from 0x7bdc55 to 0x19ad32 (0x622f22 bytes) 000191[1] 1761315628.518774 mapread 0x00b4ac thru 0x00c043 (0xb98 bytes) 000193[0] 1761315628.610959 read 0x0d27d5 thru 0x0d36c6 (0xef2 bytes) 000194[1] 1761315628.650005 mapread 0x0e2e6b thru 0x0e4af2 (0x1c88 bytes) 000195[1] 1761315628.681131 read 0x130951 thru 0x13171b (0xdcb bytes) 000196[0] 1761315628.742526 read 0x163b48 thru 0x164923 (0xddc bytes) 000198[1] 1761315628.757625 trunc from 0x19ad33 to 0x0b42cd (0xe6a65 bytes) 000199[1] 1761315628.863513 read 0x02992d thru 0x02b1d9 (0x18ad bytes) 000201[0] 1761315628.904785 write 0x202993 thru 0x202a5a (0xc8 bytes) 000202[0] 1761315628.935439 write 0x72af22 thru 0x72b717 (0x7f6 bytes) 000204[1] 1761315628.954910 write 0x3334eb thru 0x333544 (0x5a bytes) 000205[1] 1761315628.995086 write 0x42d8a5 thru 0x42f574 (0x1cd0 bytes) 000206[1] 1761315629.121804 mapwrite 0x12859a thru 0x1294a5 (0xf0c bytes) 000208[1] 1761315629.233179 write 0x5a6b11 thru 0x5a84ae (0x199e bytes) 000209[0] 1761315629.260001 read 0x18a927 thru 0x18b437 (0xb11 bytes) 000212[1] 1761315629.353763 mapread 0x4fad36 thru 0x4fca31 (0x1cfc bytes) 000213[1] 1761315629.374411 read 0x420511 thru 0x4215ed (0x10dd bytes) 000216[0] 1761315629.422298 write 0x62ea58 thru 0x62f6f2 (0xc9b bytes) truncating to largest ever: 0x99d8c9 000219[0] 1761315629.530226 trunc from 0x72b718 to 0x99d8c8 (0x2721b1 bytes) 000221[0] 1761315629.596157 mapread 0x4f815c thru 0x4f889d (0x742 bytes) 000224[1] 1761315629.682782 write 0x674385 thru 0x676136 (0x1db2 bytes) 000227[0] 1761315629.848192 mapread 0x0c52c3 thru 0x0c717e (0x1ebc bytes) 000228[0] 1761315629.941526 read 0x22c66f thru 0x22c67b (0xd bytes) 000229[0] 1761315630.047972 read 0x8bb736 thru 0x8bce92 (0x175d bytes) 000233[0] 1761315630.080080 read 0x7768de thru 0x776edc (0x5ff bytes) 000236[0] 1761315630.103330 trunc from 0x99d8c9 to 0x241306 (0x75c5c2 bytes) 000237[1] 1761315630.196276 read 0x04fb2c thru 0x050fc2 (0x1497 bytes) 000238[0] 1761315630.254563 mapread 0x1cb2e4 thru 0x1cb5a6 (0x2c3 bytes) 000240[1] 1761315630.288312 trunc from 0x241307 to 0x786dbf (0x545ab9 bytes) 000241[1] 1761315630.368854 trunc from 0x786dc0 to 0x16c989 (0x61a436 bytes) 000247[1] 1761315630.442696 mapwrite 0x54f178 thru 0x54f88e (0x717 bytes) 000248[0] 1761315630.605118 write 0x5eb28f thru 0x5ebe75 (0xbe7 bytes) 000250[1] 1761315630.658629 mapread 0x166bc7 thru 0x1670c4 (0x4fe bytes) 000252[1] 1761315630.746375 mapwrite 0x6efa74 thru 0x6f0f4f (0x14dc bytes) 000253[1] 1761315630.924765 trunc from 0x6f0f50 to 0x14dd90 (0x5a31bf bytes) 000257[1] 1761315631.079999 mapwrite 0x15dd32 thru 0x15fc3c (0x1f0b bytes) 000259[0] 1761315631.191642 mapwrite 0x04fde0 thru 0x050c42 (0xe63 bytes) 000261[0] 1761315631.300242 read 0x0968bd thru 0x0985b0 (0x1cf4 bytes) 000263[0] 1761315631.376947 read 0x0b7740 thru 0x0b8f9a (0x185b bytes) 000264[0] 1761315631.423991 write 0x394640 thru 0x394ed0 (0x891 bytes) 000265[0] 1761315631.454981 write 0x14b69a thru 0x14d25d (0x1bc4 bytes) 000266[1] 1761315631.465936 write 0x41d57a thru 0x41dfb9 (0xa40 bytes) 000268[1] 1761315631.508873 mapread 0x298ce3 thru 0x29966e (0x98c bytes) 000272[0] 1761315631.622081 mapwrite 0x96fa27 thru 0x970fc2 (0x159c bytes) 000274[0] 1761315631.724225 mapwrite 0x0f4ae2 thru 0x0f577c (0xc9b bytes) 000276[0] 1761315631.804366 mapread 0x5fa883 thru 0x5fc642 (0x1dc0 bytes) 000280[0] 1761315631.843602 write 0x9f9ae9 thru 0x9fadb7 (0x12cf bytes) 000282[0] 1761315631.846348 write 0x186606 thru 0x188264 (0x1c5f bytes) 000284[0] 1761315631.883153 mapread 0x9f00bc thru 0x9f036a (0x2af bytes) 000285[0] 1761315631.887940 read 0x3d4099 thru 0x3d5eb2 (0x1e1a bytes) 000286[0] 1761315632.026332 write 0x6d9ffc thru 0x6da31f (0x324 bytes) 000288[1] 1761315632.027274 mapwrite 0x328103 thru 0x329a16 (0x1914 bytes) 000291[0] 1761315632.256310 mapwrite 0x84154e thru 0x84236e (0xe21 bytes) 000292[1] 1761315632.358102 write 0x9f52f5 thru 0x9f654a (0x1256 bytes) 000293[1] 1761315632.388151 read 0x36a861 thru 0x36b203 (0x9a3 bytes) 000296[0] 1761315632.541786 read 0x956fc5 thru 0x958022 (0x105e bytes) 000300[1] 1761315632.630396 read 0x85a8b4 thru 0x85a9a7 (0xf4 bytes) 000301[1] 1761315632.690568 mapwrite 0x6bd51f thru 0x6be4e3 (0xfc5 bytes) 000302[0] 1761315632.819479 trunc from 0x9fadb8 to 0x93c434 (0xbe983 bytes) 000303[0] 1761315632.868452 read 0x707d1b thru 0x70915f (0x1445 bytes) 000304[0] 1761315632.906076 write 0x190ea7 thru 0x191439 (0x593 bytes) 000305[0] 1761315632.930171 read 0x56f6d0 thru 0x56f959 (0x28a bytes) 000306[0] 1761315632.988274 mapwrite 0x2d1a23 thru 0x2d314a (0x1728 bytes) 000307[0] 1761315633.102774 trunc from 0x93c435 to 0x106e74 (0x8355c0 bytes) 000308[0] 1761315633.152019 write 0x7a3f26 thru 0x7a4640 (0x71b bytes) 000312[0] 1761315633.181859 trunc from 0x7a4641 to 0x449ca8 (0x35a998 bytes) 000313[1] 1761315633.206919 write 0x99f3a5 thru 0x9a0cdc (0x1938 bytes) 000314[0] 1761315633.254686 read 0x5d4b88 thru 0x5d58fc (0xd75 bytes) 000316[1] 1761315633.430866 read 0x59f83d thru 0x5a0696 (0xe5a bytes) 000320[1] 1761315633.505391 read 0x900c77 thru 0x9025d0 (0x195a bytes) 000321[0] 1761315633.540776 trunc from 0x9a0cdd to 0x792e01 (0x20dedb bytes) 000325[0] 1761315633.650182 mapwrite 0x279d72 thru 0x27a142 (0x3d1 bytes) 000326[0] 1761315633.712527 mapread 0x0c01a0 thru 0x0c0e86 (0xce7 bytes) 000328[1] 1761315633.738750 write 0x8bcab2 thru 0x8bcc80 (0x1cf bytes) 000329[0] 1761315633.773033 write 0x082918 thru 0x083a6a (0x1153 bytes) 000330[1] 1761315633.861300 mapwrite 0x3c19d9 thru 0x3c2796 (0xdbe bytes) 000332[0] 1761315633.958567 mapread 0x86973f thru 0x86a515 (0xdd7 bytes) 000336[1] 1761315634.035529 mapwrite 0x5eaa61 thru 0x5eb0ab (0x64b bytes) 000337[1] 1761315634.130477 mapread 0x7d7f91 thru 0x7d9de6 (0x1e56 bytes) 000340[0] 1761315634.229942 mapread 0x090416 thru 0x09105a (0xc45 bytes) 000343[0] 1761315634.346787 trunc from 0x8bcc81 to 0x1cae74 (0x6f1e0c bytes) 000344[0] 1761315634.400852 trunc from 0x1cae75 to 0x4b7206 (0x2ec392 bytes) 000346[1] 1761315634.444210 mapread 0x28f5bb thru 0x28ffca (0xa10 bytes) 000347[0] 1761315634.515343 mapwrite 0x5caf21 thru 0x5cb18f (0x26f bytes) 000348[0] 1761315634.667453 trunc from 0x5cb190 to 0x3ba556 (0x210c39 bytes) 000351[1] 1761315634.735275 mapread 0x24c932 thru 0x24cabe (0x18d bytes) 000354[0] 1761315634.780759 read 0x32e8c8 thru 0x32f9b1 (0x10ea bytes) 000356[0] 1761315634.799236 trunc from 0x3ba557 to 0x1d348d (0x1e70c9 bytes) 000357[1] 1761315634.836818 trunc from 0x1d348e to 0x16b3f5 (0x68098 bytes) 000359[1] 1761315634.898359 write 0x363213 thru 0x3641de (0xfcc bytes) 000360[1] 1761315634.935399 write 0x41ed82 thru 0x41fb4f (0xdce bytes) 000361[0] 1761315634.936478 write 0x42feac thru 0x431923 (0x1a78 bytes) 000366[1] 1761315635.047752 read 0x078a67 thru 0x07a704 (0x1c9e bytes) 000367[0] 1761315635.132759 mapread 0x3ff368 thru 0x4009f9 (0x1692 bytes) 000368[1] 1761315635.186008 mapwrite 0x14e089 thru 0x14e57d (0x4f5 bytes) 000370[1] 1761315635.328867 read 0x15cb38 thru 0x15cc42 (0x10b bytes) 000372[0] 1761315635.355885 write 0x911642 thru 0x911f71 (0x930 bytes) 000373[0] 1761315635.395980 write 0x016778 thru 0x016f99 (0x822 bytes) 000376[0] 1761315635.482430 read 0x48eb2f thru 0x48f1d3 (0x6a5 bytes) 000377[0] 1761315635.522643 mapread 0x05bb15 thru 0x05ca3a (0xf26 bytes) 000378[0] 1761315635.540591 mapread 0x110456 thru 0x111574 (0x111f bytes) 000384[0] 1761315635.604331 read 0x668c7c thru 0x66a58d (0x1912 bytes) 000386[0] 1761315635.624712 mapwrite 0x6ab144 thru 0x6ad007 (0x1ec4 bytes) 000388[0] 1761315635.765639 trunc from 0x911f72 to 0x4ae5a3 (0x4639ce bytes) 000391[1] 1761315635.885425 mapwrite 0x635217 thru 0x635556 (0x340 bytes) 000392[1] 1761315636.029461 write 0x988b66 thru 0x989d60 (0x11fb bytes) 000394[1] 1761315636.057843 mapwrite 0x966f0c thru 0x96757b (0x670 bytes) 000396[0] 1761315636.175946 trunc from 0x989d61 to 0x6c88da (0x2c1486 bytes) 000398[0] 1761315636.286188 mapwrite 0x865af7 thru 0x8665af (0xab9 bytes) 000404[1] 1761315636.521225 mapwrite 0x4c9df3 thru 0x4ca0c4 (0x2d2 bytes) 000406[1] 1761315636.644057 mapread 0x7608b8 thru 0x761192 (0x8db bytes) 000407[1] 1761315636.673208 read 0x7f734f thru 0x7f75e0 (0x292 bytes) 000408[1] 1761315636.693991 read 0x219f4a thru 0x21b2d5 (0x138c bytes) 000409[0] 1761315636.850281 write 0x13f5d8 thru 0x140362 (0xd8b bytes) 000412[0] 1761315636.931539 trunc from 0x8665b0 to 0x4f10f5 (0x3754ba bytes) 000414[1] 1761315637.020123 mapwrite 0x6a37ec thru 0x6a4836 (0x104b bytes) 000416[0] 1761315637.234646 trunc from 0x6a4837 to 0x93a75f (0x295f29 bytes) 000417[1] 1761315637.291181 write 0x6ddc39 thru 0x6debab (0xf73 bytes) 000418[0] 1761315637.343530 mapread 0x757bdb thru 0x758744 (0xb6a bytes) 000420[0] 1761315637.413063 read 0x0f2371 thru 0x0f27cc (0x45c bytes) 000425[1] 1761315637.604984 read 0x8f198d thru 0x8f2e68 (0x14dc bytes) 000426[1] 1761315637.622690 write 0x609c90 thru 0x60a340 (0x6b1 bytes) 000427[0] 1761315637.713362 write 0x1a9ff1 thru 0x1abdc0 (0x1dd0 bytes) 000428[1] 1761315637.745431 mapwrite 0x5cd77d thru 0x5cdb94 (0x418 bytes) 000429[1] 1761315637.905494 mapwrite 0x16235d thru 0x162e44 (0xae8 bytes) 000430[1] 1761315637.985119 read 0x6439ef thru 0x644d08 (0x131a bytes) 000431[1] 1761315638.042240 mapread 0x81e4cb thru 0x81e6ac (0x1e2 bytes) 000433[0] 1761315638.087653 write 0x5b642e thru 0x5b6ad2 (0x6a5 bytes) 000437[1] 1761315638.207097 mapwrite 0x9aa67f thru 0x9aa73a (0xbc bytes) 000438[1] 1761315638.325959 mapwrite 0x03612a thru 0x037197 (0x106e bytes) 000439[1] 1761315638.415328 mapread 0x562c9a thru 0x56338d (0x6f4 bytes) 000442[1] 1761315638.493651 read 0x848678 thru 0x848d5f (0x6e8 bytes) 000444[0] 1761315638.528482 mapread 0x82d1c5 thru 0x82e3f0 (0x122c bytes) 000447[0] 1761315638.581153 mapwrite 0x1ddbfc thru 0x1de25e (0x663 bytes) 000448[1] 1761315638.689145 mapread 0x6bf7e4 thru 0x6c0582 (0xd9f bytes) 000450[0] 1761315638.750459 read 0x67ad58 thru 0x67b624 (0x8cd bytes) 000451[0] 1761315638.835763 trunc from 0x9aa73b to 0x13e6db (0x86c05f bytes) 000453[0] 1761315638.890295 read 0x0dd8a5 thru 0x0def75 (0x16d1 bytes) 000454[1] 1761315638.938606 trunc from 0x13e6dc to 0x2983ee (0x159d13 bytes) 000457[0] 1761315639.108458 write 0x668294 thru 0x668524 (0x291 bytes) 000459[1] 1761315639.188724 mapwrite 0x518758 thru 0x51900c (0x8b5 bytes) 000460[0] 1761315639.449055 trunc from 0x668525 to 0x74efa8 (0xe6a84 bytes) 000461[1] 1761315639.506229 trunc from 0x74efa9 to 0x37231e (0x3dcc8a bytes) 000462[0] 1761315639.601497 write 0x6a9c9d thru 0x6aaf74 (0x12d8 bytes) 000464[0] 1761315639.662974 mapread 0x090a81 thru 0x091f51 (0x14d1 bytes) 000465[1] 1761315639.704725 trunc from 0x6aaf75 to 0x2b335e (0x3f7c16 bytes) 000467[1] 1761315639.787116 mapwrite 0x0b0149 thru 0x0b0f58 (0xe10 bytes) 000471[1] 1761315639.911154 trunc from 0x2b335f to 0x0edbe1 (0x1c577d bytes) 000472[0] 1761315639.962038 trunc from 0x0edbe2 to 0x8df10b (0x7f152a bytes) 000477[1] 1761315640.237007 trunc from 0x8df10c to 0x8cb23c (0x13ecf bytes) 000478[1] 1761315640.306930 write 0x55048f thru 0x5520f1 (0x1c63 bytes) 000479[1] 1761315640.331099 trunc from 0x8cb23d to 0x1ad00f (0x71e22d bytes) 000480[0] 1761315640.351195 read 0x0ae3c8 thru 0x0ae95d (0x596 bytes) 000482[1] 1761315640.419489 mapwrite 0x0e1ff6 thru 0x0e259a (0x5a5 bytes) 000484[1] 1761315640.497265 write 0x91d877 thru 0x91dff8 (0x782 bytes) 000486[0] 1761315640.565813 mapread 0x123851 thru 0x125608 (0x1db8 bytes) 000487[0] 1761315640.663742 mapwrite 0x2a2ad9 thru 0x2a3bb0 (0x10d8 bytes) 000489[1] 1761315640.808145 mapwrite 0x37f463 thru 0x3805fb (0x1199 bytes) 000493[0] 1761315640.954693 write 0x450266 thru 0x451fe3 (0x1d7e bytes) 000496[1] 1761315641.031499 write 0x658fcb thru 0x65ae06 (0x1e3c bytes) 000497[0] 1761315641.077475 mapwrite 0x7e0472 thru 0x7e1672 (0x1201 bytes) 000498[0] 1761315641.182886 mapwrite 0x9fb1b5 thru 0x9fc5dd (0x1429 bytes) All operations completed A-OK! PASS 16b (27s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 10:20:45 (1761315645) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (4s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 10:20:49 (1761315649) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.281603 s, 7.4 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.247273 s, 8.5 MB/s ldlm.namespaces.MGC192.168.204.139@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff9d3ac752c000.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff9d3ae00bf000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff9d3ac752c000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff9d3ac752c000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff9d3ae00bf000.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.00293 s, 13.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.87903 s, 36.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 1.40853 s, 74.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.88673 s, 21.5 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.14454 s, 12.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.98588 s, 35.1 MB/s PASS 16d (40s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 10:21:29 (1761315689) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.309837 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130197 s, 8.1 MB/s PASS 16e (8s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 10:21:37 (1761315697) TIMEOUT PASS 16f (28s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 10:22:05 (1761315725) TIMEOUT PASS 16g (27s) == sanityn test 16i: read after truncate file ============ 10:22:32 (1761315752) ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16i (6s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 10:22:38 (1761315758) fail_loc=0x8000030a PASS 17 (10s) == sanityn test 18: mmap sanity check =========================================================================================== 10:22:48 (1761315768) mmap test1: basic mmap operation (PASS, 0.094976s) mmap test2: MAP_PRIVATE not write back (PASS, 0.07677s) mmap test3: concurrent mmap ops on two nodes (PASS, 22.374s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.4202s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.12011s) mmap test6: check mmap write/read content on two nodes (PASS, 0.24355s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.064s) PASS 18 (33s) == sanityn test 19: test concurrent uncached read races ========================================================================= 10:23:21 (1761315801) oleg439-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg439-client: oleg439-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (4s) == sanityn test 20: test extra readahead page left in cache ============================================================== 10:23:26 (1761315806) PASS 20 (6s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 10:23:31 (1761315811) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (5s) == sanityn test 23: others should see updated atime while another read============================================================== 10:23:37 (1761315817) now is 1761315819 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 new atime is 1761315880 PASS 23 (69s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 10:24:45 (1761315885) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 5.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 11.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 PASS 24a (9s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 10:24:54 (1761315894) PASS 24b (8s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 10:25:02 (1761315902) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (9s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 10:25:11 (1761315911) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (3s) == sanityn test 26a: allow mtime to get older ============ 10:25:15 (1761315915) utime: good mknod times 1761315915 <= 1761315916 <= 1761315916 for /mnt/lustre/f26a utime: good mknod times 1761315915 <= 1761315916 <= 1761315916 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (7s) == sanityn test 26b: sync mtime between ost and mds ====== 10:25:22 (1761315922) PASS 26b (8s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 10:25:33 (1761315933) 0 PASS 30 (8s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 10:25:41 (1761315941) fail_loc=0x314 PASS 31a (8s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 10:25:50 (1761315950) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg439-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.204.139@tcp:/lustre 7542784 12288 7526400 1% /mnt/lustre2 PASS 31b (20s) == sanityn test 31r: open-rename(replace) race =========== 10:26:10 (1761315970) -rw-r--r-- 1 root root 0 Oct 24 10:26 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (10s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 10:26:21 (1761315981) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (3s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 10:26:24 (1761315984) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (2s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 10:26:26 (1761315986) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (2s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 10:26:28 (1761315988) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (2s) == sanityn test 34: no lock timeout under IO ============= 10:26:31 (1761315991) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg439-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9d3ac752c000.ost_server_uuid,osc.lustre-OST0000-osc-ffff9d3ae00bf000.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9d3ac752c000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9d3ae00bf000.ost_server_uuid in IDLE state after 0 sec oleg439-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9d3ac752c000.ost_server_uuid,osc.lustre-OST0001-osc-ffff9d3ae00bf000.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9d3ac752c000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff9d3ae00bf000.ost_server_uuid in IDLE state after 0 sec oleg439-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9d3ac752c000.ost_server_uuid,osc.lustre-OST0000-osc-ffff9d3ae00bf000.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9d3ac752c000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9d3ae00bf000.ost_server_uuid in IDLE state after 0 sec oleg439-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9d3ac752c000.ost_server_uuid,osc.lustre-OST0001-osc-ffff9d3ae00bf000.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9d3ac752c000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff9d3ae00bf000.ost_server_uuid in IDLE state after 0 sec oleg439-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9d3ac752c000.ost_server_uuid,osc.lustre-OST0000-osc-ffff9d3ae00bf000.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9d3ac752c000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9d3ae00bf000.ost_server_uuid in IDLE state after 0 sec oleg439-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9d3ac752c000.ost_server_uuid,osc.lustre-OST0001-osc-ffff9d3ae00bf000.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9d3ac752c000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff9d3ae00bf000.ost_server_uuid in IDLE state after 0 sec PASS 34 (119s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 10:28:30 (1761316110) fail_loc=0x80000317 Race attempt 0 Wait for 44679 44706 for 60 sec... - open/close 683 (time 1761316126.94 total 10.00 last 68.29) - open/close 1386 (time 1761316136.94 total 20.00 last 70.30) - open/close 2084 (time 1761316146.95 total 30.01 last 69.75) - open/close 2728 (time 1761316156.96 total 40.02 last 64.33) - open/close 3437 (time 1761316166.96 total 50.02 last 70.89) total: 4000 open/close in 57.97 seconds: 69.01 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.204.139@tcp:/lustre 7.2G 12M 7.2G 1% /mnt/lustre 192.168.204.139@tcp:/lustre 7.2G 12M 7.2G 1% /mnt/lustre2 PASS 35 (71s) == sanityn test 36: handle ESTALE/open-unlink correctly == 10:29:42 (1761316182) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg439-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.927521 s, 56.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7526400) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.820115 s, 63.9 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.18079 s, 44.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7524352) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.790706 s, 66.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7526400) after_dd(7471104) after(7522304) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.896005 s, 58.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7522304) after_dd(7471104) after(7522304) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.18949 s, 44.1 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7522304) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.23777 s, 42.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7526400) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.741558 s, 70.7 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7526400) after_dd(7475200) after(7526400) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.968428 s, 54.1 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7526400) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.888775 s, 59.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7524352) after_dd(7467008) after(7518208) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.838759 s, 62.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7518208) after_dd(7471104) after(7522304) PASS 36 (293s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 10:34:35 (1761316475) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 - create 1326 (time 1761316489.14 total 10.01 last 132.50) - create 2537 (time 1761316499.15 total 20.01 last 121.07) - create 3826 (time 1761316509.15 total 30.01 last 128.89) - create 5087 (time 1761316519.15 total 40.01 last 126.09) - create 6378 (time 1761316529.15 total 50.01 last 129.09) - create 7720 (time 1761316539.16 total 60.02 last 134.08) - create 9004 (time 1761316549.16 total 70.03 last 128.33) total: 10000 create in 77.91 seconds: 128.35 ops/second PASS 37 (88s) == sanityn test 39a: test from 11063 ============================================================================================ 10:36:03 (1761316563) repeat after cancel_lru_locks PASS 39a (7s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 10:36:10 (1761316570) repeat after cancel_lru_locks PASS 39b (7s) == sanityn test 39c: check truncate mtime update ================================================================================ 10:36:17 (1761316577) repeat after cancel_lru_locks PASS 39c (8s) == sanityn test 39d: sync write should update mtime ====== 10:36:25 (1761316585) fail_loc=0x411 fail_loc=0 PASS 39d (6s) == sanityn test 40a: pdirops: create vs others ======================================================================== 10:36:31 (1761316591) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (15s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 10:36:46 (1761316606) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (15s) == sanityn test 40c: pdirops: link and others ======================================================================== 10:37:01 (1761316621) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (16s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 10:37:17 (1761316637) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (15s) == sanityn test 40e: pdirops: rename and others ======================================================================== 10:37:32 (1761316652) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (15s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 10:37:48 (1761316668) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (18s) == sanityn test 41b: pdirops: create vs create ======================================================================== 10:38:06 (1761316686) open: File exists Conflict PASS 41b (16s) == sanityn test 41c: pdirops: create vs link ======================================================================== 10:38:22 (1761316702) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (12s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 10:38:34 (1761316714) Conflict PASS 41d (11s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 10:38:46 (1761316726) Conflict PASS 41e (10s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 10:38:56 (1761316736) Conflict PASS 41f (12s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 10:39:08 (1761316748) Conflict PASS 41g (13s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 10:39:21 (1761316761) Conflict PASS 41h (13s) == sanityn test 41i: reint_open: create vs create ======== 10:39:34 (1761316774) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (1039s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 10:56:53 (1761317813) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (13s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 10:57:06 (1761317826) open: File exists Conflict PASS 42b (11s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 10:57:17 (1761317837) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (13s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 10:57:30 (1761317850) Conflict PASS 42d (13s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 10:57:43 (1761317863) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (12s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 10:57:55 (1761317875) Conflict PASS 42f (13s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 10:58:08 (1761317888) Conflict PASS 42g (11s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 10:58:19 (1761317899) Conflict PASS 42h (12s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 10:58:32 (1761317912) PASS 43a (50s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 10:59:22 (1761317962) Conflict PASS 43b (13s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 10:59:35 (1761317975) Conflict PASS 43c (12s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 10:59:47 (1761317987) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (11s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 10:59:58 (1761317998) Conflict PASS 43e (12s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 11:00:10 (1761318010) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (13s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 11:00:23 (1761318023) stat: cannot statx '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (14s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 11:00:38 (1761318038) Conflict PASS 43h (13s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 11:00:50 (1761318050) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (3s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 11:00:53 (1761318053) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists PASS 43j (130s) == sanityn test 43k: unlink vs create ==================== 11:03:03 (1761318183) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (1086s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 11:21:09 (1761319269) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Fri Oct 24 11:21:15 EDT 2025 PASS 44a (8s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 11:21:18 (1761319278) open: File exists Conflict PASS 44b (8s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 11:21:26 (1761319286) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (10s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 11:21:36 (1761319296) Conflict PASS 44d (8s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 11:21:45 (1761319305) Conflict PASS 44e (8s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 11:21:53 (1761319313) Conflict PASS 44f (10s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 11:22:03 (1761319323) Conflict PASS 44g (9s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 11:22:12 (1761319332) Conflict PASS 44h (8s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 11:22:21 (1761319341) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (2s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 11:22:23 (1761319343) PASS 45a (77s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 11:23:40 (1761319420) Conflict PASS 45b (8s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 11:23:48 (1761319428) Conflict PASS 45c (8s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 11:23:56 (1761319436) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (8s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 11:24:04 (1761319444) Conflict PASS 45e (8s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 11:24:12 (1761319452) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (9s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 11:24:21 (1761319461) stat: cannot statx '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (7s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 11:24:28 (1761319468) Conflict PASS 45h (6s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 11:24:35 (1761319475) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (2s) == sanityn test 45j: read vs rename ====================== 11:24:36 (1761319476) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (867s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 11:39:03 (1761320343) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (8s) == sanityn test 46b: pdirops: link vs create ======================================================================== 11:39:11 (1761320351) open: File exists Conflict PASS 46b (9s) == sanityn test 46c: pdirops: link vs link ======================================================================== 11:39:20 (1761320360) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (8s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 11:39:28 (1761320368) Conflict PASS 46d (7s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 11:39:35 (1761320375) Conflict PASS 46e (8s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 11:39:43 (1761320383) Conflict PASS 46f (8s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 11:39:51 (1761320391) Conflict PASS 46g (7s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 11:39:58 (1761320398) Conflict PASS 46h (7s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 11:40:05 (1761320405) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (2s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 11:40:07 (1761320407) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (2s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 11:40:09 (1761320409) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 11:40:11 (1761320411) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (1s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 11:40:12 (1761320412) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 11:40:14 (1761320414) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (2s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 11:40:15 (1761320415) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (2s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 11:40:17 (1761320417) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 11:40:19 (1761320419) 10+0 records in 10+0 records out 10240 bytes (10 kB, 10 KiB) copied, 0.00987148 s, 1.0 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (8s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 11:40:27 (1761320427) 0+1 records in 0+1 records out 158 bytes copied, 0.0116196 s, 13.6 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3146: kill: (242471) - No such process PASS 51a (5s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 11:40:32 (1761320432) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00813022 s, 126 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032667 s, 32.1 MB/s 3145728 PASS 51b (16s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 11:40:48 (1761320448) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0125725 s, 81.4 kB/s PASS 51c (8s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 11:40:56 (1761320456) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262704 s, 39.9 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (5s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 11:41:01 (1761320461) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2435 0x983 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2435 0x983 0 read lease(1) has applied. PASS 51e (6s) == sanityn test 54: rename locking ======================= 11:41:07 (1761320467) llite.lustre-ffff9d3ac752c000.xattr_cache=1 llite.lustre-ffff9d3ae00bf000.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504962 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 11:41:07.000000000 -0400 Modify: 2025-10-24 11:41:08.000000000 -0400 Change: 2025-10-24 11:41:08.000000000 -0400 Birth: 2025-10-24 11:41:08.000000000 -0400 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504965 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 11:41:13.000000000 -0400 Modify: 2025-10-24 11:41:14.000000000 -0400 Change: 2025-10-24 11:41:14.000000000 -0400 Birth: 2025-10-24 11:41:13.000000000 -0400 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 11:41:19.000000000 -0400 Modify: 2025-10-24 11:41:19.000000000 -0400 Change: 2025-10-24 11:41:19.000000000 -0400 Birth: 2025-10-24 11:41:19.000000000 -0400 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504967 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 11:41:19.000000000 -0400 Modify: 2025-10-24 11:41:19.000000000 -0400 Change: 2025-10-24 11:41:19.000000000 -0400 Birth: 2025-10-24 11:41:19.000000000 -0400 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 11:41:25.000000000 -0400 Modify: 2025-10-24 11:41:25.000000000 -0400 Change: 2025-10-24 11:41:25.000000000 -0400 Birth: 2025-10-24 11:41:25.000000000 -0400 File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504970 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 11:41:25.000000000 -0400 Modify: 2025-10-24 11:41:25.000000000 -0400 Change: 2025-10-24 11:41:25.000000000 -0400 Birth: 2025-10-24 11:41:25.000000000 -0400 PASS 54 (26s) == sanityn test 55a: rename vs unlink target dir ========= 11:41:33 (1761320493) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (8s) == sanityn test 55b: rename vs unlink source dir ========= 11:41:41 (1761320501) fail_loc=0x80000156 mv: cannot stat '/mnt/lustre/d55b.sanityn/d1/d2': No such file or directory PASS 55b (9s) == sanityn test 55c: rename vs unlink orphan target dir == 11:41:50 (1761320510) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (15s) == sanityn test 55d: rename file vs link ================= 11:42:05 (1761320525) fail_loc=0x155 mv: '/mnt/lustre/d55d.sanityn/f1' and '/mnt/lustre/d55d.sanityn/d55d.sanityn/f1' are the same file PASS 55d (11s) == sanityn test 60: Verify data_version behaviour ======== 11:42:16 (1761320536) PASS 60 (4s) == sanityn test 70a: cd directory && rm directory ======== 11:42:21 (1761320541) PASS 70a (3s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 11:42:24 (1761320544) PASS 70b (3s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 11:42:27 (1761320547) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.00794133 s, 8.3 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (2s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 11:42:29 (1761320549) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.00785411 s, 8.3 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (2s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 11:42:31 (1761320551) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (1s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 11:42:33 (1761320553) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.00942242 s, 7.0 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 11:42:34 (1761320554) llite.lustre-ffff9d3ac752c000.xattr_cache=1 llite.lustre-ffff9d3ae00bf000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (4s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 11:42:38 (1761320558) llite.lustre-ffff9d3ac752c000.xattr_cache=1 llite.lustre-ffff9d3ae00bf000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (3s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 11:42:41 (1761320561) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00723623 s, 142 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00808474 s, 127 kB/s 252513: get lock1 252510: get lock2 252513: done 252513: get lock2 252510: done 252510: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 252510: cannot get lock1: Resource deadlock avoided 252513: done 252513: exit rc=0 252510: done 252510: exit rc=0 PASS 74 (7s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 11:42:48 (1761320568) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0299267 s, 70.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199544 s, 52.5 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3714: 253086 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (9s) == sanityn test 76: Verify MDT open_files listing ======== 11:42:57 (1761320577) opening files: ........ closing files: ........ PASS 76 (31s) == sanityn test 77a: check FIFO NRS policy =============== 11:43:28 (1761320608) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.169604 s, 98.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0838512 s, 12.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0744989 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0894366 s, 11.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0855597 s, 12.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104761 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0876831 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0953374 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0947417 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0789688 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145805 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13436 s, 7.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191971 s, 5.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158409 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157681 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171007 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1972 s, 5.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=7 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357145 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402477 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0371392 s, 28.2 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319026 s, 32.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0362405 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.040307 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0421059 s, 24.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0387082 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0424233 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.041362 s, 25.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0417891 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0454126 s, 23.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0428174 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0442472 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.045464 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0453217 s, 23.1 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77a.sanityn' PASS 77a (5s) == sanityn test 77b: check CRR-N NRS policy ============== 11:43:33 (1761320613) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.182748 s, 91.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340153 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357551 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120358 s, 8.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115209 s, 9.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146318 s, 7.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158446 s, 6.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15581 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144447 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.168223 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172797 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170583 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156375 s, 6.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166931 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180036 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154054 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191877 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724399 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245732 s, 42.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426935 s, 24.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0434282 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349776 s, 30.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380585 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355857 s, 29.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321546 s, 32.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0524 s, 20.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332025 s, 31.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0373628 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031418 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329462 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0579053 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903989 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00527615 s, 199 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff9d3ae00bf000.lock_unused_count=1 removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.191098 s, 87.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0658498 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0862274 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105853 s, 9.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122664 s, 8.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131749 s, 8.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109413 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128811 s, 8.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131384 s, 8.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12389 s, 8.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125396 s, 8.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131449 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112641 s, 9.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109954 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136764 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141641 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142383 s, 7.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319644 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277823 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0439729 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204563 s, 51.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109471 s, 95.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0397726 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039055 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0396426 s, 26.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260736 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263198 s, 39.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0455913 s, 23.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0577221 s, 18.2 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101951 s, 103 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0682847 s, 15.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=2 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186221 s, 56.3 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0621325 s, 16.9 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (6s) == sanityn test 77c: check ORR NRS policy ================ 11:43:39 (1761320619) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.204779 s, 81.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0714507 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0938856 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103595 s, 10.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116292 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12673 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103079 s, 10.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134113 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129922 s, 8.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10609 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119236 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130185 s, 8.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108158 s, 9.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14342 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10538 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112406 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134866 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264677 s, 39.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208206 s, 50.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271579 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0428124 s, 24.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260229 s, 40.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270263 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318929 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298244 s, 35.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273138 s, 38.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339412 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117075 s, 89.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335897 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00456217 s, 230 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299885 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227018 s, 46.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244762 s, 42.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=2 removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.159102 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305324 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0722339 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0636673 s, 16.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0899992 s, 11.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0805644 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0756162 s, 13.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0809578 s, 13.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0881348 s, 11.9 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0740049 s, 14.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0640482 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0992867 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0802473 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0803813 s, 13.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9d3ae00bf000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131976 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106288 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1056 s, 9.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207478 s, 50.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345202 s, 30.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017316 s, 60.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032498 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215334 s, 48.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270394 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342286 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167351 s, 62.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297913 s, 35.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030589 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317641 s, 33.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301259 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301879 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077275 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109816 s, 95.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151563 s, 69.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.187395 s, 89.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285244 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370932 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0804974 s, 13.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110465 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137943 s, 7.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137471 s, 7.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124782 s, 8.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153445 s, 6.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144804 s, 7.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137648 s, 7.6 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148672 s, 7.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157824 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137526 s, 7.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.162071 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169663 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180439 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317025 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271997 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221648 s, 47.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096327 s, 109 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261533 s, 40.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139219 s, 75.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00473208 s, 222 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015091 s, 69.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0585837 s, 17.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118326 s, 88.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815425 s, 129 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554256 s, 189 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0455309 s, 23.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0412589 s, 25.4 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0508468 s, 20.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0409217 s, 25.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=4 removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (8s) == sanityn test 77d: check TRR nrs policy ================ 11:43:47 (1761320627) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.285093 s, 58.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0631504 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0665362 s, 15.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0937277 s, 11.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0985467 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109039 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100047 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114334 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103367 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0948728 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.099229 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110685 s, 9.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100458 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110794 s, 9.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111187 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107344 s, 9.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121263 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021874 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307634 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217202 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029244 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0431818 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353167 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0571441 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0577968 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0575435 s, 18.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0452799 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0552968 s, 19.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0552072 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0617648 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0562057 s, 18.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0512262 s, 20.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0644467 s, 16.3 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.207209 s, 81.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0539288 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.085121 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130861 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106544 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126833 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116691 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129693 s, 8.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9d3ae00bf000.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151913 s, 6.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180065 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198754 s, 5.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171686 s, 6.1 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206718 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142397 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.20413 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215328 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.234025 s, 4.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250584 s, 41.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227589 s, 46.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570574 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601667 s, 174 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555317 s, 189 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920667 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0593646 s, 17.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0663593 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553884 s, 189 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.004097 s, 256 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.042285 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304294 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308049 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379176 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027153 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0479848 s, 21.9 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.221061 s, 75.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0654617 s, 16.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0782672 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0783704 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325639 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0584923 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0759903 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105643 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0763118 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100552 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125433 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.168453 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163272 s, 6.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.168309 s, 6.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157573 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145057 s, 7.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9d3ae00bf000.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193208 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279178 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00310791 s, 337 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0742089 s, 14.1 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0700361 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0750689 s, 14.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351375 s, 29.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0614783 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00379447 s, 276 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0561643 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757265 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.038623 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318959 s, 32.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275279 s, 38.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248613 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210424 s, 49.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182972 s, 57.3 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (9s) == sanityn test 77e: check TBF NID nrs policy ============ 11:43:56 (1761320636) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.204.39@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.178087 s, 94.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0700761 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0660639 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0650073 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0841611 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0890104 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11488 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113419 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0814371 s, 12.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134773 s, 7.8 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108072 s, 9.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140109 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147311 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109322 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134073 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130655 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128214 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150044 s, 69.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341932 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266097 s, 39.4 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370768 s, 28.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303868 s, 34.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253921 s, 41.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363413 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383205 s, 27.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267052 s, 39.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292272 s, 35.9 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293241 s, 35.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290913 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032479 s, 32.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.038497 s, 27.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384255 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389063 s, 27.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.197387 s, 85.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282779 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0422728 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310833 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109633 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0995365 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103207 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152949 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145842 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154773 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159516 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152502 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161103 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130914 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139535 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147891 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145008 s, 7.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=4 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357822 s, 29.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156407 s, 67.0 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219786 s, 47.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348775 s, 30.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193439 s, 54.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0403042 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216617 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0388053 s, 27.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0391145 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0397922 s, 26.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0365995 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261707 s, 40.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0391234 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0396113 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301694 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0438166 s, 23.9 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.162093 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0589384 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0671522 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0816278 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0787313 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.080607 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0906247 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0962226 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106951 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114907 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107923 s, 9.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124453 s, 8.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121772 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137652 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145401 s, 7.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128803 s, 8.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9d3ae00bf000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118024 s, 8.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025956 s, 40.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264648 s, 39.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271076 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271764 s, 38.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293407 s, 35.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746879 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127185 s, 82.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215166 s, 48.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317739 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00517099 s, 203 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335623 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012175 s, 86.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0365707 s, 28.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927468 s, 113 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109776 s, 95.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139499 s, 75.2 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.170786 s, 98.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0434667 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103139 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102973 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11336 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116967 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108664 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124509 s, 8.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119323 s, 8.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109802 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120598 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116328 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136022 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137478 s, 7.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9d3ae00bf000.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151466 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143359 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164553 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191837 s, 54.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205015 s, 51.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281201 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328781 s, 31.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426245 s, 24.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239895 s, 43.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181677 s, 57.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283193 s, 37.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0367336 s, 28.5 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260971 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370673 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271109 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00394365 s, 266 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372502 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0401692 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648601 s, 162 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' PASS 77e (11s) == sanityn test 77f: check TBF JobID nrs policy ========== 11:44:07 (1761320647) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.226268 s, 74.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0385002 s, 27.2 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0372661 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0873589 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100789 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134764 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107782 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136893 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131168 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133711 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124038 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133743 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125869 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139875 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135669 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154469 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135005 s, 7.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=3 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181837 s, 57.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266791 s, 39.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088667 s, 118 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170629 s, 61.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685353 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027634 s, 37.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00462575 s, 227 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00478611 s, 219 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0563585 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00354311 s, 296 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0560454 s, 18.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338174 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0707161 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283538 s, 37.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189498 s, 55.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150672 s, 69.6 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.179322 s, 93.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324231 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.045236 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364951 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0849358 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11666 s, 9.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129624 s, 8.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107489 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113629 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122303 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103688 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143111 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123536 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143384 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13207 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119504 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134491 s, 7.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=6 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145395 s, 72.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190063 s, 55.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226175 s, 46.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116065 s, 90.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333488 s, 31.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603262 s, 174 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112055 s, 93.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314835 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974168 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00351501 s, 298 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00384791 s, 273 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820481 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673703 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00323327 s, 324 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00344953 s, 304 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00461095 s, 227 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.177267 s, 94.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0573132 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0513931 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0688811 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0549398 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.060705 s, 17.3 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0688937 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0590486 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0805816 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0793053 s, 13.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15122 s, 6.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191718 s, 5.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172632 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193616 s, 5.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.21102 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166763 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196223 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00277184 s, 378 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0487387 s, 21.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0565101 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0661503 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0819448 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0518172 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00352577 s, 297 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0621406 s, 16.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0505023 s, 20.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0585517 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0666898 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032923 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0565591 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0568282 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271151 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229303 s, 45.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.212904 s, 78.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294654 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312758 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0381443 s, 27.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105859 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117911 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11162 s, 9.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0805511 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11382 s, 9.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10568 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120818 s, 8.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114947 s, 9.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12603 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134826 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111467 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11093 s, 9.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135078 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848816 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232577 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015125 s, 69.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00324709 s, 323 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123931 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100785 s, 10.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0884036 s, 11.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0476166 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00342831 s, 306 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380998 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349392 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0445552 s, 23.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346163 s, 30.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288439 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233494 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151741 s, 69.1 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' PASS 77f (11s) == sanityn test 77g: Change TBF type directly ============ 11:44:18 (1761320658) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (5s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 11:44:24 (1761320664) oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg439-client: oleg439-server: ssh exited with exit code 2 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg439-client: oleg439-server: ssh exited with exit code 12 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg439-client: oleg439-server: ssh exited with exit code 12 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg439-client: oleg439-server: ssh exited with exit code 12 PASS 77h (5s) == sanityn test 77i: Change rank of TBF rule ============= 11:44:29 (1761320669) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (13s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 11:44:42 (1761320682) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.258324 s, 64.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.062847 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0558957 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0674365 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306248 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0912636 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0806981 s, 13.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161579 s, 6.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15844 s, 6.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139465 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163452 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161271 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183572 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206607 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203325 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201614 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186436 s, 5.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0390564 s, 26.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211091 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028153 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243575 s, 43.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242483 s, 43.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253878 s, 41.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264929 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297464 s, 35.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306878 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303132 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312482 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336753 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350097 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379615 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386409 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0445444 s, 23.5 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.06748 s, 20.7 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.521 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (55s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 11:45:37 (1761320737) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.703455 s, 23.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11147 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118106 s, 8.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136619 s, 7.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106336 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140318 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113986 s, 9.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176578 s, 5.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14506 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.324263 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.377666 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.401886 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.372051 s, 2.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.417972 s, 2.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.423154 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.427801 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.443786 s, 2.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0852188 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0821958 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108868 s, 9.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109937 s, 9.5 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100055 s, 10.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106764 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0853717 s, 12.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0891608 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0873021 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0920778 s, 11.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0924376 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0917764 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0959948 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0940866 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0950848 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0977766 s, 10.7 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.7808 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9085 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.684911 s, 24.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128181 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16521 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140533 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141077 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17536 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16213 s, 6.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172227 s, 6.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177376 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.337889 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.351649 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.380016 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.3957 s, 2.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.391157 s, 2.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.376236 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.407505 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.379791 s, 2.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109845 s, 9.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116204 s, 9.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113657 s, 9.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116353 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1232 s, 8.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121993 s, 8.6 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12188 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120229 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123952 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122155 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125266 s, 8.4 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137635 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124315 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126454 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126723 s, 8.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126928 s, 8.3 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.7396 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9618 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (138s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 11:47:55 (1761320875) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.233962 s, 71.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0414837 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398714 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0833578 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.079554 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128749 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129215 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0965019 s, 10.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122638 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115385 s, 9.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117922 s, 8.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138869 s, 7.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116677 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151514 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152936 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123224 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145761 s, 7.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164003 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00431804 s, 243 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00500803 s, 209 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00493709 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597748 s, 175 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274029 s, 38.3 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0408302 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0432052 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00356652 s, 294 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261232 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339028 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352048 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185624 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666264 s, 157 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228224 s, 45.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998705 s, 105 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.15642 s, 20.3 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.83546 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.204.39@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.204.39@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.222395 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03164 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0390204 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.096446 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0899402 s, 11.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134944 s, 7.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136159 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127943 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139142 s, 7.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149071 s, 7.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139618 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145636 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153688 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154985 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133391 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223744 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213742 s, 4.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213322 s, 49.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333907 s, 31.4 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291432 s, 36.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227498 s, 46.1 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03937 s, 26.6 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313816 s, 33.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323289 s, 32.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320284 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307582 s, 34.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024378 s, 43.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233523 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317575 s, 33.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0404794 s, 25.9 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034161 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331001 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398608 s, 26.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.12544 s, 20.5 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.78798 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.204.39@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.229159 s, 73.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323762 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0411386 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101283 s, 10.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0978873 s, 10.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112353 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108811 s, 9.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113311 s, 9.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1141 s, 9.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114677 s, 9.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124157 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0974841 s, 10.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0994264 s, 10.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104962 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105334 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101475 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119192 s, 8.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00471641 s, 222 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184984 s, 56.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105152 s, 99.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303669 s, 34.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00402996 s, 260 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00402985 s, 260 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00423086 s, 248 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00418902 s, 250 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254585 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00413749 s, 253 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250153 s, 41.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326278 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0048792 s, 215 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00501601 s, 209 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067484 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.042053 s, 24.9 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.04116 s, 20.8 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.92745 s, 21.3 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.377161 s, 44.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265294 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0492907 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0708907 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0680463 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0675443 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0581805 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0672538 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0611976 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143087 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169023 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158495 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190364 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.346685 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.347029 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.383411 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.392287 s, 2.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205884 s, 50.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00454017 s, 231 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193626 s, 54.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137892 s, 76.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179215 s, 58.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348302 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0046269 s, 227 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00431671 s, 243 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271999 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00405858 s, 258 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00542294 s, 193 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648443 s, 162 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896196 s, 117 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00545144 s, 192 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00501048 s, 209 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00423213 s, 248 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.84372 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.76998 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.00666 s, 20.9 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.79001 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.680408 s, 24.7 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302334 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0547788 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0734037 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0568361 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0734305 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0552413 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0630549 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0660523 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.336076 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.354417 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.386205 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.387621 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.397069 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.375449 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.398253 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.405135 s, 2.6 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136867 s, 76.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989332 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282503 s, 37.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018566 s, 56.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145113 s, 72.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255071 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020579 s, 51.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023336 s, 44.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181883 s, 57.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215194 s, 48.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217272 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226553 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0434151 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024067 s, 43.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026496 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271813 s, 38.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.5711 s, 5.4 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.4881 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.216847 s, 77.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326842 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301508 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440673 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0687147 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0975472 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.098538 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0760667 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0846056 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0994213 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11156 s, 9.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.096517 s, 10.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100081 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111919 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101779 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0885712 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105756 s, 9.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183702 s, 57.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252902 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324233 s, 32.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320648 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034673 s, 30.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281117 s, 37.3 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328501 s, 31.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0430598 s, 24.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316936 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0356805 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311762 s, 33.6 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323715 s, 32.4 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0359491 s, 29.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030854 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102607 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0470923 s, 22.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.97797 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.76926 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.367373 s, 45.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245401 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0417974 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251387 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0491714 s, 21.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224273 s, 46.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0501561 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321589 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375944 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141736 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173367 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172743 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186917 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.3334 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.343378 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.395093 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.375401 s, 2.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132361 s, 79.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319743 s, 32.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137832 s, 76.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217358 s, 48.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181455 s, 57.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248273 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190717 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202404 s, 51.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196046 s, 53.5 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343652 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144181 s, 72.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224074 s, 46.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271554 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028433 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00543588 s, 193 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311227 s, 33.7 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg439-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg439-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.81817 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.75808 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.86241 s, 10.6 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.76928 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (391s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 11:54:26 (1761321266) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (4s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 11:54:30 (1761321270) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg439-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 3.47496 s, 302 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg439-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 40.0335 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (51s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 11:55:21 (1761321321) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.150252 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.037852 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0462041 s, 22.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0561903 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0575304 s, 18.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0486376 s, 21.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0585222 s, 17.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.068233 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425503 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0445692 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0599112 s, 17.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9d3ae00bf000.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0859836 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0897948 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113997 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0976065 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124285 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101534 s, 10.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985501 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02342 s, 44.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106136 s, 98.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121241 s, 86.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130131 s, 80.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304342 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147728 s, 71.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02361 s, 44.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220055 s, 47.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293328 s, 35.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272842 s, 38.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233174 s, 45.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315752 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244134 s, 43.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305516 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272398 s, 38.5 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.09189 s, 20.6 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.95055 s, 21.2 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.174334 s, 96.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0526244 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0455905 s, 23.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0576135 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0736065 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0620073 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0836654 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0718373 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112625 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10818 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0945234 s, 11.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142078 s, 7.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130741 s, 8.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218284 s, 4.8 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.237858 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.333978 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.344009 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207235 s, 50.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150533 s, 69.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165631 s, 63.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226542 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313121 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215198 s, 48.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025106 s, 41.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216369 s, 48.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216528 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243446 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029551 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250979 s, 41.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253222 s, 41.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316651 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296821 s, 35.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292009 s, 35.9 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg439-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg439-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.01986 s, 20.9 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.96132 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (76s) == sanityn test 77o: Changing rank should not panic ====== 11:56:37 (1761321397) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (4s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 11:56:41 (1761321401) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_policies=fifo PASS 77q (46s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 11:57:27 (1761321447) mds.MDS.mdt.nrs_policies=tbf oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg439-client: oleg439-server: ssh exited with exit code 36 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg439-client: oleg439-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (15s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 11:57:42 (1761321462) oleg439-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device pdsh@oleg439-client: oleg439-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (4s) == sanityn test 79: xattr: intent error ================== 11:57:46 (1761321466) File: /mnt/lustre/d79.sanityn Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505430 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 11:57:46.000000000 -0400 Modify: 2025-10-24 11:57:46.000000000 -0400 Change: 2025-10-24 11:57:46.000000000 -0400 Birth: 2025-10-24 11:57:47.000000000 -0400 fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (13s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 11:57:59 (1761321479) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 11:58:00 (1761321480) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 11:58:02 (1761321482) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 11:58:03 (1761321483) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 11:58:04 (1761321484) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 11:58:05 (1761321485) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7119 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7119 PASS 82 (3s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 11:58:08 (1761321488) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 11:58:10 (1761321490) fail_loc=0x8000060b PASS 84 (9s) == sanityn test 90: open/create and unlink striped directory ========================================================== 11:58:18 (1761321498) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 11:58:19 (1761321499) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 11:58:20 (1761321500) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (2s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 11:58:22 (1761321502) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2644 0xa54 0 1 2624 0xa40 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2625 0xa41 0 0 2645 0xa55 0 rc1=0 and rc2=0 PASS 93 (9s) == sanityn test 94: signal vs CP callback race =========== 11:58:31 (1761321511) osc.lustre-OST0000-osc-ffff9d3ac752c000.idle_timeout=0 osc.lustre-OST0000-osc-ffff9d3ae00bf000.idle_timeout=0 osc.lustre-OST0001-osc-ffff9d3ac752c000.idle_timeout=0 osc.lustre-OST0001-osc-ffff9d3ae00bf000.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0772308 s, 106 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 3.09496 s, 1.3 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5135: 284451 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0241914 s, 169 kB/s osc.lustre-OST0000-osc-ffff9d3ac752c000.idle_timeout=debug osc.lustre-OST0000-osc-ffff9d3ae00bf000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9d3ac752c000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9d3ae00bf000.idle_timeout=debug PASS 94 (11s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 11:58:42 (1761321522) llite.lustre-ffff9d3ac752c000.fast_read=0 llite.lustre-ffff9d3ae00bf000.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB, 12 KiB) copied, 0.00314605 s, 3.9 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff9d3ac752c000.fast_read=1 llite.lustre-ffff9d3ae00bf000.fast_read=1 PASS 95b (9s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 11:58:51 (1761321531) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 11:58:52 (1761321532) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0047074 s, 870 kB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (3s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 11:58:55 (1761321535) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0307924 s, 68.1 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (3s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 11:58:58 (1761321538) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0340663 s, 61.6 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (2s) == sanityn test 100e: DoM: read on open and file size ==== 11:59:00 (1761321540) 1+0 records in 1+0 records out 12000 bytes (12 kB, 12 KiB) copied, 0.00352757 s, 3.4 MB/s PASS 100e (3s) == sanityn test 101a: Discard DoM data on unlink ========= 11:59:03 (1761321543) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000681658 s, 6.0 MB/s PASS 101a (3s) == sanityn test 101b: Discard DoM data on rename ========= 11:59:06 (1761321546) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000642386 s, 6.4 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 11:59:09 (1761321549) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000634625 s, 6.5 MB/s PASS 101c (4s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 11:59:14 (1761321554) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1761321555 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1761321558 Finishing test test23 at 1761321558 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 11:59:22 (1761321562) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 11:59:23 (1761321563) fail_loc=0x416 PASS 105 (49s) == sanityn test 106a: Verify the btime via statx() ======= 12:00:12 (1761321612) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 12:00:13 (1761321613) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00571444 s, 179 kB/s File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 12:00:14.000000000 -0400 Modify: 2025-10-24 12:00:14.000000000 -0400 Change: 2025-10-24 12:00:14.000000000 -0400 Birth: 2025-10-24 12:00:14.000000000 -0400 /mnt/lustre/f106b.sanityn 144115205272505458 -rw-r--r-- 1 0 0 1761321614 1761321614 1761321614 File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 12:00:14.000000000 -0400 Modify: 2025-10-24 12:00:14.000000000 -0400 Change: 2025-10-24 12:00:14.000000000 -0400 Birth: 2025-10-24 12:00:14.000000000 -0400 1761321614 1024 1 PASS 106b (3s) == sanityn test 106c: Verify statx attributes mask ======= 12:00:17 (1761321617) PASS 106c (3s) == sanityn test 107a: Basic grouplock conflict =========== 12:00:20 (1761321620) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.101808 s, 103 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2631 0xa47 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 12:00:24 (1761321624) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.102046 s, 103 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2652 0xa5c 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7119 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) == sanityn test 108a: lseek: parallel updates ============ 12:00:33 (1761321633) 1+0 records in 1+0 records out 10000 bytes (10 kB, 9.8 KiB) copied, 0.00243382 s, 4.1 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 4.37146 s, 1.9 MB/s PASS 108a (7s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 12:00:40 (1761321640) 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 192.168.204.139@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.204.139@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg439-server' oleg439-server: oleg439-server.virtnet: executing load_modules_local oleg439-server: Loading modules from /home/green/git/lustre-release/lustre oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg439-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg439-server: detected 4 online CPUs by sysfs oleg439-server: Force libcfs to create 2 CPU partitions Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre Starting client: oleg439-client.virtnet: -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre2 PASS 109 (685s) == sanityn test 110: do not grant another lock on resend ========================================================== 12:12:05 (1761322325) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: /mnt/lustre/f110.sanityn Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 12:12:06.000000000 -0400 Modify: 2025-10-24 12:12:06.000000000 -0400 Change: 2025-10-24 12:12:06.000000000 -0400 Birth: 2025-10-24 12:12:06.000000000 -0400 fail_loc=0 fail_val=0 Connected clients: oleg439-client.virtnet oleg439-client.virtnet PASS 110 (37s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 12:12:42 (1761322362) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 12:12:43 (1761322363) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 12:12:45 (1761322365) lustre-OST0000-osc-ffff9d3ac7ba4800 active. lustre-OST0001-osc-ffff9d3ac7ba4800 active. lustre-OST0000-osc-ffff9d3ac7ba4800 active. lustre-OST0001-osc-ffff9d3ac7ba4800 active. MGC192.168.204.139@tcp active. PASS 113 (3s) cleanup: ====================================================== == sanityn test complete, duration 7167 sec ============== 12:12:48 (1761322368) Stopping clients: oleg439-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg439-client.virtnet /mnt/lustre2 opts: