-----============= acceptance-small: sanity-dom ============----- Tue Sep 8 20:47:21 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky use SANITY_DOM_ONLY='' SANITY_DOM_EXCEPT='' oleg440-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-dom.*ex': No such file or directory only running tests: sanity sanityn excepting tests: === sanity-dom: start setup 20:47:52 (1788914872) === Starting client oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre2 Mount client oleg440-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre2 Started clients oleg440-client.virtnet: 192.168.204.140@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg440-client.virtnet: executing check_config_client /mnt/lustre oleg440-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg440-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9512c2e3d000.idle_timeout=debug osc.lustre-OST0000-osc-ffff9512c550c800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9512c2e3d000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9512c550c800.idle_timeout=debug disable quota as required oleg440-server: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-dom: finish setup 20:48:37 (1788914917) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8446] 192.168.204.140@tcp:/lustre /mnt/lustre2 lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 20:48:39 (1788914919) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky use SANITY_ONLY='36 39 40 41 42d 42e 43 46 56r 101e 119a 131 150a 155a 155b 155c 155d 207 241 251 150b 150bb 150c 150d 150f 150g 150ia 150ib 150ic' SANITY_EXCEPT='' oleg440-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see CLIENT_VERSION > v2_15_63-134-gdacc4b6d38 (34683217 > 34553734) for LU-15963, go 312 - see CLIENT_VERSION > v2_15_63-239-gab4ede45b4 (34683217 > 34553839) for LU-17856, go 56wa 56xe - see CLIENT_VERSION >= v2_15_7-16-gab522d54ad (34683217 >= 34539280) for LU-16203, go 60i - see CLIENT_VERSION > v2_16_54-54-ga2e3a2f5a3 (34683217 > 34616886) for LU-14590, go 0d - see CLIENT_VERSION >= v2_17_50-196-g63ee4af3bb (34683217 >= 34681540) for LU-19620, go 60b - see CLIENT_VERSION >= v2_17_50-34-g089f438ba9 (34683217 >= 34681378) for LU-19692, go 77k - see CLIENT_VERSION >= v2_17_50-71-g2cbe29c282 (34683217 >= 34681415) for LU-19644, go 150ib - see CLIENT_VERSION >= v2_17_50-72-ge1f272796c (34683217 >= 34681416) for LU-19743, go 27z - see CLIENT_VERSION >= v2_17_52-99-g84242c4358 (34683217 >= 34681955) for LU-20010, go 56aa - see CLIENT_VERSION >= v2_17_55-19-g2868627130 (34683217 >= 34682643) for LU-20435, go 430a - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683217 <= 34618625) for LU-18938, skip 360 - see MDS1_VERSION <= CLIENT_VERSION (34683217 <= 34683217) for LU-18562, go 270a - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683217 < 34486116) for LU-14927, skip 0f - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683217 < 34681754) for LU-12550, skip 216 only running tests: sanity sanityn 36 39 40 41 42d 42e 43 46 56r 101e 119a 131 150a 155a 155b 155c 155d 207 241 251 150b 150bb 150c 150d 150f 150g 150ia 150ib 150ic excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 360 0f 216 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 === sanity: start setup 20:49:07 (1788914947) === Stopping clients: oleg440-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg440-client.virtnet /mnt/lustre2 opts: oleg440-client.virtnet: executing check_config_client /mnt/lustre oleg440-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg440-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9512c2e3d000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9512c2e3d000.idle_timeout=debug disable quota as required oleg440-server: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 20:49:50 (1788914990) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f11129] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=all == sanity test 36a: MDS utime check (mknod, utime) ======= 20:49:55 (1788914995) utime: good mknod times 1788914995 <= 1788914996 <= 1788914996 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (7s) == sanity test 36b: OST utime check (open, utime) ======== 20:50:01 (1788915001) utime: good utime mtimes 100000, atime 200000 PASS 36b (8s) == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 20:50:09 (1788915009) striped dir -i0 -c2 -H crush /mnt/lustre/d36 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1788915010 <= 1788915011 <= 1788915011 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (8s) == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 20:50:17 (1788915017) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (8s) == sanity test 36e: utime on non-owned file (should return error) ========================================================== 20:50:25 (1788915025) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d36e.sanity running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (8s) == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 20:50:33 (1788915033) striped dir -i0 -c2 -H all_char /mnt/lustre/d36f.sanity fail_loc=0x80000214 Tue Sep 8 20:50:35 EDT 2026 1788915035 Tue Sep 8 20:50:36 EDT 2026 1788915037 PASS 36f (9s) == sanity test 36g: FMD cache expiry =============================================================================== 20:50:42 (1788915042) striped dir -i0 -c2 -H crush /mnt/lustre/d36g.sanity FMD max age: 30s FMD before: 4 FMD after: 0 PASS 36g (55s) == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 20:51:37 (1788915097) striped dir -i0 -c2 -H crush2 /mnt/lustre/d36h.sanity fail_loc=0x80000227 Tue Sep 8 20:51:39 EDT 2026 1788915099 Tue Sep 8 20:51:41 EDT 2026 1788915101 PASS 36h (11s) == sanity test 36i: change mtime on striped directory ==== 20:51:49 (1788915109) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d36i.sanity PASS 36i (9s) == sanity test 39a: mtime changed on create ============== 20:51:57 (1788915117) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (10s) == sanity test 39b: mtime change on open, link, unlink, rename ========================================================== 20:52:07 (1788915127) striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d39b.sanity repeat after cancel_lru_locks PASS 39b (10s) == sanity test 39c: mtime change on rename =============== 20:52:17 (1788915137) repeat after cancel_lru_locks PASS 39c (10s) == sanity test 39d: create, utime, stat ================== 20:52:28 (1788915148) repeat after cancel_lru_locks PASS 39d (8s) == sanity test 39e: create, stat, utime, stat ============ 20:52:36 (1788915156) repeat after cancel_lru_locks PASS 39e (8s) == sanity test 39f: create, stat, sleep, utime, stat ===== 20:52:44 (1788915164) repeat after cancel_lru_locks PASS 39f (9s) == sanity test 39g: write, chmod, stat =================== 20:52:53 (1788915173) repeat after cancel_lru_locks PASS 39g (10s) == sanity test 39h: write, utime within one second, stat ========================================================== 20:53:03 (1788915183) repeat after cancel_lru_locks PASS 39h (8s) == sanity test 39i: write, rename, stat ================== 20:53:12 (1788915192) repeat after cancel_lru_locks PASS 39i (10s) == sanity test 39j: write, rename, close, stat =========== 20:53:21 (1788915201) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.11129 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 PASS 39j (18s) == sanity test 39k: write, utime, close, stat ============ 20:53:39 (1788915219) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.11129 repeat after cancel_lru_locks PASS 39k (12s) == sanity test 39l: directory atime update =============== 20:53:51 (1788915231) PASS 39l (20s) == sanity test 39m: test atime and mtime before 1970 ===== 20:54:11 (1788915251) repeat after cancel_lru_locks PASS 39m (9s) == sanity test 39n: check that O_NOATIME is honored ====== 20:54:20 (1788915260) 1+0 records in 1+0 records out PASS 39n (22s) == sanity test 39o: directory cached attributes updated after create ========================================================== 20:54:42 (1788915282) a b PASS 39o (9s) == sanity test 39p: remote directory cached attributes updated after create ================================================================== 20:54:51 (1788915291) striped dir -i1 -c2 -H crush2 /mnt/lustre/d39p.sanity/d39p.sanity striped dir -i1 -c2 -H crush /mnt/lustre/d39p.sanity/d39p.sanity/remote_dir1 striped dir -i1 -c2 -H crush /mnt/lustre/d39p.sanity/d39p.sanity/remote_dir2 remote_dir1 remote_dir2 PASS 39p (9s) == sanity test 39r: lazy atime update on OST ============= 20:55:00 (1788915300) SKIP: sanity test_39r ldiskfs only test SKIP 39r (4s) == sanity test 39q: close won't zero out atime =========== 20:55:04 (1788915304) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.11129 PASS 39q (8s) == sanity test 39s: relatime is supported ================ 20:55:12 (1788915312) 192.168.204.140@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg440-client.virtnet /mnt/lustre (opts:) Starting client: oleg440-client.virtnet: -o relatime 192.168.204.140@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg440-client.virtnet /mnt/lustre (opts:) Starting client: oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre PASS 39s (21s) == sanity test 39u: stat race ============================ 20:55:33 (1788915333) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147397 s, 7.1 MB/s fail_loc=0x80001434 PASS 39u (23s) == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 20:55:56 (1788915356) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0369369 s, 111 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (7s) == sanity test 41: test small file write + fstat =============================================================================== 20:56:03 (1788915363) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (8s) == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 20:56:12 (1788915372) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB, 100 KiB) copied, 0.0951646 s, 1.1 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 30 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3456 2205184 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 2176 2206464 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre pass grant check: client:6815744 server:6815744 vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 30 PASS 42d (12s) == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 20:56:23 (1788915383) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d42e.sanitye - open/close 498 (time 1788915398.26 total 10.00 last 49.78) - open/close 949 (time 1788915408.27 total 20.01 last 45.07) total: 1000 open/close in 20.78 seconds: 48.13 ops/second - open/close 570 (time 1788915424.94 total 10.01 last 56.95) total: 924 open/close in 15.70 seconds: 58.84 ops/second 1+0 records in 1+0 records out 484442112 bytes (484 MB, 462 MiB) copied, 23.7796 s, 20.4 MB/s osc.lustre-OST0000-osc-ffff9512c7c54000.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff9512c7c54000.cur_grant_bytes=485097472 osc.lustre-OST0000-osc-ffff9512c7c54000.cur_dirty_bytes=1048576 osc.lustre-OST0000-osc-ffff9512c7c54000.cur_grant_bytes=485359616 osc.lustre-OST0000-osc-ffff9512c7c54000.rpc_stats=0 osc.lustre-OST0000-osc-ffff9512c7c54000.rpc_stats= snapshot_time: 1788915607.754114845 secs.nsecs start_time: 1788915599.831615542 secs.nsecs elapsed_time: 7.922499303 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 DIO RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 38 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 1 2 2 2: 0 0 0 | 1 2 5 3: 0 0 0 | 1 2 7 4: 0 0 0 | 1 2 10 5: 0 0 0 | 1 2 13 6: 0 0 0 | 1 2 15 7: 0 0 0 | 7 18 34 8: 0 0 0 | 12 31 65 9: 0 0 0 | 13 34 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 38 100 100 read write RPC latency (us) count % cum % | count % cum % 0: 0 0 0 | 0 0 0 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 0 0 0 32: 0 0 0 | 0 0 0 64: 0 0 0 | 0 0 0 128: 0 0 0 | 0 0 0 256: 0 0 0 | 0 0 0 512: 0 0 0 | 0 0 0 1024: 0 0 0 | 0 0 0 2048: 0 0 0 | 0 0 0 4096: 0 0 0 | 0 0 0 8192: 0 0 0 | 0 0 0 16384: 0 0 0 | 13 33 33 32768: 0 0 0 | 26 66 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3712 2204928 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 14336 3741696 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 17408 7507968 1% /mnt/lustre pass grant check: client:491913216 server:491913216 PASS 42e (284s) == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 21:01:07 (1788915667) striped dir -i1 -c2 -H all_char /mnt/lustre/d43A.sanity /home/green/git/lustre-release/lustre/tests/sanity.sh: line 6088: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (10s) == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 21:01:17 (1788915677) striped dir -i1 -c2 -H crush2 /mnt/lustre/d43a.sanity open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5091: 37165 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (10s) == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 21:01:27 (1788915687) striped dir -i1 -c2 -H crush /mnt/lustre/d43b.sanity truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5091: 37758 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (10s) == sanity test 43c: md5sum of copy into lustre =========== 21:01:37 (1788915697) striped dir -i1 -c2 -H crush /mnt/lustre/d43c.sanity bash: OK PASS 43c (9s) == sanity test 46: dirtying a previously written page ========================================================================== 21:01:47 (1788915707) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0105737 s, 387 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.002795 s, 1.5 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00163008 s, 2.5 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 30 vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 30 PASS 46 (9s) == sanity test 56r: check lfs find -size works =========== 21:01:57 (1788915717) striped dir -i0 -c2 -H crush /mnt/lustre/d56r.sanity striped dir -i0 -c2 -H crush /mnt/lustre/d56r.sanity/dir1 striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d56r.sanity/dir2 striped dir -i0 -c2 -H all_char /mnt/lustre/d56r.sanity/dir3 PASS 56r (16s) == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 21:02:16 (1788915736) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff9512c7c54000.max_cached_mb= users: 6 max_cached_mb: 1846 used_mb: 49 unused_mb: 1797 unevict_mb: 0 reclaim_count: 0 max_read_ahead_mb: 256 used_read_ahead_mb: 0 llite.lustre-ffff9512c7c54000.read_ahead_stats= snapshot_time 1788915825.804265223 secs.nsecs start_time 1788915803.207206563 secs.nsecs elapsed_time 22.597058660 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] readahead_pages 100 samples [pages] 123 123 12300 PASS 101e (108s) resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119a: Short directIO read must return actual read amount ========================================================== 21:04:05 (1788915845) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (10s) == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 21:04:17 (1788915857) PASS 131a (11s) == sanity test 131b: test append writev ================== 21:04:28 (1788915868) /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 3145728 OK /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 5767168 OK PASS 131b (11s) == sanity test 131c: test read/write on file w/o objects ========================================================== 21:04:39 (1788915879) Write error: Bad file descriptor (rc = -1, len = 1048576) PASS 131c (9s) == sanity test 131d: test short read ===================== 21:04:49 (1788915889) PASS 131d (9s) == sanity test 131e: test read hitting hole ============== 21:04:59 (1788915899) PASS 131e (10s) == sanity test 150a: truncate/append tests =============== 21:05:09 (1788915909) 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.00100004 s, 6.1 MB/s Stopping client oleg440-client.virtnet /mnt/lustre (opts:) Starting client: oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre Filesystem 1024-blocks Used Available Capacity Mounted on 192.168.204.140@tcp:/lustre 7542784 7168 7531520 1% /mnt/lustre sleep 5 for ZFS MDS Waiting for MDT destroys to complete PASS 150a (25s) == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 21:05:34 (1788915934) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150b need >= 2.13.57 and ldiskfs for fallocate SKIP 150b (5s) == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 21:05:39 (1788915939) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150bb need >= 2.13.57 and ldiskfs for fallocate SKIP 150bb (4s) == sanity test 150c: Verify fallocate Size and Blocks ==== 21:05:44 (1788915944) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150c need >= 2.13.57 and ldiskfs for fallocate SKIP 150c (4s) == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 21:05:48 (1788915948) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150d need >= 2.13.57 and ldiskfs for fallocate SKIP 150d (5s) == sanity test 150f: Verify fallocate punch functionality ========================================================== 21:05:53 (1788915953) SKIP: sanity test_150f LU-14160: punch mode is not implemented on OSD ZFS SKIP 150f (4s) == sanity test 150g: Verify fallocate punch on large range ========================================================== 21:05:57 (1788915957) SKIP: sanity test_150g LU-14160: punch mode is not implemented on OSD ZFS SKIP 150g (5s) == sanity test 150ia: Verify fallocate zero-range ZERO functionality ========================================================== 21:06:02 (1788915962) SKIP: sanity test_150ia zero-range mode is not implemented on OSD ZFS SKIP 150ia (5s) == sanity test 150ib: Verify fallocate zero-range PREALLOC functionality ========================================================== 21:06:07 (1788915967) SKIP: sanity test_150ib zero-range mode is not implemented on OSD ZFS SKIP 150ib (5s) == sanity test 150ic: Verify fallocate LARGE zero PREALLOC functionality ========================================================== 21:06:13 (1788915973) SKIP: sanity test_150ic zero-range mode is not implemented on OSD ZFS SKIP 150ic (4s) == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 21:06:18 (1788915978) oleg440-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg440-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg440-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg440-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 oleg440-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg440-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.00148938 s, 4.1 MB/s oleg440-server: error: set_param: setting : Invalid argument pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 oleg440-server: error: set_param: setting : Invalid argument pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 PASS 155a (19s) == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 21:06:37 (1788915997) oleg440-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg440-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg440-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg440-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 oleg440-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg440-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.00265724 s, 2.3 MB/s oleg440-server: error: set_param: setting : Invalid argument pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 oleg440-server: error: set_param: setting : Invalid argument pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 PASS 155b (19s) == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 21:06:57 (1788916017) oleg440-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg440-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg440-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg440-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 oleg440-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg440-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.00324537 s, 1.9 MB/s oleg440-server: error: set_param: setting : Invalid argument pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 oleg440-server: error: set_param: setting : Invalid argument pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 PASS 155c (17s) == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 21:07:15 (1788916035) oleg440-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg440-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg440-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg440-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 oleg440-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg440-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.00104314 s, 5.8 MB/s oleg440-server: error: set_param: setting : Invalid argument pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 oleg440-server: error: set_param: setting : Invalid argument pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 PASS 155d (22s) == sanity test 207a: can refresh layout at glimpse ======= 21:07:39 (1788916059) 9+0 records in 9+0 records out 36864 bytes (37 kB, 36 KiB) copied, 0.0417033 s, 884 kB/s fail_loc=0x170 PASS 207a (10s) == sanity test 207b: can refresh layout at open ========== 21:07:50 (1788916070) 8+0 records in 8+0 records out 32768 bytes (33 kB, 32 KiB) copied, 0.0291653 s, 1.1 MB/s fail_loc=0x171 checksum is bb7df04e1b0a2570657527a7e108ae23 /mnt/lustre/f207b.sanity PASS 207b (13s) == sanity test 241a: bio vs dio ========================== 21:08:04 (1788916084) 1+0 records in 1+0 records out 40960 bytes (41 kB, 40 KiB) copied, 0.0500738 s, 818 kB/s -rw-r--r-- 1 root root 40960 Sep 8 21:08 /mnt/lustre/f241a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff9512cba11800.lock_unused_count=1 PASS 241a (166s) == sanity test 241b: dio vs dio ========================== 21:10:51 (1788916251) 1+0 records in 1+0 records out 40960 bytes (41 kB, 40 KiB) copied, 0.02225 s, 1.8 MB/s -rw-r--r-- 1 root root 40960 Sep 8 21:10 /mnt/lustre/f241b.sanity PASS 241b (66s) == sanity test 251a: Handling short read and write correctly ========================================================== 21:11:58 (1788916318) fail_loc=0xa0001407 fail_val=1 fail_loc=0xa0001407 fail_val=1 PASS 251a (13s) == sanity test complete, duration 1418 sec =============== 21:12:20 (1788916340) === sanity: start cleanup 21:12:22 (1788916342) === Starting client oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre2 Mount client oleg440-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre2 Started clients oleg440-client.virtnet: 192.168.204.140@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) Stopping clients: oleg440-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg440-client.virtnet /mnt/lustre2 opts: === sanity: finish cleanup 21:12:37 (1788916357) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS sanity (1447s) == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 21:12:46 (1788916366) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky use SANITYN_ONLY='1 2 4 5 6 7 8 9 10 11 12 14 17 19 20 23 27 39 51a 51c 51d 107' SANITYN_EXCEPT='' oleg440-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory only running tests: sanity sanityn 1 2 4 5 6 7 8 9 10 11 12 14 17 19 20 23 27 39 51a 51c 51d 107 excepting tests: 40a skipping tests SLOW=no: 33a === sanityn: start setup 21:13:16 (1788916396) === Starting client oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre2 Mount client oleg440-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre2 Started clients oleg440-client.virtnet: 192.168.204.140@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg440-client.virtnet: executing check_config_client /mnt/lustre oleg440-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg440-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9512c9e05800.idle_timeout=debug osc.lustre-OST0000-osc-ffff9512cba11800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9512c9e05800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9512cba11800.idle_timeout=debug disable quota as required oleg440-server: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 21:14:14 (1788916454) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634146 s, 16.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f65196] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 21:14:18 (1788916458) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (10s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 21:14:27 (1788916467) -rw-r--r-- 1 root root 0 Sep 8 21:14 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (9s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 21:14:37 (1788916477) -rw-r--r-- 1 root root 0 Sep 8 21:14 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (9s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 21:14:46 (1788916486) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (10s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 21:14:56 (1788916496) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (8s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 21:15:04 (1788916504) total 2 -rwxrwxrwx 1 root root 0 Sep 8 21:14 f2a -rwxrwxrwx 1 root root 0 Sep 8 21:14 f2b total 2 -rwxrwxrwx 1 root root 0 Sep 8 21:14 f2a -rwxrwxrwx 1 root root 0 Sep 8 21:14 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.0409095 s, 12.5 kB/s PASS 2e (9s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 21:15:13 (1788916513) /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has type file OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has perms 0777 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by user #500 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by group #500 OK Can't lstat /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn: No such file or directory PASS 2f (10s) == sanityn test 2g: check blocks update on sync write ==== 21:15:23 (1788916523) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.587579 s, 3.6 MB/s /mnt/lustre/f2g.sanityn has 4109 blocks /mnt/lustre2/f2g.sanityn has 4109 blocks PASS 2g (9s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 21:15:32 (1788916532) PASS 4 (13s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 21:15:45 (1788916545) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (11s) == sanityn test 6: remove of open file on other node ============================================================================ 21:15:56 (1788916556) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (10s) == sanityn test 7: remove of open directory on other node ======================================================================= 21:16:06 (1788916566) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (9s) == sanityn test 8: remove of open special file on other node ==================================================================== 21:16:15 (1788916575) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (7s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 21:16:22 (1788916582) PASS 9a (10s) == sanityn test 9b: append to striped sparse file ======== 21:16:32 (1788916592) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120198 s, 8.7 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.102606 s, 0.0 kB/s Data read (expecting 'foo'): foo PASS 9b (8s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 21:16:41 (1788916601) 1+0 records in 1+0 records out 1 byte copied, 0.0184889 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0346494 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0117288 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0182375 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.010859 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00844232 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0100694 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00925901 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0226305 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0136046 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0213277 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0415041 s, 0.0 kB/s PASS 10a (10s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 21:16:52 (1788916612) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0117869 s, 261 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0438954 s, 93.3 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.000325975 s, 9.4 MB/s PASS 10b (9s) == sanityn test 11: execution of file opened for write should return error ============================================================== 21:17:01 (1788916621) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d11 multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.65196 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 298: /mnt/lustre2/d11/f: Text file busy PASS 11 (9s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 21:17:11 (1788916631) warning: '-runtime' deprecated, use '-t runtime' instead - link 267 (time 1788916644.84 total 10.04 last 26.60) - link 522 (time 1788916654.86 total 20.05 last 25.47) - link 843 (time 1788916664.90 total 30.10 last 31.95) - link 1126 (time 1788916674.92 total 40.12 last 28.24) - link 1466 (time 1788916684.93 total 50.12 last 33.98) - link 1726 (time 1788916694.94 total 60.13 last 25.98) - link 1996 (time 1788916704.96 total 70.15 last 26.93) - link 2250 (time 1788916715.02 total 80.21 last 25.26) - link 2492 (time 1788916725.02 total 90.21 last 24.20) total: 2763 link in 100.01 seconds: 27.63 ops/second using seed 118072572 running for 100 seconds - stat 331 (time 1788916646 ; total 11 ; last 11) - stat 3807 (time 1788916657 ; total 22 ; last 11) - stat 8125 (time 1788916668 ; total 33 ; last 11) - stat 10000 (time 1788916674 ; total 39 ; last 6) - stat 14749 (time 1788916685 ; total 50 ; last 11) - stat 17389 (time 1788916696 ; total 61 ; last 11) - stat 19905 (time 1788916707 ; total 72 ; last 11) - stat 20000 (time 1788916707 ; total 72 ; last 0) - stat 22218 (time 1788916718 ; total 83 ; last 11) - stat 24695 (time 1788916729 ; total 94 ; last 11) total: 26121 stats in 100 seconds: 261.209991 stats/second - unlinked 0 (time 1788916686 ; total 1 ; last 1) unlink(/mnt/lustre2/lockdir/lockfile2763) error: No such file or directory total: 2762 unlinks in 91 seconds: 30.351648 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (78432) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (78435) - No such process PASS 12 (153s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 21:19:45 (1788916785) striped dir -i0 -c2 -H crush /mnt/lustre/d14aa.sanityn multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.65196 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 333: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5091: 79052 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (14s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 21:19:58 (1788916798) striped dir -i0 -c2 -H all_char /mnt/lustre/d14ab.sanityn open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5091: 79644 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (13s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 21:20:12 (1788916812) striped dir -i0 -c2 -H crush /mnt/lustre/d14b.sanityn truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 348: 80236 Terminated $DIR1/$tdir/sleep 60 PASS 14b (10s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 21:20:23 (1788916823) striped dir -i0 -c2 -H all_char /mnt/lustre/d14c.sanityn cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 360: 80832 Terminated $DIR1/$tdir/sleep 60 PASS 14c (10s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 21:20:34 (1788916834) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d14d.sanityn chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 371: 81427 Terminated $DIR1/$tdir/sleep 60 PASS 14d (15s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 21:20:50 (1788916850) fail_loc=0x8000030a PASS 17 (11s) == sanityn test 19: test concurrent uncached read races ========================================================================= 21:21:02 (1788916862) oleg440-server: error: get_param: param_path 'osd-*/lustre-MDT*/read_cache_enable': No such file or directory pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (5s) == sanityn test 20: test extra readahead page left in cache ============================================================== 21:21:07 (1788916867) striped dir -i0 -c2 -H all_char /mnt/lustre/d20.sanityn PASS 20 (8s) == sanityn test 23: others should see updated atime while another read============================================================== 21:21:14 (1788916874) now is 1788916877 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.65196 new atime is 1788916938 PASS 23 (70s) == sanityn test 27: align non-overlapping extent locks from request ============================================================= 21:22:24 (1788916944) dd 1 started 4+0 records in 4+0 records out 16793600 bytes (17 MB, 16 MiB) copied, 1.09222 s, 15.4 MB/s dd 2 started 1+0 records in 1+0 records out 15728640 bytes (16 MB, 15 MiB) copied, 0.716119 s, 22.0 MB/s 1+0 records in 1+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0322001 s, 254 kB/s dd 3 finished PASS 27 (12s) == sanityn test 39a: file mtime does not change after rename ========================================================== 21:22:37 (1788916957) repeat after cancel_lru_locks PASS 39a (6s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 21:22:43 (1788916963) repeat after cancel_lru_locks PASS 39b (7s) == sanityn test 39c: check truncate mtime update ================================================================================ 21:22:50 (1788916970) repeat after cancel_lru_locks PASS 39c (7s) == sanityn test 39d: sync write should update mtime ====== 21:22:57 (1788916977) fail_loc=0x411 fail_loc=0 PASS 39d (5s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 21:23:03 (1788916983) 0+1 records in 0+1 records out 158 bytes copied, 0.013223 s, 11.9 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3690: kill: (87899) - No such process PASS 51a (8s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 21:23:11 (1788916991) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.030196 s, 33.9 kB/s PASS 51c (10s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 21:23:21 (1788917001) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375905 s, 27.9 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (6s) == sanityn test 107a: Basic grouplock conflict =========== 21:23:28 (1788917008) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.311686 s, 33.6 MB/s /mnt/lustre/f107a.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_mdt_index: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x2c0000401:0x1ec:0x0] } multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.65196 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.65196 First grouplock blocks second one PASS 107a (7s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 21:23:35 (1788917015) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.370404 s, 28.3 MB/s /mnt/lustre/f107b.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_mdt_index: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x280000401:0x1ed:0x0] } multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.65196 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (12s) cleanup: ====================================================== == sanityn test complete, duration 661 sec =============== 21:23:49 (1788917029) === sanityn: start cleanup 21:23:50 (1788917030) === Stopping clients: oleg440-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg440-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 21:23:55 (1788917035) === PASS sanityn (673s) == sanity-dom test complete, duration 2195 sec =========== 21:23:59 (1788917039) === sanity-dom: start cleanup 21:24:00 (1788917040) === Stopping clients: oleg440-client.virtnet /mnt/lustre2 (opts:) === sanity-dom: finish cleanup 21:24:03 (1788917043) ===