-----============= acceptance-small: sanity-dom ============----- Tue Sep 8 20:48:22 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky use SANITY_DOM_ONLY='' SANITY_DOM_EXCEPT='' oleg102-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-dom.*ex': No such file or directory only running tests: sanity sanityn excepting tests: === sanity-dom: start setup 20:48:44 (1788914924) === Starting client oleg102-client.virtnet: -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre2 Mount client oleg102-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre2 Started clients oleg102-client.virtnet: 192.168.201.102@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg102-client.virtnet: executing check_config_client /mnt/lustre oleg102-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg102-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff92b6c6231000.idle_timeout=debug osc.lustre-OST0000-osc-ffff92b6d0aa7800.idle_timeout=debug osc.lustre-OST0001-osc-ffff92b6c6231000.idle_timeout=debug osc.lustre-OST0001-osc-ffff92b6d0aa7800.idle_timeout=debug disable quota as required oleg102-server: oleg102-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-dom: finish setup 20:49:22 (1788914962) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8451] 192.168.201.102@tcp:/lustre /mnt/lustre2 lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 20:49:25 (1788914965) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky use SANITY_ONLY='36 39 40 41 42d 42e 43 46 56r 101e 119a 131 150a 155a 155b 155c 155d 207 241 251 150b 150bb 150c 150d 150f 150g 150ia 150ib 150ic' SANITY_EXCEPT='' oleg102-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see CLIENT_VERSION > v2_15_63-134-gdacc4b6d38 (34683217 > 34553734) for LU-15963, go 312 - see CLIENT_VERSION > v2_15_63-239-gab4ede45b4 (34683217 > 34553839) for LU-17856, go 56wa 56xe - see CLIENT_VERSION >= v2_15_7-16-gab522d54ad (34683217 >= 34539280) for LU-16203, go 60i - see CLIENT_VERSION > v2_16_54-54-ga2e3a2f5a3 (34683217 > 34616886) for LU-14590, go 0d - see CLIENT_VERSION >= v2_17_50-196-g63ee4af3bb (34683217 >= 34681540) for LU-19620, go 60b - see CLIENT_VERSION >= v2_17_50-34-g089f438ba9 (34683217 >= 34681378) for LU-19692, go 77k - see CLIENT_VERSION >= v2_17_50-71-g2cbe29c282 (34683217 >= 34681415) for LU-19644, go 150ib - see CLIENT_VERSION >= v2_17_50-72-ge1f272796c (34683217 >= 34681416) for LU-19743, go 27z - see CLIENT_VERSION >= v2_17_52-99-g84242c4358 (34683217 >= 34681955) for LU-20010, go 56aa - see CLIENT_VERSION >= v2_17_55-19-g2868627130 (34683217 >= 34682643) for LU-20435, go 430a - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683217 <= 34618625) for LU-18938, skip 360 - see MDS1_VERSION <= CLIENT_VERSION (34683217 <= 34683217) for LU-18562, go 270a - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683217 < 34486116) for LU-14927, skip 0f - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683217 < 34681754) for LU-12550, skip 216 only running tests: sanity sanityn 36 39 40 41 42d 42e 43 46 56r 101e 119a 131 150a 155a 155b 155c 155d 207 241 251 150b 150bb 150c 150d 150f 150g 150ia 150ib 150ic excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 360 0f 216 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 === sanity: start setup 20:49:51 (1788914991) === Stopping clients: oleg102-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg102-client.virtnet /mnt/lustre2 opts: oleg102-client.virtnet: executing check_config_client /mnt/lustre oleg102-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg102-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff92b6c6231000.idle_timeout=debug osc.lustre-OST0001-osc-ffff92b6c6231000.idle_timeout=debug disable quota as required oleg102-server: oleg102-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 20:50:34 (1788915034) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f11136] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=all == sanity test 36a: MDS utime check (mknod, utime) ======= 20:50:41 (1788915041) utime: good mknod times 1788915042 <= 1788915043 <= 1788915043 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (9s) == sanity test 36b: OST utime check (open, utime) ======== 20:50:49 (1788915049) utime: good utime mtimes 100000, atime 200000 PASS 36b (7s) == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 20:50:57 (1788915057) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d36 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1788915059 <= 1788915060 <= 1788915060 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (9s) == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 20:51:06 (1788915066) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (9s) == sanity test 36e: utime on non-owned file (should return error) ========================================================== 20:51:15 (1788915075) striped dir -i0 -c2 -H crush /mnt/lustre/d36e.sanity running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (10s) == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 20:51:25 (1788915085) striped dir -i0 -c2 -H crush /mnt/lustre/d36f.sanity fail_loc=0x80000214 Tue Sep 8 20:51:27 EDT 2026 1788915087 Tue Sep 8 20:51:29 EDT 2026 1788915089 PASS 36f (9s) == sanity test 36g: FMD cache expiry =============================================================================== 20:51:34 (1788915094) striped dir -i0 -c2 -H crush /mnt/lustre/d36g.sanity FMD max age: 30s FMD before: 4 FMD after: 0 PASS 36g (54s) == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 20:52:28 (1788915148) striped dir -i0 -c2 -H all_char /mnt/lustre/d36h.sanity fail_loc=0x80000227 Tue Sep 8 20:52:30 EDT 2026 1788915150 Tue Sep 8 20:52:31 EDT 2026 1788915151 PASS 36h (8s) == sanity test 36i: change mtime on striped directory ==== 20:52:36 (1788915156) striped dir -i0 -c2 -H crush2 /mnt/lustre/d36i.sanity PASS 36i (8s) == sanity test 39a: mtime changed on create ============== 20:52:44 (1788915164) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (9s) == sanity test 39b: mtime change on open, link, unlink, rename ========================================================== 20:52:53 (1788915173) striped dir -i1 -c1 -H all_char /mnt/lustre/d39b.sanity repeat after cancel_lru_locks PASS 39b (10s) == sanity test 39c: mtime change on rename =============== 20:53:03 (1788915183) repeat after cancel_lru_locks PASS 39c (11s) == sanity test 39d: create, utime, stat ================== 20:53:14 (1788915194) repeat after cancel_lru_locks PASS 39d (6s) == sanity test 39e: create, stat, utime, stat ============ 20:53:20 (1788915200) repeat after cancel_lru_locks PASS 39e (7s) == sanity test 39f: create, stat, sleep, utime, stat ===== 20:53:27 (1788915207) repeat after cancel_lru_locks PASS 39f (9s) == sanity test 39g: write, chmod, stat =================== 20:53:37 (1788915217) repeat after cancel_lru_locks PASS 39g (9s) == sanity test 39h: write, utime within one second, stat ========================================================== 20:53:46 (1788915226) repeat after cancel_lru_locks PASS 39h (8s) == sanity test 39i: write, rename, stat ================== 20:53:54 (1788915234) repeat after cancel_lru_locks PASS 39i (9s) == sanity test 39j: write, rename, close, stat =========== 20:54:03 (1788915243) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.11136 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 PASS 39j (17s) == sanity test 39k: write, utime, close, stat ============ 20:54:20 (1788915260) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.11136 repeat after cancel_lru_locks PASS 39k (11s) == sanity test 39l: directory atime update =============== 20:54:31 (1788915271) PASS 39l (20s) == sanity test 39m: test atime and mtime before 1970 ===== 20:54:51 (1788915291) repeat after cancel_lru_locks PASS 39m (10s) == sanity test 39n: check that O_NOATIME is honored ====== 20:55:01 (1788915301) 1+0 records in 1+0 records out PASS 39n (22s) == sanity test 39o: directory cached attributes updated after create ========================================================== 20:55:23 (1788915323) a b PASS 39o (9s) == sanity test 39p: remote directory cached attributes updated after create ================================================================== 20:55:32 (1788915332) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d39p.sanity/d39p.sanity striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d39p.sanity/d39p.sanity/remote_dir1 striped dir -i1 -c2 -H all_char /mnt/lustre/d39p.sanity/d39p.sanity/remote_dir2 remote_dir1 remote_dir2 PASS 39p (9s) == sanity test 39r: lazy atime update on OST ============= 20:55:41 (1788915341) SKIP: sanity test_39r ldiskfs only test SKIP 39r (4s) == sanity test 39q: close won't zero out atime =========== 20:55:45 (1788915345) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.11136 PASS 39q (8s) == sanity test 39s: relatime is supported ================ 20:55:53 (1788915353) 192.168.201.102@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg102-client.virtnet /mnt/lustre (opts:) Starting client: oleg102-client.virtnet: -o relatime 192.168.201.102@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg102-client.virtnet /mnt/lustre (opts:) Starting client: oleg102-client.virtnet: -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre PASS 39s (18s) == sanity test 39u: stat race ============================ 20:56:12 (1788915372) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183861 s, 5.7 MB/s fail_loc=0x80001434 PASS 39u (23s) == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 20:56:34 (1788915394) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0187692 s, 218 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (7s) == sanity test 41: test small file write + fstat =============================================================================== 20:56:41 (1788915401) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (7s) == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 20:56:49 (1788915409) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB, 100 KiB) copied, 0.058888 s, 1.7 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 30 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3456 2203648 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 2176 2206464 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre pass grant check: client:6815744 server:6815744 vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 30 PASS 42d (10s) == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 20:56:59 (1788915419) striped dir -i0 -c2 -H crush2 /mnt/lustre/d42e.sanitye - open/close 699 (time 1788915433.62 total 10.02 last 69.74) total: 1000 open/close in 14.59 seconds: 68.56 ops/second - open/close 646 (time 1788915453.75 total 10.01 last 64.53) total: 924 open/close in 14.90 seconds: 62.01 ops/second 1+0 records in 1+0 records out 484442112 bytes (484 MB, 462 MiB) copied, 27.7271 s, 17.5 MB/s osc.lustre-OST0000-osc-ffff92b6ca67f800.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff92b6ca67f800.cur_grant_bytes=488505344 osc.lustre-OST0000-osc-ffff92b6ca67f800.cur_dirty_bytes=1048576 osc.lustre-OST0000-osc-ffff92b6ca67f800.cur_grant_bytes=485621760 osc.lustre-OST0000-osc-ffff92b6ca67f800.rpc_stats=0 osc.lustre-OST0000-osc-ffff92b6ca67f800.rpc_stats= snapshot_time: 1788915629.996168245 secs.nsecs start_time: 1788915622.463461521 secs.nsecs elapsed_time: 7.532706724 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 DIO RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 38 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 1 2 2 2: 0 0 0 | 1 2 5 3: 0 0 0 | 1 2 7 4: 0 0 0 | 1 2 10 5: 0 0 0 | 2 5 15 6: 0 0 0 | 6 15 31 7: 0 0 0 | 7 18 50 8: 0 0 0 | 6 15 65 9: 0 0 0 | 13 34 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 38 100 100 read write RPC latency (us) count % cum % | count % cum % 0: 0 0 0 | 0 0 0 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 0 0 0 32: 0 0 0 | 0 0 0 64: 0 0 0 | 0 0 0 128: 0 0 0 | 0 0 0 256: 0 0 0 | 0 0 0 512: 0 0 0 | 0 0 0 1024: 0 0 0 | 0 0 0 2048: 0 0 0 | 0 0 0 4096: 0 0 0 | 0 0 0 8192: 0 0 0 | 0 0 0 16384: 0 0 0 | 2 5 5 32768: 0 0 0 | 23 60 65 65536: 0 0 0 | 13 34 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3712 2204928 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 60416 3695616 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 63488 7461888 1% /mnt/lustre pass grant check: client:491913216 server:491913216 PASS 42e (266s) == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 21:01:25 (1788915685) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d43A.sanity /home/green/git/lustre-release/lustre/tests/sanity.sh: line 6088: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (10s) == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 21:01:35 (1788915695) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d43a.sanity open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5091: 37169 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (9s) == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 21:01:45 (1788915705) striped dir -i1 -c2 -H crush2 /mnt/lustre/d43b.sanity truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5091: 37763 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (10s) == sanity test 43c: md5sum of copy into lustre =========== 21:01:56 (1788915716) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d43c.sanity bash: OK PASS 43c (8s) == sanity test 46: dirtying a previously written page ========================================================================== 21:02:05 (1788915725) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0225843 s, 181 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00357309 s, 1.1 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00207483 s, 2.0 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 30 vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 30 PASS 46 (9s) == sanity test 56r: check lfs find -size works =========== 21:02:14 (1788915734) striped dir -i0 -c2 -H crush2 /mnt/lustre/d56r.sanity striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d56r.sanity/dir1 striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d56r.sanity/dir2 striped dir -i0 -c2 -H crush /mnt/lustre/d56r.sanity/dir3 PASS 56r (14s) == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 21:02:31 (1788915751) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff92b6ca67f800.max_cached_mb= users: 6 max_cached_mb: 1846 used_mb: 49 unused_mb: 1797 unevict_mb: 0 reclaim_count: 0 max_read_ahead_mb: 256 used_read_ahead_mb: 0 llite.lustre-ffff92b6ca67f800.read_ahead_stats= snapshot_time 1788915839.068505483 secs.nsecs start_time 1788915820.063667645 secs.nsecs elapsed_time 19.004837838 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] readahead_pages 100 samples [pages] 123 123 12300 PASS 101e (103s) resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119a: Short directIO read must return actual read amount ========================================================== 21:04:17 (1788915857) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (11s) == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 21:04:28 (1788915868) PASS 131a (10s) == sanity test 131b: test append writev ================== 21:04:38 (1788915878) /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 3145728 OK /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 5767168 OK PASS 131b (10s) == sanity test 131c: test read/write on file w/o objects ========================================================== 21:04:48 (1788915888) Write error: Bad file descriptor (rc = -1, len = 1048576) PASS 131c (12s) == sanity test 131d: test short read ===================== 21:05:00 (1788915900) PASS 131d (9s) == sanity test 131e: test read hitting hole ============== 21:05:10 (1788915910) PASS 131e (10s) == sanity test 150a: truncate/append tests =============== 21:05:21 (1788915921) 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.000856457 s, 7.1 MB/s Stopping client oleg102-client.virtnet /mnt/lustre (opts:) Starting client: oleg102-client.virtnet: -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre Filesystem 1024-blocks Used Available Capacity Mounted on 192.168.201.102@tcp:/lustre 7542784 7168 7531520 1% /mnt/lustre sleep 5 for ZFS MDS Waiting for MDT destroys to complete PASS 150a (24s) == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 21:05:45 (1788915945) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150b need >= 2.13.57 and ldiskfs for fallocate SKIP 150b (5s) == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 21:05:50 (1788915950) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150bb need >= 2.13.57 and ldiskfs for fallocate SKIP 150bb (4s) == sanity test 150c: Verify fallocate Size and Blocks ==== 21:05:55 (1788915955) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150c need >= 2.13.57 and ldiskfs for fallocate SKIP 150c (4s) == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 21:05:59 (1788915959) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150d need >= 2.13.57 and ldiskfs for fallocate SKIP 150d (5s) == sanity test 150f: Verify fallocate punch functionality ========================================================== 21:06:04 (1788915964) SKIP: sanity test_150f LU-14160: punch mode is not implemented on OSD ZFS SKIP 150f (4s) == sanity test 150g: Verify fallocate punch on large range ========================================================== 21:06:08 (1788915968) SKIP: sanity test_150g LU-14160: punch mode is not implemented on OSD ZFS SKIP 150g (5s) == sanity test 150ia: Verify fallocate zero-range ZERO functionality ========================================================== 21:06:14 (1788915974) SKIP: sanity test_150ia zero-range mode is not implemented on OSD ZFS SKIP 150ia (5s) == sanity test 150ib: Verify fallocate zero-range PREALLOC functionality ========================================================== 21:06:18 (1788915978) SKIP: sanity test_150ib zero-range mode is not implemented on OSD ZFS SKIP 150ib (5s) == sanity test 150ic: Verify fallocate LARGE zero PREALLOC functionality ========================================================== 21:06:23 (1788915983) SKIP: sanity test_150ic zero-range mode is not implemented on OSD ZFS SKIP 150ic (5s) == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 21:06:28 (1788915988) oleg102-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg102-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg102-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg102-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 oleg102-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg102-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.00414289 s, 1.5 MB/s oleg102-server: error: set_param: setting : Invalid argument pdsh@oleg102-client: oleg102-server: ssh exited with exit code 22 oleg102-server: error: set_param: setting : Invalid argument pdsh@oleg102-client: oleg102-server: ssh exited with exit code 22 PASS 155a (17s) == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 21:06:45 (1788916005) oleg102-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg102-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg102-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg102-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 oleg102-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg102-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.000932322 s, 6.5 MB/s oleg102-server: error: set_param: setting : Invalid argument pdsh@oleg102-client: oleg102-server: ssh exited with exit code 22 oleg102-server: error: set_param: setting : Invalid argument pdsh@oleg102-client: oleg102-server: ssh exited with exit code 22 PASS 155b (17s) == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 21:07:03 (1788916023) oleg102-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg102-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg102-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg102-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 oleg102-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg102-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.00125707 s, 4.8 MB/s oleg102-server: error: set_param: setting : Invalid argument pdsh@oleg102-client: oleg102-server: ssh exited with exit code 22 oleg102-server: error: set_param: setting : Invalid argument pdsh@oleg102-client: oleg102-server: ssh exited with exit code 22 PASS 155c (18s) == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 21:07:21 (1788916041) oleg102-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg102-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg102-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg102-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 oleg102-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg102-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB, 6.0 KiB) copied, 0.00037507 s, 16.3 MB/s oleg102-server: error: set_param: setting : Invalid argument pdsh@oleg102-client: oleg102-server: ssh exited with exit code 22 oleg102-server: error: set_param: setting : Invalid argument pdsh@oleg102-client: oleg102-server: ssh exited with exit code 22 PASS 155d (18s) == sanity test 207a: can refresh layout at glimpse ======= 21:07:41 (1788916061) 8+0 records in 8+0 records out 32768 bytes (33 kB, 32 KiB) copied, 0.0769575 s, 426 kB/s fail_loc=0x170 PASS 207a (11s) == sanity test 207b: can refresh layout at open ========== 21:07:53 (1788916073) 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0116425 s, 704 kB/s fail_loc=0x171 checksum is 0829f71740aab1ab98b33eae21dee122 /mnt/lustre/f207b.sanity PASS 207b (12s) == sanity test 241a: bio vs dio ========================== 21:08:08 (1788916088) 1+0 records in 1+0 records out 40960 bytes (41 kB, 40 KiB) copied, 0.0285212 s, 1.4 MB/s -rw-r--r-- 1 root root 40960 Sep 8 21:08 /mnt/lustre/f241a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff92b6d11e9000.lock_unused_count=2 PASS 241a (162s) == sanity test 241b: dio vs dio ========================== 21:10:50 (1788916250) 1+0 records in 1+0 records out 40960 bytes (41 kB, 40 KiB) copied, 0.0316024 s, 1.3 MB/s -rw-r--r-- 1 root root 40960 Sep 8 21:10 /mnt/lustre/f241b.sanity PASS 241b (70s) == sanity test 251a: Handling short read and write correctly ========================================================== 21:12:00 (1788916320) fail_loc=0xa0001407 fail_val=1 fail_loc=0xa0001407 fail_val=1 PASS 251a (13s) == sanity test complete, duration 1379 sec =============== 21:12:26 (1788916346) === sanity: start cleanup 21:12:30 (1788916350) === Starting client oleg102-client.virtnet: -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre2 Mount client oleg102-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre2 Started clients oleg102-client.virtnet: 192.168.201.102@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) Stopping clients: oleg102-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg102-client.virtnet /mnt/lustre2 opts: === sanity: finish cleanup 21:12:46 (1788916366) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS sanity (1411s) == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 21:12:56 (1788916376) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky use SANITYN_ONLY='1 2 4 5 6 7 8 9 10 11 12 14 17 19 20 23 27 39 51a 51c 51d 107' SANITYN_EXCEPT='' oleg102-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory only running tests: sanity sanityn 1 2 4 5 6 7 8 9 10 11 12 14 17 19 20 23 27 39 51a 51c 51d 107 excepting tests: 40a skipping tests SLOW=no: 33a === sanityn: start setup 21:13:24 (1788916404) === Starting client oleg102-client.virtnet: -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre2 Mount client oleg102-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre2 Started clients oleg102-client.virtnet: 192.168.201.102@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg102-client.virtnet: executing check_config_client /mnt/lustre oleg102-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg102-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff92b6ca8a2800.idle_timeout=debug osc.lustre-OST0000-osc-ffff92b6d11e9000.idle_timeout=debug osc.lustre-OST0001-osc-ffff92b6ca8a2800.idle_timeout=debug osc.lustre-OST0001-osc-ffff92b6d11e9000.idle_timeout=debug disable quota as required oleg102-server: oleg102-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 21:14:05 (1788916445) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0362438 s, 28.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f65197] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 21:14:08 (1788916448) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (8s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 21:14:16 (1788916456) -rw-r--r-- 1 root root 0 Sep 8 21:14 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (8s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 21:14:24 (1788916464) -rw-r--r-- 1 root root 0 Sep 8 21:14 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (8s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 21:14:32 (1788916472) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (8s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 21:14:40 (1788916480) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (10s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 21:14:51 (1788916491) total 2 -rwxrwxrwx 1 root root 0 Sep 8 21:14 f2a -rwxrwxrwx 1 root root 0 Sep 8 21:14 f2b total 2 -rwxrwxrwx 1 root root 0 Sep 8 21:14 f2a -rwxrwxrwx 1 root root 0 Sep 8 21:14 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.00588534 s, 87.0 kB/s PASS 2e (12s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 21:15:02 (1788916502) /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has type file OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has perms 0777 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by user #500 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by group #500 OK Can't lstat /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn: No such file or directory PASS 2f (9s) == sanityn test 2g: check blocks update on sync write ==== 21:15:12 (1788916512) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.321365 s, 6.5 MB/s /mnt/lustre/f2g.sanityn has 4109 blocks /mnt/lustre2/f2g.sanityn has 4109 blocks PASS 2g (10s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 21:15:22 (1788916522) PASS 4 (10s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 21:15:32 (1788916532) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (8s) == sanityn test 6: remove of open file on other node ============================================================================ 21:15:40 (1788916540) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (9s) == sanityn test 7: remove of open directory on other node ======================================================================= 21:15:50 (1788916550) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (10s) == sanityn test 8: remove of open special file on other node ==================================================================== 21:15:59 (1788916559) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (8s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 21:16:07 (1788916567) PASS 9a (9s) == sanityn test 9b: append to striped sparse file ======== 21:16:16 (1788916576) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135874 s, 7.7 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.0941544 s, 0.0 kB/s Data read (expecting 'foo'): foo PASS 9b (13s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 21:16:29 (1788916589) 1+0 records in 1+0 records out 1 byte copied, 0.0180264 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0247426 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0320776 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0124347 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.014271 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00948238 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0189344 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0291679 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0301936 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0250144 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0270313 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0350315 s, 0.0 kB/s PASS 10a (12s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 21:16:41 (1788916601) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0083143 s, 369 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0551984 s, 74.2 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.000718492 s, 4.3 MB/s PASS 10b (8s) == sanityn test 11: execution of file opened for write should return error ============================================================== 21:16:49 (1788916609) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d11 multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.65197 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 298: /mnt/lustre2/d11/f: Text file busy PASS 11 (9s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 21:16:58 (1788916618) warning: '-runtime' deprecated, use '-t runtime' instead - link 100 (time 1788916632.10 total 10.05 last 9.95) - link 210 (time 1788916642.16 total 20.11 last 10.93) - link 306 (time 1788916652.18 total 30.13 last 9.58) - link 401 (time 1788916662.21 total 40.17 last 9.47) - link 506 (time 1788916672.31 total 50.27 last 10.40) - link 562 (time 1788916682.36 total 60.32 last 5.57) - link 597 (time 1788916692.44 total 70.39 last 3.47) - link 645 (time 1788916702.47 total 80.43 last 4.78) - link 686 (time 1788916712.72 total 90.67 last 4.00) total: 721 link in 100.10 seconds: 7.20 ops/second using seed 2322374679 running for 100 seconds - stat 382 (time 1788916634 ; total 11 ; last 11) - stat 3519 (time 1788916645 ; total 22 ; last 11) - stat 6224 (time 1788916656 ; total 33 ; last 11) - stat 9038 (time 1788916667 ; total 44 ; last 11) - stat 10000 (time 1788916671 ; total 48 ; last 4) - stat 10430 (time 1788916682 ; total 59 ; last 11) - stat 10534 (time 1788916693 ; total 70 ; last 11) - stat 10617 (time 1788916704 ; total 81 ; last 11) - stat 10701 (time 1788916715 ; total 92 ; last 11) total: 10973 stats in 100 seconds: 109.730003 stats/second - unlinked 0 (time 1788916673 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile721) error: No such file or directory total: 720 unlinks in 84 seconds: 8.571428 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (78438) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (78440) - No such process PASS 12 (147s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 21:19:25 (1788916765) striped dir -i0 -c2 -H all_char /mnt/lustre/d14aa.sanityn multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.65197 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 333: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5091: 79052 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (10s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 21:19:35 (1788916775) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14ab.sanityn open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5091: 79643 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (9s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 21:19:44 (1788916784) striped dir -i0 -c2 -H all_char /mnt/lustre/d14b.sanityn truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 348: 80235 Terminated $DIR1/$tdir/sleep 60 PASS 14b (9s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 21:19:53 (1788916793) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14c.sanityn cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 360: 80830 Terminated $DIR1/$tdir/sleep 60 PASS 14c (10s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 21:20:03 (1788916803) striped dir -i0 -c2 -H crush /mnt/lustre/d14d.sanityn chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 371: 81426 Terminated $DIR1/$tdir/sleep 60 PASS 14d (15s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 21:20:18 (1788916818) fail_loc=0x8000030a PASS 17 (14s) == sanityn test 19: test concurrent uncached read races ========================================================================= 21:20:32 (1788916832) oleg102-server: error: get_param: param_path 'osd-*/lustre-MDT*/read_cache_enable': No such file or directory pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (5s) == sanityn test 20: test extra readahead page left in cache ============================================================== 21:20:38 (1788916838) striped dir -i0 -c2 -H crush /mnt/lustre/d20.sanityn PASS 20 (8s) == sanityn test 23: others should see updated atime while another read============================================================== 21:20:45 (1788916845) now is 1788916849 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.65197 new atime is 1788916910 PASS 23 (71s) == sanityn test 27: align non-overlapping extent locks from request ============================================================= 21:21:56 (1788916916) dd 1 started 4+0 records in 4+0 records out 16793600 bytes (17 MB, 16 MiB) copied, 0.735866 s, 22.8 MB/s dd 2 started 1+0 records in 1+0 records out 15728640 bytes (16 MB, 15 MiB) copied, 0.505997 s, 31.1 MB/s 1+0 records in 1+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0278907 s, 294 kB/s dd 3 finished PASS 27 (12s) == sanityn test 39a: file mtime does not change after rename ========================================================== 21:22:09 (1788916929) repeat after cancel_lru_locks PASS 39a (6s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 21:22:15 (1788916935) repeat after cancel_lru_locks PASS 39b (7s) == sanityn test 39c: check truncate mtime update ================================================================================ 21:22:22 (1788916942) repeat after cancel_lru_locks PASS 39c (8s) == sanityn test 39d: sync write should update mtime ====== 21:22:30 (1788916950) fail_loc=0x411 fail_loc=0 PASS 39d (7s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 21:22:37 (1788916957) 0+1 records in 0+1 records out 158 bytes copied, 0.0227402 s, 6.9 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3690: kill: (87900) - No such process PASS 51a (8s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 21:22:45 (1788916965) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0399987 s, 25.6 kB/s PASS 51c (12s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 21:22:58 (1788916978) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0422436 s, 24.8 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (7s) == sanityn test 107a: Basic grouplock conflict =========== 21:23:06 (1788916986) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.311019 s, 33.7 MB/s /mnt/lustre/f107a.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_mdt_index: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x2c0000401:0x1e9:0x0] } multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.65197 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.65197 First grouplock blocks second one PASS 107a (9s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 21:23:15 (1788916995) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.284592 s, 36.8 MB/s /mnt/lustre/f107b.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_mdt_index: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x280000401:0x1eb:0x0] } multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.65197 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (13s) cleanup: ====================================================== == sanityn test complete, duration 631 sec =============== 21:23:29 (1788917009) === sanityn: start cleanup 21:23:31 (1788917011) === Stopping clients: oleg102-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg102-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 21:23:37 (1788917017) === PASS sanityn (645s) == sanity-dom test complete, duration 2117 sec =========== 21:23:42 (1788917022) === sanity-dom: start cleanup 21:23:43 (1788917023) === Stopping clients: oleg102-client.virtnet /mnt/lustre2 (opts:) === sanity-dom: finish cleanup 21:23:45 (1788917025) ===