== sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 13:16:13 (1743527773) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 excepting tests: 42a 42c 42b 118c 118d 407 56x 56xa 56xb 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b === sanity: start setup 13:16:18 (1743527778) === Stopping clients: oleg360-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg360-client.virtnet /mnt/lustre2 opts: oleg360-client.virtnet: executing check_config_client /mnt/lustre oleg360-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg360-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a575000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a575000.idle_timeout=debug disable quota as required oleg360-server: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 13:16:26 (1743527786) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f14105] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all == sanity test 36a: MDS utime check (mknod, utime) ======= 13:16:26 (1743527786) utime: good mknod times 1743527786 <= 1743527787 <= 1743527787 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (2s) == sanity test 36b: OST utime check (open, utime) ======== 13:16:28 (1743527788) utime: good utime mtimes 100000, atime 200000 PASS 36b (2s) == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 13:16:30 (1743527790) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1743527790 <= 1743527791 <= 1743527791 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (2s) == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 13:16:32 (1743527792) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (2s) == sanity test 36e: utime on non-owned file (should return error) ========================================================== 13:16:34 (1743527794) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (1s) == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 13:16:36 (1743527796) fail_loc=0x80000214 Tue Apr 1 13:16:36 EDT 2025 1743527796 Tue Apr 1 13:16:37 EDT 2025 1743527797 PASS 36f (4s) == sanity test 36g: FMD cache expiry =============================================================================== 13:16:39 (1743527799) FMD max age: 30s FMD before: 7 FMD after: 0 PASS 36g (45s) == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 13:17:24 (1743527844) fail_loc=0x80000227 Tue Apr 1 13:17:25 EDT 2025 1743527845 Tue Apr 1 13:17:26 EDT 2025 1743527846 PASS 36h (4s) == sanity test 36i: change mtime on striped directory ==== 13:17:28 (1743527848) SKIP: sanity test_36i needs >= 2 MDTs SKIP 36i (1s) == sanity test 39a: mtime changed on create ============== 13:17:29 (1743527849) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (4s) == sanity test 39b: mtime change on open, link, unlink, rename ================================================================ 13:17:33 (1743527853) repeat after cancel_lru_locks PASS 39b (4s) == sanity test 39c: mtime change on rename ===================================================================================== 13:17:37 (1743527857) repeat after cancel_lru_locks PASS 39c (5s) == sanity test 39d: create, utime, stat ======================================================================================== 13:17:42 (1743527862) repeat after cancel_lru_locks PASS 39d (2s) == sanity test 39e: create, stat, utime, stat ================================================================================== 13:17:44 (1743527864) repeat after cancel_lru_locks PASS 39e (2s) == sanity test 39f: create, stat, sleep, utime, stat =========================================================================== 13:17:46 (1743527866) repeat after cancel_lru_locks PASS 39f (5s) == sanity test 39g: write, chmod, stat ========================================================================================= 13:17:51 (1743527871) repeat after cancel_lru_locks PASS 39g (4s) == sanity test 39h: write, utime within one second, stat ======================================================================= 13:17:55 (1743527875) repeat after cancel_lru_locks PASS 39h (3s) == sanity test 39i: write, rename, stat ======================================================================================== 13:17:58 (1743527878) repeat after cancel_lru_locks PASS 39i (3s) == sanity test 39j: write, rename, close, stat ================================================================================= 13:18:01 (1743527881) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14105 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 PASS 39j (6s) == sanity test 39k: write, utime, close, stat ================================================================================== 13:18:07 (1743527887) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14105 repeat after cancel_lru_locks PASS 39k (4s) == sanity test 39l: directory atime update ===================================================================================== 13:18:11 (1743527891) PASS 39l (8s) == sanity test 39m: test atime and mtime before 1970 ===== 13:18:19 (1743527899) repeat after cancel_lru_locks PASS 39m (4s) == sanity test 39n: check that O_NOATIME is honored ====== 13:18:23 (1743527903) 1+0 records in 1+0 records out PASS 39n (12s) == sanity test 39o: directory cached attributes updated after create ========================================================== 13:18:35 (1743527915) a b PASS 39o (2s) == sanity test 39p: remote directory cached attributes updated after create ================================================================== 13:18:37 (1743527917) SKIP: sanity test_39p needs >= 2 MDTs SKIP 39p (1s) == sanity test 39r: lazy atime update on OST ============= 13:18:38 (1743527918) SKIP: sanity test_39r ldiskfs only test SKIP 39r (1s) == sanity test 39q: close won't zero out atime =========== 13:18:39 (1743527919) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.14105 PASS 39q (1s) == sanity test 39s: relatime is supported ================ 13:18:40 (1743527920) 192.168.203.160@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg360-client.virtnet /mnt/lustre (opts:) Starting client: oleg360-client.virtnet: -o relatime oleg360-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg360-client.virtnet /mnt/lustre (opts:) Starting client: oleg360-client.virtnet: -o user_xattr,flock oleg360-server@tcp:/lustre /mnt/lustre PASS 39s (7s) == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 13:18:47 (1743527927) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00285012 s, 1.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (2s) == sanity test 41: test small file write + fstat =============================================================================== 13:18:49 (1743527929) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (2s) == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 13:18:51 (1743527931) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB) copied, 0.019951 s, 5.1 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 5888 2201216 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 8192 7530496 1% /mnt/lustre pass grant check: client:6815744 server:6815744 PASS 42d (2s) == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 13:18:53 (1743527933) total: 1000 open/close in 2.62 seconds: 381.84 ops/second total: 934 open/close in 2.51 seconds: 372.18 ops/second 1+0 records in 1+0 records out 489684992 bytes (490 MB) copied, 11.8771 s, 41.2 MB/s osc.lustre-OST0000-osc-ffff8800a967e000.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff8800a967e000.cur_grant_bytes=492044288 osc.lustre-OST0000-osc-ffff8800a967e000.cur_dirty_bytes=1048576 osc.lustre-OST0000-osc-ffff8800a967e000.cur_grant_bytes=489029632 osc.lustre-OST0000-osc-ffff8800a967e000.rpc_stats=0 osc.lustre-OST0000-osc-ffff8800a967e000.rpc_stats= snapshot_time: 1743527983.518591603 secs.nsecs start_time: 1743527982.014770114 secs.nsecs elapsed_time: 1.503821489 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 33 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 33 100 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 33 100 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 6400 2202240 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 368640 3400704 10% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 372736 7165952 5% /mnt/lustre pass grant check: client:493748224 server:493748224 PASS 42e (60s) == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 13:19:53 (1743527993) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 5731: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (2s) == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 13:19:55 (1743527995) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4726: 6690 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (3s) == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 13:19:58 (1743527998) truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4726: 7321 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (2s) == sanity test 43c: md5sum of copy into lustre =========== 13:20:00 (1743528000) bash: OK PASS 43c (2s) == sanity test 46: dirtying a previously written page ========================================================================== 13:20:02 (1743528002) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00278683 s, 1.5 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00131963 s, 3.1 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00117434 s, 3.5 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 PASS 46 (2s) == sanity test 56r: check lfs find -size works =========== 13:20:04 (1743528004)