-----============= acceptance-small: sanity ============----- Mon Aug 31 14:31:13 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg116-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see CLIENT_VERSION > v2_15_63-134-gdacc4b6d38 (34682934 > 34553734) for LU-15963, go 312 - see CLIENT_VERSION > v2_15_63-239-gab4ede45b4 (34682934 > 34553839) for LU-17856, go 56wa 56xe - see CLIENT_VERSION >= v2_15_7-16-gab522d54ad (34682934 >= 34539280) for LU-16203, go 60i - see CLIENT_VERSION > v2_16_54-54-ga2e3a2f5a3 (34682934 > 34616886) for LU-14590, go 0d - see CLIENT_VERSION >= v2_17_50-196-g63ee4af3bb (34682934 >= 34681540) for LU-19620, go 60b - see CLIENT_VERSION >= v2_17_50-34-g089f438ba9 (34682934 >= 34681378) for LU-19692, go 77k - see CLIENT_VERSION >= v2_17_50-71-g2cbe29c282 (34682934 >= 34681415) for LU-19644, go 150ib - see CLIENT_VERSION >= v2_17_50-72-ge1f272796c (34682934 >= 34681416) for LU-19743, go 27z - see CLIENT_VERSION >= v2_17_52-99-g84242c4358 (34682934 >= 34681955) for LU-20010, go 56aa - see CLIENT_VERSION >= v2_17_55-19-g2868627130 (34682934 >= 34682643) for LU-20435, go 430a - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682934 <= 34618625) for LU-18938, skip 360 - see MDS1_VERSION <= CLIENT_VERSION (34682934 <= 34682934) for LU-18562, go 270a - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682934 < 34486116) for LU-14927, skip 0f - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682934 < 34681754) for LU-12550, skip 216 excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 === sanity: start setup 14:31:44 (1788201104) === oleg116-client.virtnet: executing check_config_client /mnt/lustre oleg116-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg116-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9a9147cea000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9a9147cea000.idle_timeout=debug disable quota as required oleg116-server: oleg116-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 14:32:25 (1788201145) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7623] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=all == sanity test 60a: llog_test run from kernel module and test llog_reader ========================================================== 14:32:33 (1788201153) SKIP: sanity test_60a missing subtest run-llog.sh SKIP 60a (6s) == sanity test 60b: limit repeated messages from CERROR/CWARN ========================================================== 14:32:39 (1788201159) PASS 60b (9s) == sanity test 60c: unlink file when mds full ============ 14:32:48 (1788201168) create 5000 files - open/close 572 (time 1788201183.60 total 10.02 last 57.07) - open/close 1059 (time 1788201193.63 total 20.05 last 48.58) - open/close 1559 (time 1788201203.65 total 30.07 last 49.91) - open/close 2129 (time 1788201213.65 total 40.07 last 56.97) - open/close 2657 (time 1788201223.67 total 50.09 last 52.71) - open/close 3198 (time 1788201233.67 total 60.09 last 54.07) - open/close 3721 (time 1788201243.67 total 70.09 last 52.29) - open/close 4252 (time 1788201253.68 total 80.10 last 53.06) - open/close 4780 (time 1788201263.70 total 90.12 last 52.73) total: 5000 open/close in 94.30 seconds: 53.02 ops/second fail_loc=0x80000137 - unlinked 0 (time 1788201272 ; total 0 ; last 0) total: 5000 unlinks in 67 seconds: 74.626869 unlinks/second fail_loc=0 PASS 60c (179s) == sanity test 60d: test printk console message masking == 14:35:47 (1788201347) printk=0 emerg PASS 60d (7s) == sanity test 60e: no space while new llog is being created ========================================================== 14:35:55 (1788201355) fail_loc=0x15b PASS 60e (8s) == sanity test 60f: change debug_path works ============== 14:36:03 (1788201363) debug_path=/tmp/f60f.sanity fail_loc=0x8000050e ls: cannot access '/tmp/f60f.sanity*': No such file or directory 0 /tmp/f60f.sanity.1788201365.13893 debug_path=/tmp/lustre-log PASS 60f (8s) == sanity test 60g: transaction abort won't cause MDT hung ========================================================== 14:36:11 (1788201371) /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5121: 14638 Killed ( local index=0; while true; do $LFS setdirstripe -i $(($index % $MDSCOUNT)) -c $MDSCOUNT $DIR/$tdir/subdir$index 2> /dev/null; mkdir $DIR/$tdir/subdir$index 2> /dev/null; rmdir $DIR/$tdir/subdir$index 2> /dev/null; index=$((index + 1)); done ) Started LFSCK on the device lustre-MDT0000: scrub namespace /mnt/lustre/d60g.sanity: subdir111 subdir118 subdir124 subdir152 subdir171 subdir19 subdir190 subdir201 subdir214 subdir250 subdir287 subdir312 subdir325 subdir332 subdir344 subdir357 subdir364 subdir383 subdir394 subdir40 subdir401 subdir407 subdir427 subdir446 subdir459 subdir479 subdir491 subdir497 subdir502 subdir516 subdir548 subdir556 subdir564 subdir572 subdir579 subdir586 subdir59 subdir614 subdir626 subdir646 subdir72 subdir80 subdir86 /mnt/lustre/d60g.sanity/subdir111: /mnt/lustre/d60g.sanity/subdir118: /mnt/lustre/d60g.sanity/subdir124: /mnt/lustre/d60g.sanity/subdir152: /mnt/lustre/d60g.sanity/subdir171: /mnt/lustre/d60g.sanity/subdir19: /mnt/lustre/d60g.sanity/subdir190: /mnt/lustre/d60g.sanity/subdir201: /mnt/lustre/d60g.sanity/subdir214: /mnt/lustre/d60g.sanity/subdir250: /mnt/lustre/d60g.sanity/subdir287: /mnt/lustre/d60g.sanity/subdir312: /mnt/lustre/d60g.sanity/subdir325: /mnt/lustre/d60g.sanity/subdir332: /mnt/lustre/d60g.sanity/subdir344: /mnt/lustre/d60g.sanity/subdir357: /mnt/lustre/d60g.sanity/subdir364: /mnt/lustre/d60g.sanity/subdir383: /mnt/lustre/d60g.sanity/subdir394: /mnt/lustre/d60g.sanity/subdir40: /mnt/lustre/d60g.sanity/subdir401: /mnt/lustre/d60g.sanity/subdir407: /mnt/lustre/d60g.sanity/subdir427: /mnt/lustre/d60g.sanity/subdir446: /mnt/lustre/d60g.sanity/subdir459: /mnt/lustre/d60g.sanity/subdir479: /mnt/lustre/d60g.sanity/subdir491: /mnt/lustre/d60g.sanity/subdir497: /mnt/lustre/d60g.sanity/subdir502: /mnt/lustre/d60g.sanity/subdir516: /mnt/lustre/d60g.sanity/subdir548: /mnt/lustre/d60g.sanity/subdir556: /mnt/lustre/d60g.sanity/subdir564: /mnt/lustre/d60g.sanity/subdir572: /mnt/lustre/d60g.sanity/subdir579: /mnt/lustre/d60g.sanity/subdir586: /mnt/lustre/d60g.sanity/subdir59: /mnt/lustre/d60g.sanity/subdir614: /mnt/lustre/d60g.sanity/subdir626: /mnt/lustre/d60g.sanity/subdir646: /mnt/lustre/d60g.sanity/subdir72: /mnt/lustre/d60g.sanity/subdir80: /mnt/lustre/d60g.sanity/subdir86: PASS 60g (108s) == sanity test 60h: striped directory with missing stripes can be accessed ========================================================== 14:37:59 (1788201479) SKIP: sanity test_60h Need at least 2 MDTs SKIP 60h (3s) SKIP: sanity test_60i skipping SLOW test 60i == sanity test 60j: llog_reader reports corruptions ====== 14:38:04 (1788201484) SKIP: sanity test_60j ldiskfs only test SKIP 60j (4s) == sanity test 61a: mmap() writes don't make sync hang ========================================================================== 14:38:08 (1788201488) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0162435 s, 252 kB/s PASS 61a (8s) == sanity test 61b: mmap() of unstriped file is successful ========================================================== 14:38:17 (1788201497) PASS 61b (7s) == sanity test 63a: Verify oig_wait interruption does not crash ================================================================= 14:38:24 (1788201504) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20034 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20038 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20042 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20045 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20049 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20053 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20057 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20061 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20065 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11010: 20069 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2432 2206208 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3757056 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 12288 7524352 1% /mnt/lustre pass grant check: client:129499136 server:129499136 PASS 63a (72s) == sanity test 63b: async write errors should be returned to fsync ============================================================= 14:39:36 (1788201576) debug=-1 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0260559 s, 157 kB/s fail_loc=0x80000406 fsync: Input/output error checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2560 2206080 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7532544 1% /mnt/lustre pass grant check: client:129499136 server:129499136 PASS 63b (14s) == sanity test 63c: test sync_on_close=1 ================= 14:39:51 (1788201591) llite.lustre-ffff9a9147cea000.sync_on_close=1 total: 20 open/close in 1.31 seconds: 15.22 ops/second total 202 -rw-r--r-- 1 root root 90112 Aug 31 14:40 f63c.sanity-1 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-0 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-1 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-10 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-11 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-12 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-13 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-14 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-15 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-16 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-17 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-18 -rw-r--r-- 1 root root 7 Aug 31 14:39 f63c.sanity-empty-19 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-2 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-3 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-4 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-5 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-6 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-7 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-8 -rw-r--r-- 1 root root 6 Aug 31 14:39 f63c.sanity-empty-9 error: set_param: setting /sys/kernel/debug/lnet/debug=rpctrace+dlmtrace+inode+entry: Invalid argument error: set_param: setting 'debug'='rpctrace+dlmtrace+inode+entry': Invalid argument 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 2.76763 s, 6.1 MB/s llite.lustre-ffff9a9147cea000.sync_on_close=0 PASS 63c (24s) == sanity test 64a: verify filter grant calculations (in kernel) =============================================================== 14:40:15 (1788201615) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2560 2206080 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 20480 7518208 1% /mnt/lustre osc.lustre-OST0000-osc-ffff9a9147cea000.cur_grant_bytes=103940096 osc.lustre-OST0001-osc-ffff9a9147cea000.cur_grant_bytes=149946368 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2560 2206080 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 20480 7518208 1% /mnt/lustre pass grant check: client:253886464 server:253886464 PASS 64a (11s) SKIP: sanity test_64b skipping SLOW test 64b == sanity test 64c: verify grant shrink ================== 14:40:28 (1788201628) osc.lustre-OST0000-osc-ffff9a9147cea000.cur_grant_bytes=0 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2560 2206080 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 20480 7518208 1% /mnt/lustre pass grant check: client:253886464 server:253886464 PASS 64c (9s) == sanity test 64d: check grant limit exceed ============= 14:40:37 (1788201637) 1000+0 records in 1000+0 records out 1048576000 bytes (1.0 GB, 1000 MiB) copied, 29.5703 s, 35.5 MB/s /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11264: kill: (23627) - No such process checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2560 2206080 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 979968 2700288 27% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 990208 6459392 14% /mnt/lustre pass grant check: client:636747776 server:636747776 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete