-----============= acceptance-small: sanity ============----- Tue Apr 1 13:15:07 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 225 255 256 400a 42a 42c 42b 118c 118d 407 56x 56xa 56xb 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b === sanity: start setup 13:15:12 (1743527712) === oleg216-client.virtnet: executing check_config_client /mnt/lustre oleg216-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg216-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012e1e6000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012e1e6000.idle_timeout=debug disable quota as required oleg216-server: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 13:15:19 (1743527719) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6965] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all == sanity test 60a: llog_test run from kernel module and test llog_reader ========================================================== 13:15:21 (1743527721) SKIP: sanity test_60a missing subtest run-llog.sh SKIP 60a (1s) == sanity test 60b: limit repeated messages from CERROR/CWARN ========================================================== 13:15:22 (1743527722) PASS 60b (3s) == sanity test 60c: unlink file when mds full ============ 13:15:25 (1743527725) create 5000 files - open/close 2109 (time 1743527736.67 total 10.00 last 210.84) - open/close 4134 (time 1743527746.67 total 20.01 last 202.43) total: 5000 open/close in 24.23 seconds: 206.40 ops/second fail_loc=0x80000137 - unlinked 0 (time 1743527751 ; total 0 ; last 0) total: 5000 unlinks in 19 seconds: 263.157898 unlinks/second fail_loc=0 PASS 60c (47s) == sanity test 60d: test printk console message masking == 13:16:12 (1743527772) printk=0 emerg PASS 60d (1s) == sanity test 60e: no space while new llog is being created ========================================================== 13:16:13 (1743527773) fail_loc=0x15b PASS 60e (2s) == sanity test 60f: change debug_path works ============== 13:16:15 (1743527775) debug_path=/tmp/f60f.sanity fail_loc=0x8000050e ls: cannot access /tmp/f60f.sanity*: No such file or directory 0 /tmp/f60f.sanity.1743527776.12471 debug_path=/tmp/lustre-log PASS 60f (2s) == sanity test 60g: transaction abort won't cause MDT hung ========================================================== 13:16:17 (1743527777) /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4758: 13280 Killed ( local index=0; while true; do $LFS setdirstripe -i $(($index % $MDSCOUNT)) -c $MDSCOUNT $DIR/$tdir/subdir$index 2> /dev/null; mkdir $DIR/$tdir/subdir$index 2> /dev/null; rmdir $DIR/$tdir/subdir$index 2> /dev/null; index=$((index + 1)); done ) Started LFSCK on the device lustre-MDT0000: scrub namespace /mnt/lustre/d60g.sanity: subdir117 subdir125 subdir134 subdir15 subdir170 subdir179 subdir198 subdir207 subdir242 subdir251 subdir286 subdir296 subdir306 subdir316 subdir32 subdir335 subdir345 subdir354 subdir372 subdir443 subdir451 subdir460 subdir486 subdir494 subdir529 subdir546 subdir563 subdir57 subdir587 subdir613 subdir622 subdir630 subdir655 subdir687 subdir711 subdir738 subdir757 subdir775 subdir783 subdir819 subdir82 subdir828 subdir865 subdir873 subdir884 subdir99 /mnt/lustre/d60g.sanity/subdir117: /mnt/lustre/d60g.sanity/subdir125: /mnt/lustre/d60g.sanity/subdir134: /mnt/lustre/d60g.sanity/subdir15: /mnt/lustre/d60g.sanity/subdir170: /mnt/lustre/d60g.sanity/subdir179: /mnt/lustre/d60g.sanity/subdir198: /mnt/lustre/d60g.sanity/subdir207: /mnt/lustre/d60g.sanity/subdir242: /mnt/lustre/d60g.sanity/subdir251: /mnt/lustre/d60g.sanity/subdir286: /mnt/lustre/d60g.sanity/subdir296: /mnt/lustre/d60g.sanity/subdir306: /mnt/lustre/d60g.sanity/subdir316: /mnt/lustre/d60g.sanity/subdir32: /mnt/lustre/d60g.sanity/subdir335: /mnt/lustre/d60g.sanity/subdir345: /mnt/lustre/d60g.sanity/subdir354: /mnt/lustre/d60g.sanity/subdir372: /mnt/lustre/d60g.sanity/subdir443: /mnt/lustre/d60g.sanity/subdir451: /mnt/lustre/d60g.sanity/subdir460: /mnt/lustre/d60g.sanity/subdir486: /mnt/lustre/d60g.sanity/subdir494: /mnt/lustre/d60g.sanity/subdir529: /mnt/lustre/d60g.sanity/subdir546: /mnt/lustre/d60g.sanity/subdir563: /mnt/lustre/d60g.sanity/subdir57: /mnt/lustre/d60g.sanity/subdir587: /mnt/lustre/d60g.sanity/subdir613: /mnt/lustre/d60g.sanity/subdir622: /mnt/lustre/d60g.sanity/subdir630: /mnt/lustre/d60g.sanity/subdir655: /mnt/lustre/d60g.sanity/subdir687: /mnt/lustre/d60g.sanity/subdir711: /mnt/lustre/d60g.sanity/subdir738: /mnt/lustre/d60g.sanity/subdir757: /mnt/lustre/d60g.sanity/subdir775: /mnt/lustre/d60g.sanity/subdir783: /mnt/lustre/d60g.sanity/subdir819: /mnt/lustre/d60g.sanity/subdir82: /mnt/lustre/d60g.sanity/subdir828: /mnt/lustre/d60g.sanity/subdir865: /mnt/lustre/d60g.sanity/subdir873: /mnt/lustre/d60g.sanity/subdir884: /mnt/lustre/d60g.sanity/subdir99: PASS 60g (30s) == sanity test 60h: striped directory with missing stripes can be accessed ========================================================== 13:16:47 (1743527807) SKIP: sanity test_60h Need at least 2 MDTs SKIP 60h (1s) SKIP: sanity test_60i skipping SLOW test 60i == sanity test 60j: llog_reader reports corruptions ====== 13:16:48 (1743527808) SKIP: sanity test_60j ldiskfs only test SKIP 60j (1s) == sanity test 61a: mmap() writes don't make sync hang ========================================================================== 13:16:49 (1743527809) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00479644 s, 854 kB/s PASS 61a (1s) == sanity test 61b: mmap() of unstriped file is successful ========================================================== 13:16:50 (1743527810) PASS 61b (2s) == sanity test 63a: Verify oig_wait interruption does not crash ================================================================= 13:16:52 (1743527812) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19581 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19596 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19604 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19611 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19619 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19627 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19635 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19643 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19650 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9792: 19658 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3968 2204672 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 39936 3700736 2% /mnt/lustre[OST:1] filesystem_summary: 7542784 43008 7467008 1% /mnt/lustre pass grant check: client:499646464 server:499646464 PASS 63a (62s) == sanity test 63b: async write errors should be returned to fsync ============================================================= 13:17:54 (1743527874) debug=-1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00351593 s, 1.2 MB/s fail_loc=0x80000406 fsync: Input/output error checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3968 2204672 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 6144 7530496 1% /mnt/lustre pass grant check: client:499646464 server:499646464 PASS 63b (5s) == sanity test 64a: verify filter grant calculations (in kernel) =============================================================== 13:17:59 (1743527879) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3968 2204672 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 6144 7530496 1% /mnt/lustre osc.lustre-OST0000-osc-ffff88012e1e6000.cur_lost_grant_bytes=1703936 osc.lustre-OST0001-osc-ffff88012e1e6000.cur_lost_grant_bytes=3407872 osc.lustre-OST0000-osc-ffff88012e1e6000.cur_grant_bytes=5111808 osc.lustre-OST0001-osc-ffff88012e1e6000.cur_grant_bytes=489422848 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3968 2204672 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 6144 7530496 1% /mnt/lustre pass grant check: client:499646464 server:499646464 PASS 64a (1s) SKIP: sanity test_64b skipping SLOW test 64b == sanity test 64c: verify grant shrink ================== 13:18:01 (1743527881) osc.lustre-OST0000-osc-ffff88012e1e6000.cur_grant_bytes=0 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3968 2204672 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 6144 7530496 1% /mnt/lustre pass grant check: client:497942528 server:497942528 PASS 64c (1s) == sanity test 64d: check grant limit exceed ============= 13:18:02 (1743527882) 1000+0 records in 1000+0 records out 1048576000 bytes (1.0 GB) copied, 5.20674 s, 201 MB/s /home/green/git/lustre-release/lustre/tests/sanity.sh: line 9921: kill: (22755) - No such process checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3968 2204672 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 1027072 2742272 28% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 1030144 6506496 14% /mnt/lustre pass grant check: client:983695360 server:983695360 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete PASS 64d (24s) == sanity test 64e: check grant consumption (no grant allocation) ========================================================== 13:18:26 (1743527906) debug=+cache Stopping client oleg216-client.virtnet /mnt/lustre (opts:)