-----============= acceptance-small: sanity ============----- Thu Aug 27 09:53:05 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg259-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see CLIENT_VERSION > v2_15_63-134-gdacc4b6d38 (34683231 > 34553734) for LU-15963, go 312 - see CLIENT_VERSION > v2_15_63-239-gab4ede45b4 (34683231 > 34553839) for LU-17856, go 56wa 56xe - see CLIENT_VERSION >= v2_15_7-16-gab522d54ad (34683231 >= 34539280) for LU-16203, go 60i - see CLIENT_VERSION > v2_16_54-54-ga2e3a2f5a3 (34683231 > 34616886) for LU-14590, go 0d - see CLIENT_VERSION >= v2_17_50-196-g63ee4af3bb (34683231 >= 34681540) for LU-19620, go 60b - see CLIENT_VERSION >= v2_17_50-34-g089f438ba9 (34683231 >= 34681378) for LU-19692, go 77k - see CLIENT_VERSION >= v2_17_50-71-g2cbe29c282 (34683231 >= 34681415) for LU-19644, go 150ib - see CLIENT_VERSION >= v2_17_50-72-ge1f272796c (34683231 >= 34681416) for LU-19743, go 27z - see CLIENT_VERSION >= v2_17_52-99-g84242c4358 (34683231 >= 34681955) for LU-20010, go 56aa - see CLIENT_VERSION >= v2_17_55-19-g2868627130 (34683231 >= 34682643) for LU-20435, go 430a - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683231 <= 34618625) for LU-18938, skip 360 - see MDS1_VERSION <= CLIENT_VERSION (34683231 <= 34683231) for LU-18562, go 270a - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683231 < 34486116) for LU-14927, skip 0f - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683231 < 34681754) for LU-12550, skip 216 excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 === sanity: start setup 09:53:32 (1787838812) === oleg259-client.virtnet: executing check_config_client /mnt/lustre oleg259-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg259-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff975e42dca800.idle_timeout=debug osc.lustre-OST0001-osc-ffff975e42dca800.idle_timeout=debug disable quota as required oleg259-server: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 09:54:08 (1787838848) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7614] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=all == sanity test 60a: llog_test run from kernel module and test llog_reader ========================================================== 09:54:16 (1787838856) SKIP: sanity test_60a missing subtest run-llog.sh SKIP 60a (7s) == sanity test 60b: limit repeated messages from CERROR/CWARN ========================================================== 09:54:23 (1787838863) PASS 60b (11s) == sanity test 60c: unlink file when mds full ============ 09:54:35 (1787838875) create 5000 files - open/close 523 (time 1787838890.78 total 10.01 last 52.26) - open/close 1019 (time 1787838900.80 total 20.02 last 49.53) - open/close 1540 (time 1787838910.80 total 30.02 last 52.08) - open/close 2108 (time 1787838920.82 total 40.04 last 56.69) - open/close 2623 (time 1787838930.82 total 50.05 last 51.47) - open/close 3211 (time 1787838940.83 total 60.05 last 58.79) - open/close 3783 (time 1787838950.84 total 70.06 last 57.13) - open/close 4322 (time 1787838960.84 total 80.06 last 53.90) - open/close 4851 (time 1787838970.84 total 90.07 last 52.86) total: 5000 open/close in 92.68 seconds: 53.95 ops/second fail_loc=0x80000137 - unlinked 0 (time 1787838977 ; total 0 ; last 0) total: 5000 unlinks in 63 seconds: 79.365082 unlinks/second fail_loc=0 PASS 60c (172s) == sanity test 60d: test printk console message masking == 09:57:27 (1787839047) printk=0 emerg PASS 60d (7s) == sanity test 60e: no space while new llog is being created ========================================================== 09:57:35 (1787839055) fail_loc=0x15b PASS 60e (7s) == sanity test 60f: change debug_path works ============== 09:57:43 (1787839063) debug_path=/tmp/f60f.sanity fail_loc=0x8000050e ls: cannot access '/tmp/f60f.sanity*': No such file or directory 0 /tmp/f60f.sanity.1787839064.13890 debug_path=/tmp/lustre-log PASS 60f (7s) == sanity test 60g: transaction abort won't cause MDT hung ========================================================== 09:57:50 (1787839070) /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5174: 14637 Killed ( local index=0; while true; do $LFS setdirstripe -i $(($index % $MDSCOUNT)) -c $MDSCOUNT $DIR/$tdir/subdir$index 2> /dev/null; mkdir $DIR/$tdir/subdir$index 2> /dev/null; rmdir $DIR/$tdir/subdir$index 2> /dev/null; index=$((index + 1)); done ) Started LFSCK on the device lustre-MDT0000: scrub namespace /mnt/lustre/d60g.sanity: subdir102 subdir109 subdir117 subdir152 subdir160 subdir194 subdir201 subdir216 subdir224 subdir237 subdir251 subdir258 subdir271 subdir285 subdir292 subdir298 subdir305 subdir321 subdir334 subdir355 subdir36 subdir375 subdir381 subdir395 subdir402 subdir423 subdir431 subdir437 subdir460 subdir466 subdir489 subdir495 subdir509 subdir518 subdir525 subdir539 subdir546 subdir560 subdir57 subdir581 subdir588 subdir596 subdir6 subdir604 subdir611 subdir618 subdir625 subdir632 subdir640 subdir647 subdir654 subdir66 subdir677 subdir684 subdir692 subdir720 subdir73 subdir89 /mnt/lustre/d60g.sanity/subdir102: /mnt/lustre/d60g.sanity/subdir109: /mnt/lustre/d60g.sanity/subdir117: /mnt/lustre/d60g.sanity/subdir152: /mnt/lustre/d60g.sanity/subdir160: /mnt/lustre/d60g.sanity/subdir194: /mnt/lustre/d60g.sanity/subdir201: /mnt/lustre/d60g.sanity/subdir216: /mnt/lustre/d60g.sanity/subdir224: /mnt/lustre/d60g.sanity/subdir237: /mnt/lustre/d60g.sanity/subdir251: /mnt/lustre/d60g.sanity/subdir258: /mnt/lustre/d60g.sanity/subdir271: /mnt/lustre/d60g.sanity/subdir285: /mnt/lustre/d60g.sanity/subdir292: /mnt/lustre/d60g.sanity/subdir298: /mnt/lustre/d60g.sanity/subdir305: /mnt/lustre/d60g.sanity/subdir321: /mnt/lustre/d60g.sanity/subdir334: /mnt/lustre/d60g.sanity/subdir355: /mnt/lustre/d60g.sanity/subdir36: /mnt/lustre/d60g.sanity/subdir375: /mnt/lustre/d60g.sanity/subdir381: /mnt/lustre/d60g.sanity/subdir395: /mnt/lustre/d60g.sanity/subdir402: /mnt/lustre/d60g.sanity/subdir423: /mnt/lustre/d60g.sanity/subdir431: /mnt/lustre/d60g.sanity/subdir437: /mnt/lustre/d60g.sanity/subdir460: /mnt/lustre/d60g.sanity/subdir466: /mnt/lustre/d60g.sanity/subdir489: /mnt/lustre/d60g.sanity/subdir495: /mnt/lustre/d60g.sanity/subdir509: /mnt/lustre/d60g.sanity/subdir518: /mnt/lustre/d60g.sanity/subdir525: /mnt/lustre/d60g.sanity/subdir539: /mnt/lustre/d60g.sanity/subdir546: /mnt/lustre/d60g.sanity/subdir560: /mnt/lustre/d60g.sanity/subdir57: /mnt/lustre/d60g.sanity/subdir581: /mnt/lustre/d60g.sanity/subdir588: /mnt/lustre/d60g.sanity/subdir596: /mnt/lustre/d60g.sanity/subdir6: /mnt/lustre/d60g.sanity/subdir604: /mnt/lustre/d60g.sanity/subdir611: /mnt/lustre/d60g.sanity/subdir618: /mnt/lustre/d60g.sanity/subdir625: /mnt/lustre/d60g.sanity/subdir632: /mnt/lustre/d60g.sanity/subdir640: /mnt/lustre/d60g.sanity/subdir647: /mnt/lustre/d60g.sanity/subdir654: /mnt/lustre/d60g.sanity/subdir66: /mnt/lustre/d60g.sanity/subdir677: /mnt/lustre/d60g.sanity/subdir684: /mnt/lustre/d60g.sanity/subdir692: /mnt/lustre/d60g.sanity/subdir720: /mnt/lustre/d60g.sanity/subdir73: /mnt/lustre/d60g.sanity/subdir89: PASS 60g (110s) == sanity test 60h: striped directory with missing stripes can be accessed ========================================================== 09:59:40 (1787839180) SKIP: sanity test_60h Need at least 2 MDTs SKIP 60h (3s) SKIP: sanity test_60i skipping SLOW test 60i == sanity test 60j: llog_reader reports corruptions ====== 09:59:45 (1787839185) SKIP: sanity test_60j ldiskfs only test SKIP 60j (5s) == sanity test 61a: mmap() writes don't make sync hang ========================================================================== 09:59:50 (1787839190) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.047926 s, 85.5 kB/s PASS 61a (8s) == sanity test 61b: mmap() of unstriped file is successful ========================================================== 09:59:58 (1787839198) PASS 61b (6s) == sanity test 63a: Verify oig_wait interruption does not crash ================================================================= 10:00:04 (1787839204) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20225 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20235 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20239 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20243 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20247 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20251 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20255 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20259 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20263 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11075: 20267 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 2048 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7529472 1% /mnt/lustre pass grant check: client:149946368 server:149946368 PASS 63a (71s) == sanity test 63b: async write errors should be returned to fsync ============================================================= 10:01:15 (1787839275) debug=-1 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.019336 s, 212 kB/s fail_loc=0x80000406 fsync: Input/output error checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 2048 3765248 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7532544 1% /mnt/lustre pass grant check: client:149946368 server:149946368 PASS 63b (16s) == sanity test 63c: test sync_on_close=1 ================= 10:01:31 (1787839291) llite.lustre-ffff975e42dca800.sync_on_close=1 total: 20 open/close in 2.04 seconds: 9.82 ops/second total 202 -rw-r--r-- 1 root root 90112 Aug 27 10:01 f63c.sanity-1 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-0 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-1 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-10 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-11 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-12 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-13 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-14 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-15 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-16 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-17 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-18 -rw-r--r-- 1 root root 7 Aug 27 10:01 f63c.sanity-empty-19 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-2 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-3 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-4 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-5 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-6 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-7 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-8 -rw-r--r-- 1 root root 6 Aug 27 10:01 f63c.sanity-empty-9 error: set_param: setting /sys/kernel/debug/lnet/debug=rpctrace+dlmtrace+inode+entry: Invalid argument error: set_param: setting 'debug'='rpctrace+dlmtrace+inode+entry': Invalid argument 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 2.55896 s, 6.6 MB/s llite.lustre-ffff975e42dca800.sync_on_close=0 PASS 63c (24s) == sanity test 64a: verify filter grant calculations (in kernel) =============================================================== 10:01:56 (1787839316) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 20480 7518208 1% /mnt/lustre osc.lustre-OST0000-osc-ffff975e42dca800.cur_grant_bytes=168689664 osc.lustre-OST0001-osc-ffff975e42dca800.cur_grant_bytes=105644032 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 20480 7518208 1% /mnt/lustre pass grant check: client:274333696 server:274333696 PASS 64a (8s) SKIP: sanity test_64b skipping SLOW test 64b == sanity test 64c: verify grant shrink ================== 10:02:06 (1787839326) osc.lustre-OST0000-osc-ffff975e42dca800.cur_grant_bytes=0 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 20480 7518208 1% /mnt/lustre pass grant check: client:274333696 server:274333696 PASS 64c (10s) == sanity test 64d: check grant limit exceed ============= 10:02:16 (1787839336) 1000+0 records in 1000+0 records out 1048576000 bytes (1.0 GB, 1000 MiB) copied, 30.7108 s, 34.1 MB/s /home/green/git/lustre-release/lustre/tests/sanity.sh: line 11329: kill: (23839) - No such process checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 998400 2659328 28% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 1008640 6418432 14% /mnt/lustre pass grant check: client:591003648 server:591003648 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete PASS 64d (63s) == sanity test 64e: check grant consumption (no grant allocation) ========================================================== 10:03:19 (1787839399) debug=+cache Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock 192.168.202.159@tcp:/lustre /mnt/lustre fail_loc=0x725 1+0 records in 1+0 records out 962560 bytes (963 kB, 940 KiB) copied, 0.199218 s, 4.8 MB/s fail_loc=0 Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock 192.168.202.159@tcp:/lustre /mnt/lustre fail_loc=0x725 fail_loc=0 PASS 64e (21s) == sanity test 64f: check grant consumption (with grant allocation) ========================================================== 10:03:40 (1787839420) debug=+cache Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock 192.168.202.159@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 1032192 bytes (1.0 MB, 1008 KiB) copied, 0.14261 s, 7.2 MB/s Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock 192.168.202.159@tcp:/lustre /mnt/lustre llite.lustre-ffff975e517d4800.hybrid_io=0 fail_loc=0x50a fail_val=3 1+0 records in 1+0 records out 1032192 bytes (1.0 MB, 1008 KiB) copied, 0.200806 s, 5.1 MB/s fail_loc=0 fail_val=0 PASS 64f (17s) == sanity test 64g: grant shrink on MDT ================== 10:03:57 (1787839437) 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0267379 s, 4.9 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0169304 s, 7.7 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0133722 s, 9.8 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.015356 s, 8.5 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.114794 s, 1.1 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0204263 s, 6.4 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0149322 s, 8.8 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0127347 s, 10.3 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0174957 s, 7.5 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0170793 s, 7.7 MB/s 3932160 grants, 0 pages 3932160 grants, 8 pages 3932160 grants, 8 pages 3932160 grants, 0 pages mdc.lustre-MDT0000-mdc-ffff975e517d4800.grant_shrink_interval=5 0 grants, 8 pages 0 grants, 8 pages 0 grants, 0 pages mdc.lustre-MDT0000-mdc-ffff975e517d4800.grant_shrink_interval=1200 PASS 64g (26s) == sanity test 64h: grant shrink on read ================= 10:04:23 (1787839463) osc.lustre-OST0000-osc-ffff975e517d4800.grant_shrink=1 osc.lustre-OST0000-osc-ffff975e517d4800.grant_shrink_interval=10 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 2.19144 s, 4.8 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0364507 s, 112 kB/s PASS 64h (21s) == sanity test 64i: shrink on reconnect ================== 10:04:44 (1787839484) 64+0 records in 64+0 records out 67108864 bytes (67 MB, 64 MiB) copied, 8.55713 s, 7.8 MB/s fail_loc=0x80000513 fail_val=17 osc.lustre-OST0000-osc-ffff975e517d4800.cur_grant_bytes=64749568B Failing ost1 on oleg259-server Stopping /mnt/lustre-ost1 (opts:) on oleg259-server 10:05:03 (1787839503) shut down facet: ost1 facet_host: oleg259-server facet_failover_host: oleg259-server Failover ost1 to oleg259-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg259-server: oleg259-server.virtnet: executing set_default_debug all all pdsh@oleg259-client: oleg259-server: ssh exited with exit code 1 Started lustre-OST0000 10:05:32 (1787839532) targets are mounted 10:05:32 (1787839532) facet_failover done oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 1.30245 s, 6.4 MB/s PASS 64i (69s) == sanity test 64j: check grants on re-done rpc ========== 10:05:53 (1787839553) fail_loc=0x80000256 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 10240 3757056 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3759104 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 20480 7516160 1% /mnt/lustre pass grant check: client:22544384 server:22544384 PASS 64j (12s) == sanity test 65a: directory with no stripe info ======== 10:06:05 (1787839565) default stripe 1, ost count 2 PASS 65a (8s) == sanity test 65b: directory setstripe -S stripe_size*2 -i 0 -c 1 ========================================================== 10:06:13 (1787839573) dir stripe 1, default stripe 1, ost count 2 PASS 65b (8s) == sanity test 65c: directory setstripe -S stripe_size*4 -i 1 -c 1 ========================================================== 10:06:22 (1787839582) dir stripe 1, default stripe 1, ost count 2 PASS 65c (8s) == sanity test 65d: directory setstripe -S stripe_size -c stripe_count ========================================================== 10:06:31 (1787839591) dir stripe 0, default stripe 1, ost count 2 PASS 65d (8s) == sanity test 65e: directory setstripe defaults ========= 10:06:39 (1787839599) (Default) /mnt/lustre/d65e.sanity default stripe 1, ost count 2 PASS 65e (8s) == sanity test 65f: dir setstripe permission (should return error) ============================================================= 10:06:47 (1787839607) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [/mnt/lustre/d65f.sanityf] lfs setstripe: setstripe error for '/mnt/lustre/d65f.sanityf': Operation not permitted PASS 65f (8s) == sanity test 65g: directory setstripe -d =============== 10:06:55 (1787839615) (Default) /mnt/lustre/d65g.sanity PASS 65g (8s) == sanity test 65h: directory stripe info inherit ============================================================================== 10:07:03 (1787839623) PASS 65h (9s) == sanity test 65i: various tests to set root directory striping ========================================================== 10:07:12 (1787839632) /mnt/lustre stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65a.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f64j.sanity lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2524 0x9dc 0x240000400 /mnt/lustre/f63b.sanity lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2505 0x9c9 0x240000400 /mnt/lustre/d65c.sanity stripe_count: 1 stripe_size: 16777216 pattern: raid0 stripe_offset: 1 /mnt/lustre/d65h.sanity stripe_count: 1 stripe_size: 8388608 pattern: raid0 stripe_offset: 0 /mnt/lustre/d65e.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65g.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f60b.sanity lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2 0x2 0x280000400 /mnt/lustre/d65d.sanity stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65f.sanityf stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f61 lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2504 0x9c8 0x280000400 /mnt/lustre/d60f.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f61b.sanity has no stripe info /mnt/lustre/d63c.sanity stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65b.sanity stripe_count: 1 stripe_size: 8388608 pattern: raid0 stripe_offset: 0 /mnt/lustre lmm_fid: [0x200000007:0x1:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65a.sanity lmm_fid: [0x200000406:0x1d:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f64j.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000406 lmm_object_id: 0x1c lmm_fid: [0x200000406:0x1c:0x0] lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2524 0x9dc 0x240000400 /mnt/lustre/f63b.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000401 lmm_object_id: 0x193f lmm_fid: [0x200000401:0x193f:0x0] lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2505 0x9c9 0x240000400 /mnt/lustre/d65c.sanity lmm_fid: [0x200000406:0x21:0x0] stripe_count: 1 stripe_size: 16777216 pattern: raid0 stripe_offset: 1 /mnt/lustre/d65h.sanity lmm_fid: [0x200000406:0x2c:0x0] stripe_count: 1 stripe_size: 8388608 pattern: raid0 stripe_offset: 0 /mnt/lustre/d65e.sanity lmm_fid: [0x200000406:0x26:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65g.sanity lmm_fid: [0x200000406:0x2a:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f60b.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000401 lmm_object_id: 0x3 lmm_fid: [0x200000401:0x3:0x0] lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2 0x2 0x280000400 /mnt/lustre/d65d.sanity lmm_fid: [0x200000406:0x23:0x0] stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65f.sanityf lmm_fid: [0x200000406:0x29:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f61 lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000401 lmm_object_id: 0x1933 lmm_fid: [0x200000401:0x1933:0x0] lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2504 0x9c8 0x280000400 /mnt/lustre/d60f.sanity lmm_fid: [0x200000401:0x138d:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f61b.sanity has no stripe info /mnt/lustre/d63c.sanity lmm_fid: [0x200000401:0x1940:0x0] stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65b.sanity lmm_fid: [0x200000406:0x1f:0x0] stripe_count: 1 stripe_size: 8388608 pattern: raid0 stripe_offset: 0 PASS 65i (9s) == sanity test 65j: set default striping on root directory (bug 6367)=========================================================== 10:07:21 (1787839641) PASS 65j (8s) == sanity test 65k: validate manual striping works properly with deactivated OSCs ========================================================== 10:07:30 (1787839650) Check OST status: lustre-OST0000-osc-MDT0000 is active lustre-OST0001-osc-MDT0000 is active - open/close 727 (time 1787839668.62 total 10.02 last 72.54) total: 1000 open/close in 14.18 seconds: 70.54 ops/second Deactivate: lustre-OST0000-osc-MDT0000 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/d65k.sanity/0 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 1 -c 1 /mnt/lustre/d65k.sanity/1 - unlinked 0 (time 1787839682 ; total 0 ; last 0) total: 1000 unlinks in 7 seconds: 142.857147 unlinks/second lustre-OST0000-osc-MDT0000 is Activate oleg259-server: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg259-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec - open/close 658 (time 1787839714.83 total 10.01 last 65.73) total: 1000 open/close in 14.67 seconds: 68.17 ops/second Deactivate: lustre-OST0001-osc-MDT0000 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/d65k.sanity/0 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 1 -c 1 /mnt/lustre/d65k.sanity/1 - unlinked 0 (time 1787839729 ; total 0 ; last 0) total: 1000 unlinks in 9 seconds: 111.111115 unlinks/second lustre-OST0001-osc-MDT0000 is Activate oleg259-server: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 oleg259-server: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec PASS 65k (107s) == sanity test 65l: lfs find on -1 stripe dir ================================================================================== 10:09:16 (1787839756) PASS 65l (7s) == sanity test 65m: normal user can't set filesystem default stripe ========================================================== 10:09:23 (1787839763) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-c] [2] [/mnt/lustre] lfs setstripe: setstripe error for '/mnt/lustre': Operation not permitted PASS 65m (7s) == sanity test 65n: don't inherit default layout from root for new subdirectories ========================================================== 10:09:31 (1787839771) Creating new pool test_65n oleg259-server: Pool lustre.test_65n created Adding targets to pool oleg259-server: OST lustre-OST0000_UUID added to pool lustre.test_65n oleg259-server: OST lustre-OST0001_UUID added to pool lustre.test_65n Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' /home/green/git/lustre-release/lustre/utils/lfs getstripe -d /mnt/lustre/d65n.sanity-4 stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 pool: test_65n /home/green/git/lustre-release/lustre/utils/lfs getstripe -d /mnt/lustre stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 pool: test_65n SKIP: sanity test_65n needs >= 2 MDTs Destroy the created pools: test_65n lustre.test_65n oleg259-server: OST lustre-OST0000_UUID removed from pool lustre.test_65n oleg259-server: OST lustre-OST0001_UUID removed from pool lustre.test_65n oleg259-server: Pool lustre.test_65n destroyed SKIP 65n (27s) == sanity test 65o: pool inheritance for mdt component === 10:09:57 (1787839797) Creating new pool test_65o oleg259-server: Pool lustre.test_65o created Adding targets to pool oleg259-server: OST lustre-OST0000_UUID added to pool lustre.test_65o oleg259-server: OST lustre-OST0001_UUID added to pool lustre.test_65o Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' /mnt/lustre/d65o.sanity lcm_layout_gen: 0 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: N/A lcme_mirror_id: N/A lcme_flags: 0 lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 stripe_count: 0 stripe_size: 1048576 pattern: mdt mdt_index: -1 lcme_id: N/A lcme_mirror_id: N/A lcme_flags: 0 lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 pool: test_65o /mnt/lustre/d65o.sanity/dir2 lcm_layout_gen: 0 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: N/A lcme_mirror_id: N/A lcme_flags: 0 lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 stripe_count: 0 stripe_size: 1048576 pattern: mdt mdt_index: -1 lcme_id: N/A lcme_mirror_id: N/A lcme_flags: 0 lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 pool: test_65o lcm_layout_gen: 0 lcm_mirror_count: 1 lcm_entry_count: 1 lcme_id: N/A lcme_mirror_id: N/A lcme_flags: 0 lcme_extent.e_start: 0 lcme_extent.e_end: EOF stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: -1 pool: test_65o Destroy the created pools: test_65o lustre.test_65o oleg259-server: OST lustre-OST0000_UUID removed from pool lustre.test_65o oleg259-server: OST lustre-OST0001_UUID removed from pool lustre.test_65o oleg259-server: Pool lustre.test_65o destroyed PASS 65o (26s) == sanity test 65p: setstripe with yaml file and huge number ========================================================== 10:10:23 (1787839823) PASS 65p (7s) == sanity test 65q: setstripe with >=8E offset should fail ========================================================== 10:10:30 (1787839830) Cannot set layout EA: Invalid argument lfs setstripe: lfs setstripe: cannot set default composite layout for '/mnt/lustre/d65q.sanity/src_dir': Invalid argument (22) PASS 65q (8s) == sanity test 65r: prevent all-zero offsets ============= 10:10:38 (1787839838) PASS 65r (8s) == sanity test 66: update inode blocks count on client ========================================================================= 10:10:47 (1787839847) 8+0 records in 8+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0308454 s, 266 kB/s PASS 66 (15s) == sanity test 69: verify oa2dentry return -ENOENT doesn't LBUG ================================================================ 10:11:02 (1787839862) directio on /mnt/lustre/f69.sanity.2 for 1x4194304 bytes PASS fail_loc=0x217 directio on /mnt/lustre/f69.sanity for 2x4194304 bytes Write error No such file or directory (rc = -1, len = 8388608) fail_loc=0 directio on /mnt/lustre/f69.sanity for 2x4194304 bytes PASS directio on /mnt/lustre/f69.sanity for 1x4194304 bytes PASS fail_loc=0x217 directio on /mnt/lustre/f69.sanity for 1x4194304 bytes Read error: No such file or directory rc = -1 fail_loc=0 PASS 69 (14s) == sanity test 70a: verify health_check, health_write don't explode (on OST) ========================================================== 10:11:15 (1787839875) enable_health_write=off enable_health_write=0 enable_health_write=on enable_health_write=1 enable_health_write=0 PASS 70a (17s) SKIP: sanity test_71 skipping SLOW test 71 == sanity test 72a: Test that remove suid works properly (bug5695) ============================================================== 10:11:34 (1787839894) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7614] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/f72a.sanity] [bs=512] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.00643084 s, 79.6 kB/s PASS 72a (8s) == sanity test 72b: Test that we keep mode setting if without file data changed (bug 24226) ========================================================== 10:11:42 (1787839902) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7614] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/f72b.sanity-fg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/f72b.sanity-fu] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fu': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/f72b.sanity-dg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-dg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/f72b.sanity-du] chmod: changing permissions of '/mnt/lustre/f72b.sanity-du': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [2777] [/mnt/lustre/f72b.sanity-fg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [2777] [/mnt/lustre/f72b.sanity-fu] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fu': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [2777] [/mnt/lustre/f72b.sanity-dg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-dg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [2777] [/mnt/lustre/f72b.sanity-du] chmod: changing permissions of '/mnt/lustre/f72b.sanity-du': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [4777] [/mnt/lustre/f72b.sanity-fg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [4777] [/mnt/lustre/f72b.sanity-fu] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fu': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [4777] [/mnt/lustre/f72b.sanity-dg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-dg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [4777] [/mnt/lustre/f72b.sanity-du] chmod: changing permissions of '/mnt/lustre/f72b.sanity-du': Operation not permitted PASS 72b (8s) == sanity test 73: multiple MDC requests (should not deadlock) ========================================================== 10:11:51 (1787839911) multiop /mnt/lustre/d73-1/f73-1 vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7614 fail_loc=0x80000129 fail_loc=0 /mnt/lustre/d73-1/f73-1 has type file OK /mnt/lustre/d73-1/f73-2 has type file OK /mnt/lustre/d73-2/f73-3 has type file OK PASS 73 (35s) == sanity test 74a: ldlm_enqueue freed-export error path, ls (shouldn't LBUG) ========================================================== 10:12:26 (1787839946) fail_loc=0x8000030e /mnt/lustre/f74a fail_loc=0 PASS 74a (7s) == sanity test 74b: ldlm_enqueue freed-export error path, touch (shouldn't LBUG) ========================================================== 10:12:33 (1787839953) fail_loc=0x8000030e fail_loc=0 PASS 74b (8s) == sanity test 74c: ldlm_lock_create error path, (shouldn't LBUG) ========================================================== 10:12:41 (1787839961) fail_loc=0x319 touch: cannot touch '/mnt/lustre/f74c.sanity': No such file or directory fail_loc=0 PASS 74c (7s) == sanity test 76a: confirm clients recycle inodes properly ============================================================== 10:12:48 (1787839968) before slab objects: 46 created: 512, after slab objects: 46 PASS 76a (74s) == sanity test 76b: confirm clients recycle directory inodes properly ============================================================== 10:14:02 (1787840042) slab objects before: 46, after: 46 PASS 76b (52s) == sanity test 77a: normal checksum read/write operation ========================================================== 10:14:54 (1787840094) 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.11654 s, 72.0 MB/s 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.586789 s, 14.3 MB/s PASS 77a (7s) == sanity test 77b: checksum error on client write, read ========================================================== 10:15:01 (1787840101) fail_loc=0x80000409 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.951753 s, 8.8 MB/s fail_loc=0 set checksum type to crc32, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to adler, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to crc32c, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to t10ip512, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to t10ip4K, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to t10crc512, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to t10crc4K, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to t10ip4K, rc = 0 PASS 77b (44s) == sanity test 77c: checksum error on client read with debug ========================================================== 10:15:45 (1787840145) debug_path=/tmp/lustre-log 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 1.36156 s, 6.2 MB/s osc.lustre-OST0000-osc-ffff975e517d4800.checksum_dump=1 osc.lustre-OST0001-osc-ffff975e517d4800.checksum_dump=1 obdfilter.lustre-OST0000.checksum_dump=1 obdfilter.lustre-OST0001.checksum_dump=1 fail_loc=0x80000408 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 6.30463 s, 1.3 MB/s fail_loc=0 osc.lustre-OST0000-osc-ffff975e517d4800.checksum_dump=0 osc.lustre-OST0001-osc-ffff975e517d4800.checksum_dump=0 obdfilter.lustre-OST0000.checksum_dump=0 obdfilter.lustre-OST0001.checksum_dump=0 PASS 77c (46s) == sanity test 77d: checksum error on OST direct write, read ========================================================== 10:16:31 (1787840191) fail_loc=0x80000409 directio on /mnt/lustre/f77d.sanity for 8x1048576 bytes PASS fail_loc=0 fail_loc=0x80000408 directio on /mnt/lustre/f77d.sanity for 8x1048576 bytes PASS fail_loc=0 PASS 77d (11s) == sanity test 77f: repeat checksum error on write (expect error) ========================================================== 10:16:42 (1787840202) osc.lustre-OST0000-osc-ffff975e517d4800.resend_count=1 osc.lustre-OST0001-osc-ffff975e517d4800.resend_count=1 set checksum type to crc32, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity.crc32 for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to adler, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity.adler for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to crc32c, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity.crc32c for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to t10ip512, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity.t10ip512 for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to t10ip4K, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity.t10ip4K for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to t10crc512, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity.t10crc512 for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to t10crc4K, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity.t10crc4K for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to t10ip4K, rc = 0 osc.lustre-OST0000-osc-ffff975e517d4800.resend_count=10 osc.lustre-OST0001-osc-ffff975e517d4800.resend_count=10 PASS 77f (39s) == sanity test 77g: checksum error on OST write, read ==== 10:17:21 (1787840241) fail_loc=0x8000021a 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 2.6551 s, 3.2 MB/s fail_loc=0 fail_loc=0x8000021b fail_loc=0 PASS 77g (18s) == sanity test 77k: enable/disable checksum correctly ==== 10:17:39 (1787840259) Waiting 90s for '0' Updated after 2s: want '0' got '0' remount client, checksum should be 0 Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock 192.168.202.159@tcp:/lustre /mnt/lustre Waiting 90s for '1' remount client, checksum should be 1 Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock 192.168.202.159@tcp:/lustre /mnt/lustre remount client with option checksum, checksum should be 1 192.168.202.159@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock,checksum 192.168.202.159@tcp:/lustre /mnt/lustre remount client with option nochecksum, checksum should be 0 192.168.202.159@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock,nochecksum 192.168.202.159@tcp:/lustre /mnt/lustre Stopping client oleg259-client.virtnet /mnt/lustre (opts:) Starting client: oleg259-client.virtnet: -o user_xattr,flock 192.168.202.159@tcp:/lustre /mnt/lustre Waiting 90s for '0' Updated after 2s: want '0' got '0' PASS 77k (36s)