== sanity-flr test 70a: flr mode fsx test ================ 20:51:20 (1746147080) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 7081 skipping zero size read 000002 1746147081.269682 write 0x0280a2 thru 0x02bb34 (0x3a93 bytes) fallocating to largest ever: 0x40000 000003 1746147081.271288 fallocate 0x03ad86 thru 0x03ffff (0x527a bytes) 000004 1746147081.276190 trunc from 0x040000 to 0x02062d (0x1f9d2 bytes) 000006 1746147081.288862 mapwrite 0x024441 thru 0x030d64 (0xc924 bytes) 000007 1746147081.332294 write 0x0073d5 thru 0x016e60 (0xfa8c bytes) 000009 1746147081.346217 trunc from 0x030d65 to 0x017551 (0x19813 bytes) 000010 1746147081.356762 mapread 0x002e16 thru 0x0112ec (0xe4d7 bytes) 000011 1746147081.357699 punch from 0x00fed6 to 0x0131e2 (0x330d bytes) 000014 1746147081.369974 mapwrite 0x00e634 thru 0x019a5c (0xb429 bytes) 000016 1746147081.435706 punch from 0x01369f to 0x019a5c (0x63be bytes) 000017 1746147081.441698 mapwrite 0x00d3f8 thru 0x0196c2 (0xc2cb bytes) 000018 1746147081.464126 read 0x003797 thru 0x00c6a5 (0x8f0f bytes) 000019 1746147081.464596 trunc from 0x019a5d to 0x00cb8e (0xcece bytes) 000020 1746147081.476038 mapwrite 0x00dc8d thru 0x012a5b (0x4dcf bytes) 000021 1746147081.515084 fallocate 0x029999 thru 0x02ad2d (0x1395 bytes) 000022 1746147081.519031 read 0x00e936 thru 0x01ba69 (0xd134 bytes) 000024 1746147081.525508 punch from 0x016880 to 0x025d5e (0xf4df bytes) 000025 1746147081.531449 trunc from 0x012c1a to 0x01f9d5 (0xcdbc bytes) 000026 1746147081.536622 punch from 0x015451 to 0x0200f7 (0xaca7 bytes) 000027 1746147081.541960 trunc from 0x02aabc to 0x02ad2d (0x272 bytes) 000028 1746147081.546911 write 0x023d15 thru 0x02b00e (0x72fa bytes) 000029 1746147081.554323 read 0x0003ff thru 0x0043ee (0x3ff0 bytes) 000030 1746147081.555424 trunc from 0x02b00f to 0x025388 (0x5c86 bytes) 000031 1746147081.578142 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25389: skipped LOG DUMP (25 total operations): 1: 1746147081.267270 SKIPPED (no operation) 2: 1746147081.269682 WRITE 0x280a2 thru 0x2bb34 (0x03a93 bytes) HOLE 3: 1746147081.271288 FALLOC 0x3ad86 thru 0x40000 (0x0527a bytes)EXTENDING 4: 1746147081.276190 TRUNC_DN 0x40000 to 0x2062e 5: 1746147081.288862 MAPWRITE 0x24441 thru 0x30d64 (0x0c924 bytes) 6: 1746147081.332294 WRITE 0x073d5 thru 0x16e60 (0x0fa8c bytes) 7: 1746147081.346217 TRUNC_DN 0x30d65 to 0x17552 8: 1746147081.356762 MAPREAD 0x02e16 thru 0x112ec (0x0e4d7 bytes) 9: 1746147081.357699 PUNCH 0x0fed6 thru 0x131e2 (0x0330d bytes) 10: 1746147081.369974 MAPWRITE 0x0e634 thru 0x19a5c (0x0b429 bytes) 11: 1746147081.435706 PUNCH 0x1369f thru 0x19a5c (0x063be bytes) 12: 1746147081.441698 MAPWRITE 0x0d3f8 thru 0x196c2 (0x0c2cb bytes) 13: 1746147081.464126 READ 0x03797 thru 0x0c6a5 (0x08f0f bytes) 14: 1746147081.464596 TRUNC_DN 0x19a5d to 0x0cb8f 15: 1746147081.476038 MAPWRITE 0x0dc8d thru 0x12a5b (0x04dcf bytes) 16: 1746147081.515084 FALLOC 0x29999 thru 0x2ad2e (0x01395 bytes)EXTENDING 17: 1746147081.519031 READ 0x0e936 thru 0x1ba69 (0x0d134 bytes) 18: 1746147081.525508 PUNCH 0x16880 thru 0x25d5e (0x0f4df bytes) 19: 1746147081.531449 ZERO 0x12c1a thru 0x1f9d5 (0x0cdbc bytes) 20: 1746147081.536622 PUNCH 0x15451 thru 0x200f7 (0x0aca7 bytes) 21: 1746147081.541960 ZERO 0x2aabc thru 0x2ad2d (0x00272 bytes) 22: 1746147081.546911 WRITE 0x23d15 thru 0x2b00e (0x072fa bytes) EXTEND 23: 1746147081.554323 READ 0x003ff thru 0x043ee (0x03ff0 bytes) 24: 1746147081.555424 TRUNC_DN 0x2b00f to 0x25389 25: 1746147081.578142 MIRROR_EXTEND to 2 mirrors Using seed 7081 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746147082.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg425-server.1746147082.log.riISBC" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg425-server.1746147082.log.wMSyMX" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]