== sanity-flr test 70a: flr mode fsx test ================ 17:43:15 (1746135795) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 5796 skipping zero length punch hole skipping zero length zero range 000003 1746135796.636262 mapwrite 0x023204 thru 0x026fd4 (0x3dd1 bytes) 000005 1746135796.692644 mapwrite 0x022242 thru 0x024626 (0x23e5 bytes) zero_range to largest ever: 0x1c9d2 000006 1746135796.703178 trunc from 0x018223 to 0x01c9d1 (0x47af bytes) zero_range to largest ever: 0x25579 000007 1746135796.706744 trunc from 0x01e0dc to 0x025578 (0x749d bytes) truncating to largest ever: 0x29de1 000008 1746135796.709698 trunc from 0x026fd5 to 0x029de0 (0x2e0c bytes) 000009 1746135796.722350 trunc from 0x029de1 to 0x01d8dd (0xc503 bytes) 000010 1746135796.735201 fallocate 0x0081dc thru 0x013693 (0xb4b8 bytes) fallocating to largest ever: 0x35795 000011 1746135796.742671 fallocate 0x032948 thru 0x035794 (0x2e4d bytes) 000013 1746135796.746365 write 0x0084ae thru 0x012d94 (0xa8e7 bytes) 000014 1746135796.758282 punch from 0x00c5c0 to 0x011ebc (0x58fd bytes) 000015 1746135796.772948 fallocate 0x0187c9 thru 0x02262b (0x9e63 bytes) 000016 1746135796.779883 mapwrite 0x01e485 thru 0x02d65b (0xf1d7 bytes) 000017 1746135796.809362 read 0x0179a0 thru 0x025b18 (0xe179 bytes) 000019 1746135796.810424 write 0x03b53d thru 0x03ffff (0x4ac3 bytes) 000020 1746135796.811094 read 0x02d6cf thru 0x033274 (0x5ba6 bytes) 000021 1746135796.816253 trunc from 0x0040f4 to 0x0095b5 (0x54c2 bytes) 000022 1746135796.824720 mapwrite 0x0011b5 thru 0x004420 (0x326c bytes) fallocating to largest ever: 0x35a71 000023 1746135796.849377 fallocate 0x032ab7 thru 0x035a70 (0x2fba bytes) truncating to largest ever: 0x3839f 000024 1746135796.852082 trunc from 0x040000 to 0x03839e (0x7c61 bytes) fallocating to largest ever: 0x3b740 000025 1746135796.862353 fallocate 0x032b98 thru 0x03b73f (0x8ba8 bytes) 000026 1746135796.866740 read 0x02bc29 thru 0x02d4ff (0x18d7 bytes) 000027 1746135796.867177 mapread 0x000f08 thru 0x007283 (0x637c bytes) 000029 1746135796.876553 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b740: skipped LOG DUMP (25 total operations): 1: 1746135796.631918 SKIPPED (no operation) 2: 1746135796.635827 SKIPPED (no operation) 3: 1746135796.636262 MAPWRITE 0x23204 thru 0x26fd4 (0x03dd1 bytes) 4: 1746135796.692644 MAPWRITE 0x22242 thru 0x24626 (0x023e5 bytes) 5: 1746135796.703178 ZERO 0x18223 thru 0x1c9d1 (0x047af bytes) 6: 1746135796.706744 ZERO 0x1e0dc thru 0x25578 (0x0749d bytes) 7: 1746135796.709698 TRUNC_UP 0x26fd5 to 0x29de1 8: 1746135796.722350 TRUNC_DN 0x29de1 to 0x1d8de 9: 1746135796.735201 FALLOC 0x081dc thru 0x13694 (0x0b4b8 bytes)INTERIOR 10: 1746135796.742671 FALLOC 0x32948 thru 0x35795 (0x02e4d bytes)EXTENDING 11: 1746135796.746365 WRITE 0x084ae thru 0x12d94 (0x0a8e7 bytes) 12: 1746135796.758282 PUNCH 0x0c5c0 thru 0x11ebc (0x058fd bytes) 13: 1746135796.772948 FALLOC 0x187c9 thru 0x2262c (0x09e63 bytes)INTERIOR 14: 1746135796.779883 MAPWRITE 0x1e485 thru 0x2d65b (0x0f1d7 bytes) 15: 1746135796.809362 READ 0x179a0 thru 0x25b18 (0x0e179 bytes) 16: 1746135796.810424 WRITE 0x3b53d thru 0x3ffff (0x04ac3 bytes) HOLE 17: 1746135796.811094 READ 0x2d6cf thru 0x33274 (0x05ba6 bytes) 18: 1746135796.816253 ZERO 0x040f4 thru 0x095b5 (0x054c2 bytes) 19: 1746135796.824720 MAPWRITE 0x011b5 thru 0x04420 (0x0326c bytes) 20: 1746135796.849377 FALLOC 0x32ab7 thru 0x35a71 (0x02fba bytes)INTERIOR 21: 1746135796.852082 TRUNC_DN 0x40000 to 0x3839f 22: 1746135796.862353 FALLOC 0x32b98 thru 0x3b740 (0x08ba8 bytes)EXTENDING 23: 1746135796.866740 READ 0x2bc29 thru 0x2d4ff (0x018d7 bytes) 24: 1746135796.867177 MAPREAD 0x00f08 thru 0x07283 (0x0637c bytes) 25: 1746135796.876553 MIRROR_EXTEND to 2 mirrors Using seed 5796 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746135798.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg349-server.1746135798.log.N6WgE6" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg349-server.1746135798.log.los4BX" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]