== sanity-flr test 70a: flr mode fsx test ================ 23:52:35 (1746071555) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 1555 skipping zero size read skipping zero length zero range skipping zero size read 000004 1746071556.018086 mapwrite 0x02dfc5 thru 0x0379d1 (0x9a0d bytes) zero_range to largest ever: 0x14b1e 000006 1746071556.069876 trunc from 0x00f603 to 0x014b1d (0x551b bytes) 000007 1746071556.073287 write 0x03a0c3 thru 0x03ffff (0x5f3d bytes) zero_range to largest ever: 0x31a8f 000008 1746071556.074155 trunc from 0x02682f to 0x031a8e (0xb260 bytes) 000010 1746071556.077952 trunc from 0x040000 to 0x02beb4 (0x1414b bytes) 000012 1746071556.097613 trunc from 0x02beb5 to 0x016507 (0x159ad bytes) 000014 1746071556.139122 mapread 0x00f00a thru 0x010fc0 (0x1fb7 bytes) 000017 1746071556.151631 trunc from 0x00e9cf to 0x014920 (0x5f52 bytes) 000018 1746071556.157240 trunc from 0x00f31f to 0x011430 (0x2112 bytes) 000019 1746071556.160659 mapread 0x002354 thru 0x00cd28 (0xa9d5 bytes) 000020 1746071556.170385 punch from 0x00ff35 to 0x0139f4 (0x3ac0 bytes) 000021 1746071556.173138 mapwrite 0x02c2cf thru 0x032602 (0x6334 bytes) 000023 1746071556.213530 fallocate 0x02a980 thru 0x02b5fa (0xc7b bytes) 000025 1746071556.221104 trunc from 0x0235e1 to 0x02da24 (0xa444 bytes) 000026 1746071556.225235 mapread 0x029565 thru 0x032602 (0x909e bytes) 000027 1746071556.231455 read 0x0189ff thru 0x023931 (0xaf33 bytes) 000028 1746071556.236926 mapread 0x000149 thru 0x00fb0e (0xf9c6 bytes) 000032 1746071556.247599 write 0x01b227 thru 0x020f60 (0x5d3a bytes) 000033 1746071556.248457 mapread 0x015441 thru 0x01b0be (0x5c7e bytes) 000035 1746071556.249358 read 0x02ed3e thru 0x032602 (0x38c5 bytes) 000036 1746071556.249726 read 0x00fb61 thru 0x01cd16 (0xd1b6 bytes) 000038 1746071556.250526 mapwrite 0x03460f thru 0x03d1da (0x8bcc bytes) 000039 1746071556.287268 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1db: skipped LOG DUMP (26 total operations): 1: 1746071556.012332 SKIPPED (no operation) 2: 1746071556.016493 SKIPPED (no operation) 3: 1746071556.016877 SKIPPED (no operation) 4: 1746071556.018086 MAPWRITE 0x2dfc5 thru 0x379d1 (0x09a0d bytes) 5: 1746071556.069876 ZERO 0x0f603 thru 0x14b1d (0x0551b bytes) 6: 1746071556.073287 WRITE 0x3a0c3 thru 0x3ffff (0x05f3d bytes) HOLE 7: 1746071556.074155 ZERO 0x2682f thru 0x31a8e (0x0b260 bytes) 8: 1746071556.077952 TRUNC_DN 0x40000 to 0x2beb5 9: 1746071556.097613 TRUNC_DN 0x2beb5 to 0x16508 10: 1746071556.139122 MAPREAD 0x0f00a thru 0x10fc0 (0x01fb7 bytes) 11: 1746071556.151631 ZERO 0x0e9cf thru 0x14920 (0x05f52 bytes) 12: 1746071556.157240 ZERO 0x0f31f thru 0x11430 (0x02112 bytes) 13: 1746071556.160659 MAPREAD 0x02354 thru 0x0cd28 (0x0a9d5 bytes) 14: 1746071556.170385 PUNCH 0x0ff35 thru 0x139f4 (0x03ac0 bytes) 15: 1746071556.173138 MAPWRITE 0x2c2cf thru 0x32602 (0x06334 bytes) 16: 1746071556.213530 FALLOC 0x2a980 thru 0x2b5fb (0x00c7b bytes)INTERIOR 17: 1746071556.221104 ZERO 0x235e1 thru 0x2da24 (0x0a444 bytes) 18: 1746071556.225235 MAPREAD 0x29565 thru 0x32602 (0x0909e bytes) 19: 1746071556.231455 READ 0x189ff thru 0x23931 (0x0af33 bytes) 20: 1746071556.236926 MAPREAD 0x00149 thru 0x0fb0e (0x0f9c6 bytes) 21: 1746071556.247599 WRITE 0x1b227 thru 0x20f60 (0x05d3a bytes) 22: 1746071556.248457 MAPREAD 0x15441 thru 0x1b0be (0x05c7e bytes) 23: 1746071556.249358 READ 0x2ed3e thru 0x32602 (0x038c5 bytes) 24: 1746071556.249726 READ 0x0fb61 thru 0x1cd16 (0x0d1b6 bytes) 25: 1746071556.250526 MAPWRITE 0x3460f thru 0x3d1da (0x08bcc bytes) 26: 1746071556.287268 MIRROR_EXTEND to 2 mirrors Using seed 1555 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746071557.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg242-server.1746071557.log.PCkEzV" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg242-server.1746071557.log.fw5O0K" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]