== sanity-flr test 70a: flr mode fsx test ================ 23:25:33 (1746156333) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 6334 000001 1746156335.157122 write 0x0281b5 thru 0x02ac25 (0x2a71 bytes) 000002 1746156335.166802 mapwrite 0x005a9b thru 0x00b48c (0x59f2 bytes) 000003 1746156335.219068 punch from 0x01be18 to 0x023710 (0x78f9 bytes) truncating to largest ever: 0x1a2bc 000004 1746156335.225862 trunc from 0x02ac26 to 0x01a2bb (0x1096a bytes) 000005 1746156335.241342 read 0x0194c9 thru 0x01a2bb (0xdf3 bytes) 000006 1746156335.244526 trunc from 0x0057ca to 0x0139d3 (0xe20a bytes) 000007 1746156335.248711 read 0x005168 thru 0x011907 (0xc7a0 bytes) 000008 1746156335.261854 write 0x017e1f thru 0x018fbc (0x119e bytes) 000010 1746156335.264005 punch from 0x010385 to 0x010c5c (0x8d8 bytes) 000011 1746156335.273131 mapwrite 0x011728 thru 0x016f42 (0x581b bytes) 000012 1746156335.286227 punch from 0x003a4b to 0x005a96 (0x204c bytes) 000013 1746156335.291477 trunc from 0x002685 to 0x0096ca (0x7046 bytes) truncating to largest ever: 0x32cf9 000014 1746156335.295575 trunc from 0x01a2bc to 0x032cf8 (0x18a3d bytes) 000015 1746156335.308253 read 0x0180b9 thru 0x025d1e (0xdc66 bytes) 000016 1746156335.319501 fallocate 0x0101c2 thru 0x01821e (0x805d bytes) 000018 1746156335.326684 mapread 0x01d67e thru 0x022c0a (0x558d bytes) 000019 1746156335.330714 write 0x018b75 thru 0x028806 (0xfc92 bytes) 000020 1746156335.337950 mapwrite 0x02df02 thru 0x03328b (0x538a bytes) 000021 1746156335.403220 read 0x00a5b1 thru 0x015749 (0xb199 bytes) 000022 1746156335.403680 mapread 0x023fb0 thru 0x032f89 (0xefda bytes) 000023 1746156335.405817 write 0x0206ad thru 0x025b6c (0x54c0 bytes) 000024 1746156335.414140 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3328c: skipped LOG DUMP (22 total operations): 1: 1746156335.157122 WRITE 0x281b5 thru 0x2ac25 (0x02a71 bytes) HOLE 2: 1746156335.166802 MAPWRITE 0x05a9b thru 0x0b48c (0x059f2 bytes) 3: 1746156335.219068 PUNCH 0x1be18 thru 0x23710 (0x078f9 bytes) 4: 1746156335.225862 TRUNC_DN 0x2ac26 to 0x1a2bc 5: 1746156335.241342 READ 0x194c9 thru 0x1a2bb (0x00df3 bytes) 6: 1746156335.244526 ZERO 0x057ca thru 0x139d3 (0x0e20a bytes) 7: 1746156335.248711 READ 0x05168 thru 0x11907 (0x0c7a0 bytes) 8: 1746156335.261854 WRITE 0x17e1f thru 0x18fbc (0x0119e bytes) 9: 1746156335.264005 PUNCH 0x10385 thru 0x10c5c (0x008d8 bytes) 10: 1746156335.273131 MAPWRITE 0x11728 thru 0x16f42 (0x0581b bytes) 11: 1746156335.286227 PUNCH 0x03a4b thru 0x05a96 (0x0204c bytes) 12: 1746156335.291477 ZERO 0x02685 thru 0x096ca (0x07046 bytes) 13: 1746156335.295575 TRUNC_UP 0x1a2bc to 0x32cf9 14: 1746156335.308253 READ 0x180b9 thru 0x25d1e (0x0dc66 bytes) 15: 1746156335.319501 FALLOC 0x101c2 thru 0x1821f (0x0805d bytes)INTERIOR 16: 1746156335.326684 MAPREAD 0x1d67e thru 0x22c0a (0x0558d bytes) 17: 1746156335.330714 WRITE 0x18b75 thru 0x28806 (0x0fc92 bytes) 18: 1746156335.337950 MAPWRITE 0x2df02 thru 0x3328b (0x0538a bytes) 19: 1746156335.403220 READ 0x0a5b1 thru 0x15749 (0x0b199 bytes) 20: 1746156335.403680 MAPREAD 0x23fb0 thru 0x32f89 (0x0efda bytes) 21: 1746156335.405817 WRITE 0x206ad thru 0x25b6c (0x054c0 bytes) 22: 1746156335.414140 MIRROR_EXTEND to 2 mirrors Using seed 6334 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746156336.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg122-server.1746156336.log.jmO0HO" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg122-server.1746156336.log.RSsBct" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]