== sanity-flr test 70a: flr mode fsx test ================ 15:14:33 (1746126873) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 6874 skipping zero length zero range skipping zero length zero range truncating to largest ever: 0x2a9f2 000005 1746126874.823448 trunc from 00000000 to 0x02a9f1 (0x2a9f2 bytes) 000006 1746126874.833689 mapwrite 0x0227ff thru 0x02e00f (0xb811 bytes) 000007 1746126874.892760 punch from 0x014a48 to 0x0164be (0x1a77 bytes) 000008 1746126874.898124 trunc from 0x017cf4 to 0x01fdee (0x80fb bytes) 000009 1746126874.904760 write 0x006d0a thru 0x011372 (0xa669 bytes) truncating to largest ever: 0x39214 000011 1746126874.927907 trunc from 0x02e010 to 0x039213 (0xb204 bytes) 000012 1746126874.943232 write 0x00751c thru 0x010e0c (0x98f1 bytes) 000014 1746126874.944893 mapwrite 0x02de7f thru 0x02e9a4 (0xb26 bytes) 000015 1746126874.967763 mapread 0x024bd8 thru 0x0349d3 (0xfdfc bytes) 000016 1746126874.976281 write 0x0207bf thru 0x025a60 (0x52a2 bytes) 000017 1746126874.977180 fallocate 0x0051d4 thru 0x009bca (0x49f7 bytes) 000018 1746126874.983133 trunc from 0x039214 to 0x03359c (0x5c77 bytes) 000019 1746126874.999066 fallocate 0x02825d thru 0x034cf7 (0xca9b bytes) 000020 1746126875.002076 trunc from 0x03359d to 0x0100db (0x234c1 bytes) 000021 1746126875.025408 read 0x00a625 thru 0x0100db (0x5ab7 bytes) 000022 1746126875.025967 mapread 0x006705 thru 0x00a628 (0x3f24 bytes) 000023 1746126875.026553 trunc from 0x0100dc to 0x02caed (0x1ca12 bytes) 000025 1746126875.044273 punch from 0x00db4d to 0x011f1c (0x43d0 bytes) 000026 1746126875.051895 fallocate 0x017d74 thru 0x018f5a (0x11e7 bytes) 000027 1746126875.055387 trunc from 0x000518 to 0x00810a (0x7bf3 bytes) 000028 1746126875.060389 trunc from 0x02caee to 0x035e82 (0x9395 bytes) 000029 1746126875.072622 trunc from 0x0178ef to 0x022a57 (0xb169 bytes) 000031 1746126875.076651 trunc from 0x035e83 to 0x00ef44 (0x26f3e bytes) 000032 1746126875.093461 read 0x00cdf1 thru 0x00ef44 (0x2154 bytes) 000033 1746126875.102734 read 0x005c3b thru 0x00ef44 (0x930a bytes) 000035 1746126875.107431 mapwrite 0x017210 thru 0x024a51 (0xd842 bytes) 000036 1746126875.157284 write 0x00a2b4 thru 0x013c15 (0x9962 bytes) 000039 1746126875.164912 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24a52: skipped LOG DUMP (30 total operations): 1: 1746126874.822345 SKIPPED (no operation) 2: 1746126874.822759 SKIPPED (no operation) 3: 1746126874.823448 TRUNC_UP 0x00000 to 0x2a9f2 4: 1746126874.833689 MAPWRITE 0x227ff thru 0x2e00f (0x0b811 bytes) 5: 1746126874.892760 PUNCH 0x14a48 thru 0x164be (0x01a77 bytes) 6: 1746126874.898124 ZERO 0x17cf4 thru 0x1fdee (0x080fb bytes) 7: 1746126874.904760 WRITE 0x06d0a thru 0x11372 (0x0a669 bytes) 8: 1746126874.927907 TRUNC_UP 0x2e010 to 0x39214 9: 1746126874.943232 WRITE 0x0751c thru 0x10e0c (0x098f1 bytes) 10: 1746126874.944893 MAPWRITE 0x2de7f thru 0x2e9a4 (0x00b26 bytes) 11: 1746126874.967763 MAPREAD 0x24bd8 thru 0x349d3 (0x0fdfc bytes) 12: 1746126874.976281 WRITE 0x207bf thru 0x25a60 (0x052a2 bytes) 13: 1746126874.977180 FALLOC 0x051d4 thru 0x09bcb (0x049f7 bytes)INTERIOR 14: 1746126874.983133 TRUNC_DN 0x39214 to 0x3359d 15: 1746126874.999066 FALLOC 0x2825d thru 0x34cf8 (0x0ca9b bytes)PAST_EOF 16: 1746126875.002076 TRUNC_DN 0x3359d to 0x100dc 17: 1746126875.025408 READ 0x0a625 thru 0x100db (0x05ab7 bytes) 18: 1746126875.025967 MAPREAD 0x06705 thru 0x0a628 (0x03f24 bytes) 19: 1746126875.026553 TRUNC_UP 0x100dc to 0x2caee 20: 1746126875.044273 PUNCH 0x0db4d thru 0x11f1c (0x043d0 bytes) 21: 1746126875.051895 FALLOC 0x17d74 thru 0x18f5b (0x011e7 bytes)INTERIOR 22: 1746126875.055387 ZERO 0x00518 thru 0x0810a (0x07bf3 bytes) 23: 1746126875.060389 TRUNC_UP 0x2caee to 0x35e83 24: 1746126875.072622 ZERO 0x178ef thru 0x22a57 (0x0b169 bytes) 25: 1746126875.076651 TRUNC_DN 0x35e83 to 0x0ef45 26: 1746126875.093461 READ 0x0cdf1 thru 0x0ef44 (0x02154 bytes) 27: 1746126875.102734 READ 0x05c3b thru 0x0ef44 (0x0930a bytes) 28: 1746126875.107431 MAPWRITE 0x17210 thru 0x24a51 (0x0d842 bytes) 29: 1746126875.157284 WRITE 0x0a2b4 thru 0x13c15 (0x09962 bytes) 30: 1746126875.164912 MIRROR_EXTEND to 2 mirrors Using seed 6874 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746126876.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg342-server.1746126876.log.iuMojH" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg342-server.1746126876.log.2eVt7A" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]