== sanity-flr test 70a: flr mode fsx test ================ 20:52:06 (1746147126) Seed set to 7126 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1746147127.114346 mapwrite 0x02a3e7 thru 0x036773 (0xc38d bytes) 000003 1746147127.203683 write 0x0270d3 thru 0x036f0f (0xfe3d bytes) 000004 1746147127.204931 mapread 0x027b98 thru 0x02e89f (0x6d08 bytes) 000005 1746147127.205480 write 0x012bad thru 0x01ff1a (0xd36e bytes) 000009 1746147127.217645 write 0x01d069 thru 0x02c2cb (0xf263 bytes) 000010 1746147127.218787 read 0x034928 thru 0x036f0f (0x25e8 bytes) 000013 1746147127.221325 write 0x019840 thru 0x01ef8f (0x5750 bytes) truncating to largest ever: 0x16c0c 000014 1746147127.222075 trunc from 0x036f10 to 0x016c0b (0x20304 bytes) truncating to largest ever: 0x31756 000016 1746147127.228218 trunc from 0x016c0c to 0x031755 (0x1ab4a bytes) 000017 1746147127.233468 mapread 0x028d79 thru 0x031755 (0x89dd bytes) 000020 1746147127.244520 mapwrite 0x03d658 thru 0x03ffff (0x29a8 bytes) 000022 1746147127.314873 mapwrite 0x01ae48 thru 0x029d99 (0xef52 bytes) 000023 1746147127.362474 mapread 0x03073c thru 0x030e19 (0x6de bytes) 000024 1746147127.363071 mapwrite 0x022f85 thru 0x02b46d (0x84e9 bytes) 000025 1746147127.408105 read 0x0143a7 thru 0x018a5c (0x46b6 bytes) 000027 1746147127.408873 write 0x02dfff thru 0x036bb3 (0x8bb5 bytes) 000029 1746147127.410167 trunc from 0x040000 to 0x017101 (0x28efe bytes) 000031 1746147127.418658 read 0x001c69 thru 0x008032 (0x63ca bytes) 000032 1746147127.423990 read 0x00234a thru 0x00f26a (0xcf21 bytes) 000036 1746147127.424994 read 0x00b23d thru 0x017101 (0xbec5 bytes) 000037 1746147127.425542 mapwrite 0x03e76b thru 0x03ffff (0x1895 bytes) 000038 1746147127.487970 read 0x03f59b thru 0x03ffff (0xa65 bytes) 000041 1746147127.489593 trunc from 0x040000 to 0x017451 (0x28bae bytes) 000042 1746147127.503516 read 0x00d05b thru 0x010c21 (0x3bc7 bytes) 000046 1746147127.505708 mapread 0x00141d thru 0x00baba (0xa69e bytes) 000047 1746147127.511061 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17452: skipped LOG DUMP (42 total operations): 1: 1746147127.114346 MAPWRITE 0x2a3e7 thru 0x36773 (0x0c38d bytes) 2: 1746147127.203683 WRITE 0x270d3 thru 0x36f0f (0x0fe3d bytes) EXTEND 3: 1746147127.204931 MAPREAD 0x27b98 thru 0x2e89f (0x06d08 bytes) 4: 1746147127.205480 WRITE 0x12bad thru 0x1ff1a (0x0d36e bytes) 5: 1746147127.216654 SKIPPED (no operation) 6: 1746147127.217342 SKIPPED (no operation) 7: 1746147127.217645 WRITE 0x1d069 thru 0x2c2cb (0x0f263 bytes) 8: 1746147127.218787 READ 0x34928 thru 0x36f0f (0x025e8 bytes) 9: 1746147127.220337 SKIPPED (no operation) 10: 1746147127.220658 SKIPPED (no operation) 11: 1746147127.221325 WRITE 0x19840 thru 0x1ef8f (0x05750 bytes) 12: 1746147127.222075 TRUNC_DN 0x36f10 to 0x16c0c 13: 1746147127.228218 TRUNC_UP 0x16c0c to 0x31756 14: 1746147127.233468 MAPREAD 0x28d79 thru 0x31755 (0x089dd bytes) 15: 1746147127.243905 SKIPPED (no operation) 16: 1746147127.244236 SKIPPED (no operation) 17: 1746147127.244520 MAPWRITE 0x3d658 thru 0x3ffff (0x029a8 bytes) 18: 1746147127.314556 SKIPPED (no operation) 19: 1746147127.314873 MAPWRITE 0x1ae48 thru 0x29d99 (0x0ef52 bytes) 20: 1746147127.362474 MAPREAD 0x3073c thru 0x30e19 (0x006de bytes) 21: 1746147127.363071 MAPWRITE 0x22f85 thru 0x2b46d (0x084e9 bytes) 22: 1746147127.408105 READ 0x143a7 thru 0x18a5c (0x046b6 bytes) 23: 1746147127.408568 SKIPPED (no operation) 24: 1746147127.408873 WRITE 0x2dfff thru 0x36bb3 (0x08bb5 bytes) 25: 1746147127.410167 TRUNC_DN 0x40000 to 0x17102 26: 1746147127.418339 SKIPPED (no operation) 27: 1746147127.418658 READ 0x01c69 thru 0x08032 (0x063ca bytes) 28: 1746147127.423990 READ 0x0234a thru 0x0f26a (0x0cf21 bytes) 29: 1746147127.424413 SKIPPED (no operation) 30: 1746147127.424590 SKIPPED (no operation) 31: 1746147127.424757 SKIPPED (no operation) 32: 1746147127.424994 READ 0x0b23d thru 0x17101 (0x0bec5 bytes) 33: 1746147127.425542 MAPWRITE 0x3e76b thru 0x3ffff (0x01895 bytes) 34: 1746147127.487970 READ 0x3f59b thru 0x3ffff (0x00a65 bytes) 35: 1746147127.488443 SKIPPED (no operation) 36: 1746147127.489270 SKIPPED (no operation) 37: 1746147127.489593 TRUNC_DN 0x40000 to 0x17452 38: 1746147127.503516 READ 0x0d05b thru 0x10c21 (0x03bc7 bytes) 39: 1746147127.504782 SKIPPED (no operation) 40: 1746147127.505115 SKIPPED (no operation) 41: 1746147127.505708 MAPREAD 0x0141d thru 0x0baba (0x0a69e bytes) 42: 1746147127.511061 MIRROR_EXTEND to 2 mirrors Using seed 7126 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746147128.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg336-server.1746147128.log.wuUTz9" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg336-server.1746147128.log.NiSY44" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]