== sanity-flr test 70a: flr mode fsx test ================ 18:45:08 (1746139508) Seed set to 9510 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0xe183 000003 1746139510.503133 trunc from 00000000 to 0x00e182 (0xe183 bytes) 000004 1746139510.516111 write 0x0007a4 thru 0x00be89 (0xb6e6 bytes) 000006 1746139510.524048 read 0x0000d8 thru 0x008814 (0x873d bytes) 000007 1746139510.524483 write 0x02f144 thru 0x039891 (0xa74e bytes) 000010 1746139510.526710 mapwrite 0x03c520 thru 0x03ffff (0x3ae0 bytes) 000011 1746139510.712241 write 0x000fc3 thru 0x0064fc (0x553a bytes) 000015 1746139510.717107 write 0x01902c thru 0x02791b (0xe8f0 bytes) 000017 1746139510.733181 read 0x02817f thru 0x03127f (0x9101 bytes) 000019 1746139510.741728 write 0x00dd72 thru 0x016b56 (0x8de5 bytes) 000026 1746139510.749660 mapread 0x018b37 thru 0x026f9c (0xe466 bytes) 000027 1746139510.752230 mapwrite 0x00bdba thru 0x010db8 (0x4fff bytes) 000028 1746139510.823200 write 0x0026b9 thru 0x00a64d (0x7f95 bytes) 000030 1746139510.824318 mapwrite 0x018849 thru 0x01ba8d (0x3245 bytes) 000033 1746139510.875441 mapwrite 0x01a8ee thru 0x029bdf (0xf2f2 bytes) 000037 1746139510.939217 write 0x02283d thru 0x02a90c (0x80d0 bytes) 000039 1746139510.942152 mapread 0x020bad thru 0x02d339 (0xc78d bytes) 000041 1746139510.946806 mapread 0x019e99 thru 0x02069f (0x6807 bytes) 000044 1746139510.948233 write 0x002abf thru 0x0071c8 (0x470a bytes) truncating to largest ever: 0x3efa5 000045 1746139510.953986 trunc from 0x040000 to 0x03efa4 (0x105b bytes) 000047 1746139510.982847 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3efa5: skipped LOG DUMP (38 total operations): 1: 1746139510.498195 SKIPPED (no operation) 2: 1746139510.503133 TRUNC_UP 0x00000 to 0x0e183 3: 1746139510.516111 WRITE 0x007a4 thru 0x0be89 (0x0b6e6 bytes) 4: 1746139510.523761 SKIPPED (no operation) 5: 1746139510.524048 READ 0x000d8 thru 0x08814 (0x0873d bytes) 6: 1746139510.524483 WRITE 0x2f144 thru 0x39891 (0x0a74e bytes) HOLE 7: 1746139510.526210 SKIPPED (no operation) 8: 1746139510.526710 MAPWRITE 0x3c520 thru 0x3ffff (0x03ae0 bytes) 9: 1746139510.712241 WRITE 0x00fc3 thru 0x064fc (0x0553a bytes) 10: 1746139510.716254 SKIPPED (no operation) 11: 1746139510.716804 SKIPPED (no operation) 12: 1746139510.717107 WRITE 0x1902c thru 0x2791b (0x0e8f0 bytes) 13: 1746139510.732673 SKIPPED (no operation) 14: 1746139510.733181 READ 0x2817f thru 0x3127f (0x09101 bytes) 15: 1746139510.741445 SKIPPED (no operation) 16: 1746139510.741728 WRITE 0x0dd72 thru 0x16b56 (0x08de5 bytes) 17: 1746139510.743478 SKIPPED (no operation) 18: 1746139510.749018 SKIPPED (no operation) 19: 1746139510.749336 SKIPPED (no operation) 20: 1746139510.749660 MAPREAD 0x18b37 thru 0x26f9c (0x0e466 bytes) 21: 1746139510.752230 MAPWRITE 0x0bdba thru 0x10db8 (0x04fff bytes) 22: 1746139510.823200 WRITE 0x026b9 thru 0x0a64d (0x07f95 bytes) 23: 1746139510.824318 MAPWRITE 0x18849 thru 0x1ba8d (0x03245 bytes) 24: 1746139510.873948 SKIPPED (no operation) 25: 1746139510.874698 SKIPPED (no operation) 26: 1746139510.875441 MAPWRITE 0x1a8ee thru 0x29bdf (0x0f2f2 bytes) 27: 1746139510.937255 SKIPPED (no operation) 28: 1746139510.938857 SKIPPED (no operation) 29: 1746139510.939217 WRITE 0x2283d thru 0x2a90c (0x080d0 bytes) 30: 1746139510.940972 SKIPPED (no operation) 31: 1746139510.942152 MAPREAD 0x20bad thru 0x2d339 (0x0c78d bytes) 32: 1746139510.942854 SKIPPED (no operation) 33: 1746139510.946806 MAPREAD 0x19e99 thru 0x2069f (0x06807 bytes) 34: 1746139510.947561 SKIPPED (no operation) 35: 1746139510.947915 SKIPPED (no operation) 36: 1746139510.948233 WRITE 0x02abf thru 0x071c8 (0x0470a bytes) 37: 1746139510.953986 TRUNC_DN 0x40000 to 0x3efa5 38: 1746139510.982847 MIRROR_EXTEND to 2 mirrors Using seed 9510 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746139512.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg149-server.1746139512.log.u6RC2S" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg149-server.1746139512.log.1TbUjv" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]