== sanity-flr test 70a: flr mode fsx test ================ 11:13:02 (1746112382) Seed set to 2382 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1746112382.503697 write 0x0226c6 thru 0x02c417 (0x9d52 bytes) 000002 1746112382.508046 read 0x00d3e8 thru 0x01b759 (0xe372 bytes) 000004 1746112382.511039 read 0x01a9d2 thru 0x02a12e (0xf75d bytes) 000005 1746112382.514012 mapread 0x00eb91 thru 0x01d53c (0xe9ac bytes) 000006 1746112382.514804 read 0x008f78 thru 0x01475a (0xb7e3 bytes) truncating to largest ever: 0x27c8b 000008 1746112382.515564 trunc from 0x02c418 to 0x027c8a (0x478d bytes) 000009 1746112382.519556 mapwrite 0x035a41 thru 0x03e538 (0x8af8 bytes) 000010 1746112382.555865 mapread 0x0124bf thru 0x018b63 (0x66a5 bytes) 000014 1746112382.557328 write 0x03a7f4 thru 0x03ffff (0x580c bytes) 000015 1746112382.557926 mapwrite 0x00f7a6 thru 0x0152d1 (0x5b2c bytes) 000017 1746112382.573937 read 0x01f9cf thru 0x02c81a (0xce4c bytes) 000018 1746112382.574546 mapread 0x02f2c5 thru 0x033abc (0x47f8 bytes) 000019 1746112382.575225 mapwrite 0x01d76a thru 0x02679d (0x9034 bytes) 000020 1746112382.590210 read 0x0213a1 thru 0x021426 (0x86 bytes) 000021 1746112382.590554 read 0x001277 thru 0x0017ba (0x544 bytes) 000024 1746112382.591234 mapread 0x006652 thru 0x00e4c3 (0x7e72 bytes) 000025 1746112382.591874 write 0x01b869 thru 0x01b89c (0x34 bytes) 000027 1746112382.592730 write 0x011915 thru 0x012556 (0xc42 bytes) 000029 1746112382.593615 mapwrite 0x00a52e thru 0x00d1ce (0x2ca1 bytes) 000031 1746112382.608643 mapread 0x030748 thru 0x035b39 (0x53f2 bytes) 000032 1746112382.609143 write 0x00e64a thru 0x00f41f (0xdd6 bytes) 000033 1746112382.609909 trunc from 0x040000 to 0x022719 (0x1d8e6 bytes) 000034 1746112382.614331 read 0x00661b thru 0x015958 (0xf33e bytes) truncating to largest ever: 0x3100b 000035 1746112382.614712 trunc from 0x02271a to 0x03100a (0xe8f1 bytes) 000036 1746112382.618659 mapread 0x02cbfb thru 0x03100a (0x4410 bytes) 000037 1746112382.622480 mapread 0x004915 thru 0x010d3a (0xc426 bytes) 000040 1746112382.623381 mapread 0x00879f thru 0x01142e (0x8c90 bytes) 000041 1746112382.623836 write 0x013a19 thru 0x01730c (0x38f4 bytes) 000043 1746112382.624842 read 0x002345 thru 0x00b45e (0x911a bytes) 000044 1746112382.625127 trunc from 0x03100b to 0x02c061 (0x4fa9 bytes) 000045 1746112382.629418 write 0x003e98 thru 0x0082bb (0x4424 bytes) 000046 1746112382.632782 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c062: skipped LOG DUMP (43 total operations): 1: 1746112382.503697 WRITE 0x226c6 thru 0x2c417 (0x09d52 bytes) HOLE 2: 1746112382.508046 READ 0x0d3e8 thru 0x1b759 (0x0e372 bytes) 3: 1746112382.510801 SKIPPED (no operation) 4: 1746112382.511039 READ 0x1a9d2 thru 0x2a12e (0x0f75d bytes) 5: 1746112382.514012 MAPREAD 0x0eb91 thru 0x1d53c (0x0e9ac bytes) 6: 1746112382.514804 READ 0x08f78 thru 0x1475a (0x0b7e3 bytes) 7: 1746112382.515273 SKIPPED (no operation) 8: 1746112382.515564 TRUNC_DN 0x2c418 to 0x27c8b 9: 1746112382.519556 MAPWRITE 0x35a41 thru 0x3e538 (0x08af8 bytes) 10: 1746112382.555865 MAPREAD 0x124bf thru 0x18b63 (0x066a5 bytes) 11: 1746112382.556346 SKIPPED (no operation) 12: 1746112382.557100 SKIPPED (no operation) 13: 1746112382.557328 WRITE 0x3a7f4 thru 0x3ffff (0x0580c bytes) EXTEND 14: 1746112382.557926 MAPWRITE 0x0f7a6 thru 0x152d1 (0x05b2c bytes) 15: 1746112382.573541 SKIPPED (no operation) 16: 1746112382.573937 READ 0x1f9cf thru 0x2c81a (0x0ce4c bytes) 17: 1746112382.574546 MAPREAD 0x2f2c5 thru 0x33abc (0x047f8 bytes) 18: 1746112382.575225 MAPWRITE 0x1d76a thru 0x2679d (0x09034 bytes) 19: 1746112382.590210 READ 0x213a1 thru 0x21426 (0x00086 bytes) 20: 1746112382.590554 READ 0x01277 thru 0x017ba (0x00544 bytes) 21: 1746112382.590832 SKIPPED (no operation) 22: 1746112382.591039 SKIPPED (no operation) 23: 1746112382.591234 MAPREAD 0x06652 thru 0x0e4c3 (0x07e72 bytes) 24: 1746112382.591874 WRITE 0x1b869 thru 0x1b89c (0x00034 bytes) 25: 1746112382.592476 SKIPPED (no operation) 26: 1746112382.592730 WRITE 0x11915 thru 0x12556 (0x00c42 bytes) 27: 1746112382.593615 MAPWRITE 0x0a52e thru 0x0d1ce (0x02ca1 bytes) 28: 1746112382.608355 SKIPPED (no operation) 29: 1746112382.608643 MAPREAD 0x30748 thru 0x35b39 (0x053f2 bytes) 30: 1746112382.609143 WRITE 0x0e64a thru 0x0f41f (0x00dd6 bytes) 31: 1746112382.609909 TRUNC_DN 0x40000 to 0x2271a 32: 1746112382.614331 READ 0x0661b thru 0x15958 (0x0f33e bytes) 33: 1746112382.614712 TRUNC_UP 0x2271a to 0x3100b 34: 1746112382.618659 MAPREAD 0x2cbfb thru 0x3100a (0x04410 bytes) 35: 1746112382.622480 MAPREAD 0x04915 thru 0x10d3a (0x0c426 bytes) 36: 1746112382.623187 SKIPPED (no operation) 37: 1746112382.623381 MAPREAD 0x0879f thru 0x1142e (0x08c90 bytes) 38: 1746112382.623836 WRITE 0x13a19 thru 0x1730c (0x038f4 bytes) 39: 1746112382.624603 SKIPPED (no operation) 40: 1746112382.624842 READ 0x02345 thru 0x0b45e (0x0911a bytes) 41: 1746112382.625127 TRUNC_DN 0x3100b to 0x2c062 42: 1746112382.629418 WRITE 0x03e98 thru 0x082bb (0x04424 bytes) 43: 1746112382.632782 MIRROR_EXTEND to 2 mirrors Using seed 2382 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746112383.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg423-server.1746112383.log.4mxJaL" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg423-server.1746112383.log.cnMCji" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]