== sanity-flr test 70a: flr mode fsx test ================ 17:20:08 (1746134408) Seed set to 4408 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1746134409.017330 mapwrite 0x03eb60 thru 0x03ffff (0x14a0 bytes) 000002 1746134409.124224 write 0x01ef71 thru 0x029db8 (0xae48 bytes) 000004 1746134409.134728 mapwrite 0x01146c thru 0x01df98 (0xcb2d bytes) 000010 1746134409.175431 write 0x00a27c thru 0x00be4c (0x1bd1 bytes) 000013 1746134409.178005 write 0x01c343 thru 0x0280f7 (0xbdb5 bytes) 000014 1746134409.179407 mapwrite 0x02c198 thru 0x038d04 (0xcb6d bytes) truncating to largest ever: 0x5b7e 000015 1746134409.241877 trunc from 0x040000 to 0x005b7d (0x3a482 bytes) 000016 1746134409.259189 mapwrite 0x01435b thru 0x01a2af (0x5f55 bytes) 000017 1746134409.331066 read 0x016449 thru 0x01a2af (0x3e67 bytes) 000020 1746134409.332157 mapread 0x0106ba thru 0x014a31 (0x4378 bytes) truncating to largest ever: 0x17507 000024 1746134409.335779 trunc from 0x01a2b0 to 0x017506 (0x2da9 bytes) 000027 1746134409.351620 mapwrite 0x01e3f0 thru 0x02d182 (0xed93 bytes) 000030 1746134409.423664 mapread 0x019a60 thru 0x01f12d (0x56ce bytes) truncating to largest ever: 0x303df 000032 1746134409.425167 trunc from 0x02d183 to 0x0303de (0x325c bytes) 000033 1746134409.431883 read 0x01d8fb thru 0x023362 (0x5a68 bytes) 000034 1746134409.432792 read 0x000ba0 thru 0x00b36a (0xa7cb bytes) 000039 1746134409.442064 write 0x01d285 thru 0x023731 (0x64ad bytes) 000042 1746134409.443590 write 0x000053 thru 0x001081 (0x102f bytes) truncating to largest ever: 0x382f2 000044 1746134409.445040 trunc from 0x0303df to 0x0382f1 (0x7f13 bytes) 000052 1746134409.453290 read 0x001bef thru 0x003c92 (0x20a4 bytes) 000057 1746134409.459913 mapread 0x031a64 thru 0x031b00 (0x9d bytes) 000058 1746134409.468675 MIRROR_EXTEND to 2 mirrors lfs mirror mirror: fail to pread 0-4194304 of mirror 2: Invalid argument (22) lfs verify: failed to read data from mirror 2: Invalid argument. mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 lfs mirror mirror: fail to pread 0-4194304 of mirror 1: Invalid argument (22) lfs verify: failed to read data from mirror 1: Invalid argument. lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x382f2: skipped LOG DUMP (50 total operations): 1: 1746134409.017330 MAPWRITE 0x3eb60 thru 0x3ffff (0x014a0 bytes) 2: 1746134409.124224 WRITE 0x1ef71 thru 0x29db8 (0x0ae48 bytes) 3: 1746134409.133893 SKIPPED (no operation) 4: 1746134409.134728 MAPWRITE 0x1146c thru 0x1df98 (0x0cb2d bytes) 5: 1746134409.173130 SKIPPED (no operation) 6: 1746134409.173451 SKIPPED (no operation) 7: 1746134409.173919 SKIPPED (no operation) 8: 1746134409.174795 SKIPPED (no operation) 9: 1746134409.175431 WRITE 0x0a27c thru 0x0be4c (0x01bd1 bytes) 10: 1746134409.177663 SKIPPED (no operation) 11: 1746134409.178005 WRITE 0x1c343 thru 0x280f7 (0x0bdb5 bytes) 12: 1746134409.179407 MAPWRITE 0x2c198 thru 0x38d04 (0x0cb6d bytes) 13: 1746134409.241877 TRUNC_DN 0x40000 to 0x05b7e 14: 1746134409.259189 MAPWRITE 0x1435b thru 0x1a2af (0x05f55 bytes) 15: 1746134409.331066 READ 0x16449 thru 0x1a2af (0x03e67 bytes) 16: 1746134409.331495 SKIPPED (no operation) 17: 1746134409.331828 SKIPPED (no operation) 18: 1746134409.332157 MAPREAD 0x106ba thru 0x14a31 (0x04378 bytes) 19: 1746134409.335431 SKIPPED (no operation) 20: 1746134409.335779 TRUNC_DN 0x1a2b0 to 0x17507 21: 1746134409.351248 SKIPPED (no operation) 22: 1746134409.351620 MAPWRITE 0x1e3f0 thru 0x2d182 (0x0ed93 bytes) 23: 1746134409.422984 SKIPPED (no operation) 24: 1746134409.423326 SKIPPED (no operation) 25: 1746134409.423664 MAPREAD 0x19a60 thru 0x1f12d (0x056ce bytes) 26: 1746134409.424392 SKIPPED (no operation) 27: 1746134409.425167 TRUNC_UP 0x2d183 to 0x303df 28: 1746134409.431883 READ 0x1d8fb thru 0x23362 (0x05a68 bytes) 29: 1746134409.432792 READ 0x00ba0 thru 0x0b36a (0x0a7cb bytes) 30: 1746134409.440558 SKIPPED (no operation) 31: 1746134409.440876 SKIPPED (no operation) 32: 1746134409.441815 SKIPPED (no operation) 33: 1746134409.442064 WRITE 0x1d285 thru 0x23731 (0x064ad bytes) 34: 1746134409.442931 SKIPPED (no operation) 35: 1746134409.443253 SKIPPED (no operation) 36: 1746134409.443590 WRITE 0x00053 thru 0x01081 (0x0102f bytes) 37: 1746134409.444228 SKIPPED (no operation) 38: 1746134409.445040 TRUNC_UP 0x303df to 0x382f2 39: 1746134409.451619 SKIPPED (no operation) 40: 1746134409.451943 SKIPPED (no operation) 41: 1746134409.452707 SKIPPED (no operation) 42: 1746134409.452876 SKIPPED (no operation) 43: 1746134409.453039 SKIPPED (no operation) 44: 1746134409.453290 READ 0x01bef thru 0x03c92 (0x020a4 bytes) 45: 1746134409.453964 SKIPPED (no operation) 46: 1746134409.454276 SKIPPED (no operation) 47: 1746134409.459088 SKIPPED (no operation) 48: 1746134409.459463 SKIPPED (no operation) 49: 1746134409.459913 MAPREAD 0x31a64 thru 0x31b00 (0x0009d bytes) 50: 1746134409.468675 MIRROR_EXTEND to 2 mirrors Using seed 4408 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746134410.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg424-server.1746134410.log.6gHmTx" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg424-server.1746134410.log.cYDLYx" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]