== sanity-flr test 70a: flr mode fsx test ================ 23:02:06 (1746154926) Seed set to 4927 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003 1746154927.919050 mapwrite 0x026fca thru 0x02a419 (0x3450 bytes) 000011 1746154928.066853 read 0x0149b9 thru 0x01f2a1 (0xa8e9 bytes) 000012 1746154928.078724 mapwrite 0x0301fe thru 0x032ad5 (0x28d8 bytes) 000013 1746154928.181142 read 0x002abd thru 0x010c01 (0xe145 bytes) 000015 1746154928.189578 write 0x03cebc thru 0x03ffff (0x3144 bytes) 000016 1746154928.191983 read 0x0206f5 thru 0x026c59 (0x6565 bytes) 000017 1746154928.192920 read 0x0046a3 thru 0x00f6f2 (0xb050 bytes) 000018 1746154928.199863 MIRROR_EXTEND to 2 mirrors 000019 1746154928.583601 mapwrite 0x00dfb2 thru 0x01d273 (0xf2c2 bytes) truncating to largest ever: 0x5541 000021 1746154928.804588 trunc from 0x040000 to 0x005540 (0x3aabf bytes) 000022 1746154928.847432 mapwrite 0x0000f2 thru 0x009b4b (0x9a5a bytes) 000024 1746154928.956549 mapread 0x006a7d thru 0x009b4b (0x30cf bytes) 000025 1746154928.957906 mapread 0x000ac8 thru 0x009b4b (0x9084 bytes) 000027 1746154928.960809 mapwrite 0x00898d thru 0x016a62 (0xe0d6 bytes) 000028 1746154929.137379 write 0x010543 thru 0x01dbf0 (0xd6ae bytes) 000029 1746154929.152182 MIRROR_RESYNC 2 mirrors lfs mirror mirror: fail to pread 0-122880 of mirror 1: Invalid argument (22) lfs mirror mirror: error reading bytes 0-122880 of mirror 1: Invalid argument (22) lfs mirror mirror: fail to mirror resync '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr': Invalid argument (22) lfs mirror resync /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 22 LOG DUMP (26 total operations): 1: 1746154927.912403 SKIPPED (no operation) 2: 1746154927.918509 SKIPPED (no operation) 3: 1746154927.919050 MAPWRITE 0x26fca thru 0x2a419 (0x03450 bytes) 4: 1746154928.061883 SKIPPED (no operation) 5: 1746154928.062233 SKIPPED (no operation) 6: 1746154928.062588 SKIPPED (no operation) 7: 1746154928.064003 SKIPPED (no operation) 8: 1746154928.064652 SKIPPED (no operation) 9: 1746154928.066853 READ 0x149b9 thru 0x1f2a1 (0x0a8e9 bytes) 10: 1746154928.078724 MAPWRITE 0x301fe thru 0x32ad5 (0x028d8 bytes) 11: 1746154928.181142 READ 0x02abd thru 0x10c01 (0x0e145 bytes) 12: 1746154928.189578 WRITE 0x3cebc thru 0x3ffff (0x03144 bytes) HOLE 13: 1746154928.191983 READ 0x206f5 thru 0x26c59 (0x06565 bytes) 14: 1746154928.192920 READ 0x046a3 thru 0x0f6f2 (0x0b050 bytes) 15: 1746154928.199863 MIRROR_EXTEND to 2 mirrors 16: 1746154928.583601 MAPWRITE 0x0dfb2 thru 0x1d273 (0x0f2c2 bytes) 17: 1746154928.803214 SKIPPED (no operation) 18: 1746154928.804588 TRUNC_DN 0x40000 to 0x05541 19: 1746154928.847432 MAPWRITE 0x000f2 thru 0x09b4b (0x09a5a bytes) 20: 1746154928.956063 SKIPPED (no operation) 21: 1746154928.956549 MAPREAD 0x06a7d thru 0x09b4b (0x030cf bytes) 22: 1746154928.957906 MAPREAD 0x00ac8 thru 0x09b4b (0x09084 bytes) 23: 1746154928.960411 SKIPPED (no operation) 24: 1746154928.960809 MAPWRITE 0x0898d thru 0x16a62 (0x0e0d6 bytes) 25: 1746154929.137379 WRITE 0x10543 thru 0x1dbf0 (0x0d6ae bytes) EXTEND 26: 1746154929.152182 MIRROR_RESYNC 2 mirrors Using seed 4927 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3351:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3353:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1746154930.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg122-server.1746154930.log.rk0MEl" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg122-server.1746154930.log.14TuNb" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]