== sanity-flr test 70a: flr mode fsx test ================ 19:14:29 (1763338469) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 8471 skipping zero length zero range skipping zero size read 000005 1763338471.660420 write 0x03b4fc thru 0x03ffff (0x4b04 bytes) 000007 1763338471.664343 punch from 0x01eefb to 0x0205f6 (0x16fc bytes) truncating to largest ever: 0x35a2f 000008 1763338471.680296 trunc from 0x040000 to 0x035a2e (0xa5d1 bytes) 000009 1763338471.703079 write 0x0227a1 thru 0x02c90d (0xa16d bytes) 000010 1763338471.727288 fallocate 0x030b0f thru 0x03508b (0x457d bytes) 000011 1763338471.735023 punch from 0x022e0c to 0x02b3d1 (0x85c6 bytes) 000012 1763338471.775081 trunc from 0x01f318 to 0x02d7d6 (0xe4bf bytes) 000014 1763338471.783940 read 0x008445 thru 0x016789 (0xe345 bytes) 000015 1763338471.797845 trunc from 0x02e80b to 0x03576f (0x6f65 bytes) 000018 1763338471.808291 mapwrite 0x0360bc thru 0x03b70f (0x5654 bytes) 000019 1763338471.874616 trunc from 0x029a42 to 0x03665a (0xcc19 bytes) 000020 1763338471.881807 mapwrite 0x03e40b thru 0x03ffff (0x1bf5 bytes) 000021 1763338471.944157 punch from 0x02d9b6 to 0x034ab5 (0x7100 bytes) 000022 1763338471.955620 trunc from 0x009e63 to 0x00bd2c (0x1eca bytes) 000023 1763338471.968658 write 0x01b770 thru 0x01e1ca (0x2a5b bytes) 000024 1763338471.988293 punch from 0x036609 to 0x03ffff (0x99f7 bytes) 000025 1763338471.992967 punch from 0x03027b to 0x038b31 (0x88b7 bytes) 000027 1763338472.000746 mapwrite 0x032352 thru 0x037eec (0x5b9b bytes) 000031 1763338472.056279 trunc from 0x040000 to 0x00584c (0x3a7b3 bytes) 000033 1763338472.100403 punch from 0x00365f to 0x00584c (0x21ee bytes) 000034 1763338472.104993 write 0x027769 thru 0x036634 (0xeecc bytes) 000035 1763338472.108259 punch from 0x028237 to 0x028d90 (0xb5a bytes) 000036 1763338472.141514 read 0x01ef2f thru 0x02d83d (0xe90f bytes) 000038 1763338472.156710 trunc from 0x036635 to 0x008a60 (0x2dbd4 bytes) 000040 1763338472.196625 trunc from 0x008a61 to 0x022f61 (0x1a501 bytes) 000041 1763338472.219745 fallocate 0x024c00 thru 0x02f344 (0xa745 bytes) 000042 1763338472.234661 read 0x01beab thru 0x01e48b (0x25e1 bytes) 000043 1763338472.253933 mapwrite 0x008a8d thru 0x0178d3 (0xee47 bytes) 000044 1763338472.291091 trunc from 0x02449f to 0x02b701 (0x7263 bytes) 000045 1763338472.297251 trunc from 0x02f345 to 0x000d66 (0x2e5de bytes) 000046 1763338472.311886 read 0x000ac0 thru 0x000d66 (0x2a7 bytes) 000047 1763338472.312506 mapread 0x000b9d thru 0x000d66 (0x1ca bytes) 000048 1763338472.313276 fallocate 0x01142f thru 0x01b218 (0x9dea bytes) 000049 1763338472.321352 read 0x000447 thru 0x000d66 (0x920 bytes) 000050 1763338472.322096 mapread 0x00058e thru 0x000d66 (0x7d9 bytes) 000051 1763338472.323502 read 0x000c1d thru 0x000d66 (0x14a bytes) 000052 1763338472.324006 punch from 0x000660 to 0x000d66 (0x707 bytes) 000053 1763338472.330673 fallocate 0x01ed4e thru 0x02bf59 (0xd20c bytes) 000054 1763338472.335035 write 0x01cf71 thru 0x028390 (0xb420 bytes) 000055 1763338472.344724 trunc from 0x01940a to 0x01bc65 (0x285c bytes) 000056 1763338472.352706 MIRROR_EXTEND to 2 mirrors Size error: expected 0x2bf5a stat 0x2bf5a seek 0x2c000 LOG DUMP (43 total operations): 1: 1763338471.659346 SKIPPED (no operation) 2: 1763338471.659994 SKIPPED (no operation) 3: 1763338471.660420 WRITE 0x3b4fc thru 0x3ffff (0x04b04 bytes) HOLE 4: 1763338471.664343 PUNCH 0x1eefb thru 0x205f6 (0x016fc bytes) 5: 1763338471.680296 TRUNC_DN 0x40000 to 0x35a2f 6: 1763338471.703079 WRITE 0x227a1 thru 0x2c90d (0x0a16d bytes) 7: 1763338471.727288 FALLOC 0x30b0f thru 0x3508c (0x0457d bytes)INTERIOR 8: 1763338471.735023 PUNCH 0x22e0c thru 0x2b3d1 (0x085c6 bytes) 9: 1763338471.775081 ZERO 0x1f318 thru 0x2d7d6 (0x0e4bf bytes) 10: 1763338471.783940 READ 0x08445 thru 0x16789 (0x0e345 bytes) 11: 1763338471.797845 ZERO 0x2e80b thru 0x3576f (0x06f65 bytes) 12: 1763338471.808291 MAPWRITE 0x360bc thru 0x3b70f (0x05654 bytes) 13: 1763338471.874616 ZERO 0x29a42 thru 0x3665a (0x0cc19 bytes) 14: 1763338471.881807 MAPWRITE 0x3e40b thru 0x3ffff (0x01bf5 bytes) 15: 1763338471.944157 PUNCH 0x2d9b6 thru 0x34ab5 (0x07100 bytes) 16: 1763338471.955620 ZERO 0x09e63 thru 0x0bd2c (0x01eca bytes) 17: 1763338471.968658 WRITE 0x1b770 thru 0x1e1ca (0x02a5b bytes) 18: 1763338471.988293 PUNCH 0x36609 thru 0x3ffff (0x099f7 bytes) 19: 1763338471.992967 PUNCH 0x3027b thru 0x38b31 (0x088b7 bytes) 20: 1763338472.000746 MAPWRITE 0x32352 thru 0x37eec (0x05b9b bytes) 21: 1763338472.056279 TRUNC_DN 0x40000 to 0x0584d 22: 1763338472.100403 PUNCH 0x0365f thru 0x0584c (0x021ee bytes) 23: 1763338472.104993 WRITE 0x27769 thru 0x36634 (0x0eecc bytes) HOLE 24: 1763338472.108259 PUNCH 0x28237 thru 0x28d90 (0x00b5a bytes) 25: 1763338472.141514 READ 0x1ef2f thru 0x2d83d (0x0e90f bytes) 26: 1763338472.156710 TRUNC_DN 0x36635 to 0x08a61 27: 1763338472.196625 TRUNC_UP 0x08a61 to 0x22f62 28: 1763338472.219745 FALLOC 0x24c00 thru 0x2f345 (0x0a745 bytes)EXTENDING 29: 1763338472.234661 READ 0x1beab thru 0x1e48b (0x025e1 bytes) 30: 1763338472.253933 MAPWRITE 0x08a8d thru 0x178d3 (0x0ee47 bytes) 31: 1763338472.291091 ZERO 0x2449f thru 0x2b701 (0x07263 bytes) 32: 1763338472.297251 TRUNC_DN 0x2f345 to 0x00d67 33: 1763338472.311886 READ 0x00ac0 thru 0x00d66 (0x002a7 bytes) 34: 1763338472.312506 MAPREAD 0x00b9d thru 0x00d66 (0x001ca bytes) 35: 1763338472.313276 FALLOC 0x1142f thru 0x1b219 (0x09dea bytes)PAST_EOF 36: 1763338472.321352 READ 0x00447 thru 0x00d66 (0x00920 bytes) 37: 1763338472.322096 MAPREAD 0x0058e thru 0x00d66 (0x007d9 bytes) 38: 1763338472.323502 READ 0x00c1d thru 0x00d66 (0x0014a bytes) 39: 1763338472.324006 PUNCH 0x00660 thru 0x00d66 (0x00707 bytes) 40: 1763338472.330673 FALLOC 0x1ed4e thru 0x2bf5a (0x0d20c bytes)EXTENDING 41: 1763338472.335035 WRITE 0x1cf71 thru 0x28390 (0x0b420 bytes) 42: 1763338472.344724 ZERO 0x1940a thru 0x1bc65 (0x0285c bytes) 43: 1763338472.352706 MIRROR_EXTEND to 2 mirrors Using seed 8471 Correct content saved for comparison (maybe hexdump "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr" vs "/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr.fsxgood") sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7314:error() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3373:test_70a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7690:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7753:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7568:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-flr.sh:3375:main() Dumping lctl log to /tmp/testlogs//sanity-flr.test_70a.*.1763338474.log rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.debug_log.oleg234-server.1763338474.log.t35QIg" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-flr.test_70a.dmesg.oleg234-server.1763338474.log.cs1dG6" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3]