== sanity-flr test 70a: flr mode fsx test ================ 09:03:28 (1789131808) Seed set to 1810 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1032 000001 1789131811.060660 trunc from 00000000 to 0x001031 (0x1032 bytes) 000002 1789131811.077068 read 0x0001a8 thru 0x001031 (0xe8a bytes) truncating to largest ever: 0x30562 000003 1789131811.084252 trunc from 0x001032 to 0x030561 (0x2f530 bytes) 000004 1789131811.099766 write 0x00ee89 thru 0x014531 (0x56a9 bytes) 000005 1789131811.111647 write 0x0049ef thru 0x009197 (0x47a9 bytes) 000006 1789131811.127960 mapread 0x018b67 thru 0x01f732 (0x6bcc bytes) 000007 1789131811.146670 trunc from 0x030562 to 0x02946f (0x70f2 bytes) 000011 1789131811.167900 read 0x028cac thru 0x02946f (0x7c4 bytes) 000012 1789131811.177059 write 0x018856 thru 0x0233ba (0xab65 bytes) truncating to largest ever: 0x34925 000014 1789131811.180120 trunc from 0x029470 to 0x034924 (0xb4b5 bytes) 000017 1789131811.207058 write 0x00246e thru 0x00b042 (0x8bd5 bytes) 000019 1789131811.209596 mapread 0x02fbea thru 0x034924 (0x4d3b bytes) 000020 1789131811.220252 mapwrite 0x0037b1 thru 0x00aeb1 (0x7701 bytes) 000022 1789131811.278681 mapwrite 0x018093 thru 0x019b45 (0x1ab3 bytes) 000023 1789131811.322157 write 0x008512 thru 0x010bbe (0x86ad bytes) 000028 1789131811.332187 trunc from 0x034925 to 0x01841f (0x1c505 bytes) 000029 1789131811.360464 mapwrite 0x0232fa thru 0x02db8a (0xa891 bytes) 000030 1789131811.644782 write 0x00f30c thru 0x013f97 (0x4c8c bytes) 000032 1789131811.650942 write 0x00a6f6 thru 0x018d03 (0xe60e bytes) 000035 1789131811.653606 write 0x014a8b thru 0x01cd06 (0x827c bytes) 000036 1789131811.665899 write 0x003095 thru 0x00a2a9 (0x7215 bytes) 000038 1789131811.671107 trunc from 0x02db8b to 0x02fe67 (0x22dd bytes) 000039 1789131811.705269 trunc from 0x02fe68 to 0x016bb5 (0x192b2 bytes) 000041 1789131811.753734 MIRROR_EXTEND to 2 mirrors 000042 1789131812.878661 read 0x00d805 thru 0x00e57d (0xd79 bytes) 000044 1789131812.885015 read 0x014322 thru 0x016bb5 (0x2894 bytes) 000047 1789131812.896892 write 0x000c66 thru 0x00224e (0x15e9 bytes) 000048 1789131812.973925 mapread 0x00d964 thru 0x014e12 (0x74af bytes) 000052 1789131813.015243 mapwrite 0x039ca7 thru 0x03ffff (0x6359 bytes) 000053 1789131813.115315 read 0x039daf thru 0x03ffff (0x6251 bytes) 000055 1789131813.120208 trunc from 0x040000 to 0x0231af (0x1ce50 bytes) 000056 1789131813.160489 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x231b0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x231b0): Mirror 2: 0x17a80e0e (stale) CRC-32 checksum value for chunk [0, 0x231b0): Mirror 1: 0x65c2758a Mirror 3: 0x65c2758a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x231b0: skipped 000058 1789131814.698749 mapread 0x01a2b6 thru 0x020e91 (0x6bdc bytes) 000059 1789131814.729010 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x231b0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x231b0): Mirror 2: 0x17a80e0e (stale) CRC-32 checksum value for chunk [0, 0x231b0): Mirror 1: 0x65c2758a Mirror 3: 0x65c2758a Mirror 4: 0x65c2758a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x231b0: skipped 000060 1789131815.904565 write 0x0290e0 thru 0x036dde (0xdcff bytes) 000061 1789131815.988983 read 0x001683 thru 0x005bfc (0x457a bytes) 000065 1789131816.005454 mapwrite 0x00b833 thru 0x00c830 (0xffe bytes) 000067 1789131816.060014 trunc from 0x036ddf to 0x017792 (0x1f64c bytes) 000069 1789131816.077283 mapwrite 0x00d5b0 thru 0x0194d8 (0xbf29 bytes) 000070 1789131816.190416 mapread 0x00cde8 thru 0x00fb47 (0x2d60 bytes) 000071 1789131816.192118 mapwrite 0x01f55c thru 0x029080 (0x9b25 bytes) 000074 1789131816.295249 write 0x0291aa thru 0x02df08 (0x4d5f bytes) 000076 1789131816.298284 mapread 0x000e0d thru 0x004316 (0x350a bytes) 000077 1789131816.306291 mapwrite 0x0248e3 thru 0x02c9cc (0x80ea bytes) 000078 1789131816.357464 write 0x02fd85 thru 0x03f9f0 (0xfc6c bytes) 000079 1789131816.360541 read 0x031497 thru 0x03b25c (0x9dc6 bytes) 000080 1789131816.365840 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f9f1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f9f1): Mirror 2: 0x3b956431 (stale) Mirror 3: 0x61b00864 (stale) Mirror 4: 0x61b00864 (stale) CRC-32 checksum value for chunk [0, 0x3f9f1): Mirror 1: 0xb948b17a Mirror 5: 0xb948b17a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f9f1: skipped 000081 1789131817.518271 MIRROR_RESYNC 5 mirrors 000083 1789131818.569550 mapread 0x02c1a2 thru 0x03b497 (0xf2f6 bytes) 000085 1789131818.604388 trunc from 0x03f9f1 to 0x001ce3 (0x3dd0d bytes) 000087 1789131818.705151 mapread 0x000ec0 thru 0x001ce3 (0xe24 bytes) 000088 1789131818.728871 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ce4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce4): Mirror 2: 0x1948d964 (stale) Mirror 3: 0x1948d964 (stale) Mirror 4: 0x1948d964 (stale) Mirror 5: 0x1948d964 (stale) CRC-32 checksum value for chunk [0, 0x1ce4): Mirror 1: 0x1948d964 Mirror 6: 0x1948d964 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce4: skipped 000089 1789131820.120021 trunc from 0x001ce4 to 0x002f17 (0x1234 bytes) 000090 1789131820.321116 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2f18): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f18): Mirror 2: 0xa58b00e1 (stale) Mirror 3: 0xa58b00e1 (stale) Mirror 4: 0xa58b00e1 (stale) Mirror 5: 0xa58b00e1 (stale) Mirror 6: 0x68ee416f (stale) CRC-32 checksum value for chunk [0, 0x2f18): Mirror 1: 0x68ee416f Mirror 7: 0x68ee416f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f18: skipped 000091 1789131821.970249 read 0x000fca thru 0x002f17 (0x1f4e bytes) 000093 1789131821.980599 write 0x039d17 thru 0x03a391 (0x67b bytes) truncating to largest ever: 0x389f0 000094 1789131822.160140 trunc from 0x03a392 to 0x0389ef (0x19a2 bytes) 000097 1789131822.224129 write 0x00d99d thru 0x01054c (0x2bb0 bytes) 000099 1789131822.253134 mapread 0x00eb87 thru 0x013c16 (0x5090 bytes) 000102 1789131822.295718 trunc from 0x0389f0 to 0x02f4fe (0x94f1 bytes) 000103 1789131822.333486 mapwrite 0x018ba0 thru 0x01a4b9 (0x191a bytes) 000104 1789131822.464789 trunc from 0x02f4ff to 0x02319e (0xc360 bytes) 000105 1789131822.497140 mapwrite 0x005e93 thru 0x00eabc (0x8c2a bytes) 000106 1789131822.595246 mapwrite 0x0309e9 thru 0x037735 (0x6d4d bytes) 000108 1789131822.736255 mapwrite 0x00c451 thru 0x0161c0 (0x9d70 bytes) 000109 1789131822.823308 trunc from 0x037736 to 0x02a0c6 (0xd66f bytes) 000110 1789131822.846470 trunc from 0x02a0c7 to 0x01a317 (0xfdaf bytes) 000111 1789131822.883959 read 0x00aca9 thru 0x011eb2 (0x720a bytes) 000113 1789131822.887022 mapwrite 0x00009f thru 0x006bda (0x6b3c bytes) 000114 1789131823.073844 mapwrite 0x03ea6f thru 0x03ffff (0x1591 bytes) 000115 1789131823.263792 write 0x005119 thru 0x00af14 (0x5dfc bytes) 000116 1789131823.265277 write 0x0027f3 thru 0x00ddbb (0xb5c9 bytes) 000118 1789131823.287696 MIRROR_RESYNC 7 mirrors 000120 1789131826.626574 MIRROR_RESYNC 7 mirrors 000121 1789131827.271011 trunc from 0x040000 to 0x014aaa (0x2b555 bytes) 000122 1789131827.379147 mapread 0x002b8a thru 0x00805a (0x54d1 bytes) 000124 1789131827.409037 write 0x0130e8 thru 0x0188dd (0x57f6 bytes) 000125 1789131827.429093 mapread 0x003607 thru 0x00af61 (0x795b bytes) 000126 1789131827.431110 write 0x03af2b thru 0x03ffff (0x50d5 bytes) 000130 1789131827.439172 trunc from 0x040000 to 0x024208 (0x1bdf7 bytes) 000131 1789131827.503336 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x24209): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24209): Mirror 2: 0x6af9f439 (stale) Mirror 3: 0x6af9f439 (stale) Mirror 4: 0x6af9f439 (stale) Mirror 5: 0x6af9f439 (stale) Mirror 6: 0x6af9f439 (stale) Mirror 7: 0x6af9f439 (stale) CRC-32 checksum value for chunk [0, 0x24209): Mirror 1: 0x36d969aa Mirror 8: 0x36d969aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24209: skipped 000132 1789131829.372346 write 0x000a2a thru 0x00fb33 (0xf10a bytes) 000133 1789131829.627127 mapwrite 0x004944 thru 0x01395f (0xf01c bytes) 000134 1789131829.814635 read 0x01cc76 thru 0x023030 (0x63bb bytes) 000136 1789131829.837863 mapwrite 0x0277c1 thru 0x02a570 (0x2db0 bytes) 000137 1789131830.087958 read 0x01c99f thru 0x01cc7d (0x2df bytes) 000138 1789131830.109047 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a571): Mirror 2: 0x11095f69 (stale) Mirror 3: 0x11095f69 (stale) Mirror 4: 0x11095f69 (stale) Mirror 5: 0x11095f69 (stale) Mirror 7: 0x11095f69 (stale) Mirror 8: 0x64bc733a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a571): Mirror 2: 0x11095f69 (stale) Mirror 3: 0x11095f69 (stale) Mirror 4: 0x11095f69 (stale) Mirror 5: 0x11095f69 (stale) Mirror 7: 0x11095f69 (stale) Mirror 8: 0x64bc733a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a571: skipped 000142 1789131831.180685 mapread 0x0170ed thru 0x0212d1 (0xa1e5 bytes) 000143 1789131831.208974 read 0x027e1e thru 0x02a570 (0x2753 bytes) 000144 1789131831.216117 read 0x016df4 thru 0x018a4d (0x1c5a bytes) 000145 1789131831.216699 read 0x0171b3 thru 0x0264dc (0xf32a bytes) 000147 1789131831.232859 trunc from 0x02a571 to 0x018069 (0x12507 bytes) 000148 1789131831.278796 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1806a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1806a): Mirror 2: 0x432d594d (stale) Mirror 3: 0x432d594d (stale) Mirror 4: 0x432d594d (stale) Mirror 5: 0x432d594d (stale) Mirror 7: 0x432d594d (stale) Mirror 8: 0xb3812833 (stale) CRC-32 checksum value for chunk [0, 0x1806a): Mirror 1: 0x26200179 Mirror 9: 0x26200179 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1806a: skipped 000149 1789131832.652100 mapwrite 0x008666 thru 0x0123a3 (0x9d3e bytes) 000151 1789131832.961472 read 0x005e28 thru 0x013b77 (0xdd50 bytes) 000152 1789131832.962812 write 0x023df5 thru 0x033b9d (0xfda9 bytes) 000153 1789131832.966865 trunc from 0x033b9e to 0x0113d7 (0x227c6 bytes) 000154 1789131833.031561 mapwrite 0x031147 thru 0x037e81 (0x6d3b bytes) 000155 1789131833.129215 write 0x003518 thru 0x009492 (0x5f7b bytes) 000159 1789131833.152993 mapwrite 0x032abb thru 0x03ffff (0xd545 bytes) 000161 1789131833.358420 trunc from 0x040000 to 0x013ef6 (0x2c109 bytes) 000162 1789131833.390920 mapread 0x00cd29 thru 0x013ef6 (0x71ce bytes) 000163 1789131833.400901 write 0x01daf8 thru 0x02a89c (0xcda5 bytes) 000164 1789131833.403333 mapread 0x028d8f thru 0x02a89c (0x1b0e bytes) 000165 1789131833.427477 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2a89d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a89d): Mirror 2: 0x2d2e7fed (stale) Mirror 3: 0x2d2e7fed (stale) Mirror 4: 0x2d2e7fed (stale) Mirror 5: 0x2d2e7fed (stale) Mirror 7: 0x2d2e7fed (stale) Mirror 8: 0x801ddd67 (stale) Mirror 9: 0x207887af (stale) CRC-32 checksum value for chunk [0, 0x2a89d): Mirror 1: 0xfd5b9646 Mirror 10: 0xfd5b9646 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a89d: skipped 000166 1789131835.175073 read 0x01b347 thru 0x0261f5 (0xaeaf bytes) 000167 1789131835.187774 mapwrite 0x00601b thru 0x00df0a (0x7ef0 bytes) 000169 1789131835.375444 mapread 0x0070db thru 0x00c514 (0x543a bytes) 000170 1789131835.376347 write 0x03c785 thru 0x03ffff (0x387b bytes) 000172 1789131835.377954 write 0x01ac4e thru 0x02749a (0xc84d bytes) 000173 1789131835.393095 mapread 0x00e6b7 thru 0x0117f6 (0x3140 bytes) 000175 1789131835.413992 mapread 0x02b9b9 thru 0x039558 (0xdba0 bytes) 000177 1789131835.481001 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf9a92a73 (stale) Mirror 3: 0xf9a92a73 (stale) Mirror 4: 0xf9a92a73 (stale) Mirror 5: 0xf9a92a73 (stale) Mirror 7: 0xf9a92a73 (stale) Mirror 8: 0xd6fe5b4b (stale) Mirror 9: 0x35e37a9e (stale) Mirror 10: 0xd1dc9d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9c4bbd6f Mirror 11: 0x9c4bbd6f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000178 1789131837.189504 read 0x03a6fc thru 0x03ffff (0x5904 bytes) 000179 1789131837.197451 mapwrite 0x029f08 thru 0x031b0f (0x7c08 bytes) 000181 1789131837.523304 mapwrite 0x03fa77 thru 0x03ffff (0x589 bytes) 000182 1789131837.659989 write 0x035d8e thru 0x03ffff (0xa272 bytes) 000183 1789131837.674634 read 0x00b9c3 thru 0x00e53b (0x2b79 bytes) 000184 1789131837.696822 trunc from 0x040000 to 0x01228e (0x2dd71 bytes) 000186 1789131837.766248 mapwrite 0x036f46 thru 0x03ffff (0x90ba bytes) 000187 1789131838.065052 mapread 0x02f667 thru 0x03412d (0x4ac7 bytes) 000188 1789131838.133083 mapread 0x02001b thru 0x02a6ec (0xa6d2 bytes) 000191 1789131838.243999 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf9a92a73 (stale) Mirror 3: 0xf9a92a73 (stale) Mirror 5: 0xf9a92a73 (stale) Mirror 7: 0xf9a92a73 (stale) Mirror 8: 0xd6fe5b4b (stale) Mirror 9: 0x35e37a9e (stale) Mirror 10: 0xd1dc9d3 (stale) Mirror 11: 0x9c4bbd6f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf9a92a73 (stale) Mirror 3: 0xf9a92a73 (stale) Mirror 5: 0xf9a92a73 (stale) Mirror 7: 0xf9a92a73 (stale) Mirror 8: 0xd6fe5b4b (stale) Mirror 9: 0x35e37a9e (stale) Mirror 10: 0xd1dc9d3 (stale) Mirror 11: 0x9c4bbd6f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000192 1789131838.870420 write 0x0156e1 thru 0x01cc3c (0x755c bytes) 000195 1789131838.882838 write 0x0089c1 thru 0x015bbb (0xd1fb bytes) 000196 1789131838.888189 read 0x010795 thru 0x0165de (0x5e4a bytes) 000197 1789131838.889103 read 0x02f777 thru 0x0301c2 (0xa4c bytes) 000198 1789131838.906819 read 0x00e728 thru 0x00ed10 (0x5e9 bytes) 000200 1789131838.911076 write 0x03dabc thru 0x03ffff (0x2544 bytes) 000201 1789131838.912763 trunc from 0x040000 to 0x016d1a (0x292e5 bytes) 000202 1789131838.942275 mapwrite 0x03a7f7 thru 0x03ec92 (0x449c bytes) 000203 1789131839.043230 read 0x0078b8 thru 0x00a004 (0x274d bytes) 000204 1789131839.044306 trunc from 0x03ec93 to 0x01e454 (0x2083e bytes) 000206 1789131839.102141 read 0x00d2be thru 0x011e92 (0x4bd5 bytes) 000207 1789131839.109408 mapread 0x01c6fa thru 0x01e454 (0x1d5b bytes) 000208 1789131839.122398 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e455): Mirror 2: 0xe6959ce7 (stale) Mirror 5: 0xe6959ce7 (stale) Mirror 7: 0xe6959ce7 (stale) Mirror 8: 0x8ae9ed63 (stale) Mirror 9: 0xf8ee5f5b (stale) Mirror 10: 0x6efcd12f (stale) Mirror 11: 0xc6f99c30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e455): Mirror 2: 0xe6959ce7 (stale) Mirror 5: 0xe6959ce7 (stale) Mirror 7: 0xe6959ce7 (stale) Mirror 8: 0x8ae9ed63 (stale) Mirror 9: 0xf8ee5f5b (stale) Mirror 10: 0x6efcd12f (stale) Mirror 11: 0xc6f99c30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e455: skipped 000209 1789131839.897872 MIRROR_RESYNC 8 mirrors 000210 1789131841.441208 MIRROR_RESYNC 8 mirrors 000211 1789131842.306173 read 0x009abc thru 0x018913 (0xee58 bytes) 000213 1789131842.315651 write 0x0200e5 thru 0x028452 (0x836e bytes) 000214 1789131842.448807 write 0x0306ca thru 0x032e53 (0x278a bytes) 000215 1789131842.451855 write 0x003f71 thru 0x00f6ef (0xb77f bytes) 000217 1789131842.477207 trunc from 0x032e54 to 0x020b49 (0x1230a bytes) 000218 1789131842.531362 mapwrite 0x01519a thru 0x01b342 (0x61a9 bytes) 000219 1789131842.660302 MIRROR_RESYNC 8 mirrors 000220 1789131844.054028 read 0x0120bb thru 0x0179b1 (0x58f7 bytes) 000221 1789131844.067316 write 0x008aaa thru 0x00bd69 (0x32c0 bytes) 000222 1789131844.190507 trunc from 0x020b4a to 0x00413d (0x1ca0c bytes) 000223 1789131844.217963 write 0x017c14 thru 0x01cafd (0x4eea bytes) truncating to largest ever: 0x3f309 000226 1789131844.224092 trunc from 0x01cafe to 0x03f308 (0x2280b bytes) 000228 1789131844.245125 trunc from 0x03f309 to 0x035b97 (0x9771 bytes) 000229 1789131844.282801 trunc from 0x035b98 to 0x01df25 (0x17c72 bytes) 000230 1789131844.313509 mapread 0x0192a3 thru 0x01a1cb (0xf29 bytes) 000232 1789131844.315200 read 0x01d7af thru 0x01df25 (0x777 bytes) 000235 1789131844.326339 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1df26): Mirror 2: 0x842ba06d (stale) Mirror 5: 0x842ba06d (stale) Mirror 7: 0x842ba06d (stale) Mirror 8: 0x842ba06d (stale) Mirror 10: 0x842ba06d (stale) Mirror 11: 0x842ba06d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1df26): Mirror 2: 0x842ba06d (stale) Mirror 5: 0x842ba06d (stale) Mirror 7: 0x842ba06d (stale) Mirror 8: 0x842ba06d (stale) Mirror 10: 0x842ba06d (stale) Mirror 11: 0x842ba06d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1df26: skipped 000236 1789131844.834956 trunc from 0x01df26 to 0x0249b4 (0x6a8f bytes) 000237 1789131844.863891 write 0x033c0c thru 0x035775 (0x1b6a bytes) 000239 1789131844.867727 write 0x0057ed thru 0x006243 (0xa57 bytes) 000241 1789131844.881027 trunc from 0x035776 to 0x00b18e (0x2a5e7 bytes) 000242 1789131844.905004 trunc from 0x00b18f to 0x03089f (0x25711 bytes) 000244 1789131844.925064 write 0x034723 thru 0x03ffff (0xb8dd bytes) 000246 1789131844.927080 mapwrite 0x02e0a1 thru 0x03649c (0x83fc bytes) 000247 1789131845.038273 mapread 0x004e08 thru 0x0099a5 (0x4b9e bytes) 000248 1789131845.054623 mapwrite 0x01ca81 thru 0x02b98a (0xef0a bytes) 000250 1789131845.134724 write 0x031b5d thru 0x034abf (0x2f63 bytes) 000252 1789131845.136896 mapread 0x03241f thru 0x03ffff (0xdbe1 bytes) 000253 1789131845.138700 mapread 0x023f6b thru 0x030149 (0xc1df bytes) 000255 1789131845.141208 write 0x01048f thru 0x01f096 (0xec08 bytes) 000256 1789131845.143964 mapwrite 0x00a45f thru 0x00fdb0 (0x5952 bytes) 000257 1789131845.276212 read 0x02bbb3 thru 0x03894d (0xcd9b bytes) 000260 1789131845.277803 write 0x037bd8 thru 0x03ffff (0x8428 bytes) 000261 1789131845.287762 read 0x03168a thru 0x03ffff (0xe976 bytes) 000262 1789131845.316360 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd68fd8f7 (stale) Mirror 5: 0xd68fd8f7 (stale) Mirror 7: 0xd68fd8f7 (stale) Mirror 8: 0xd68fd8f7 (stale) Mirror 10: 0xd68fd8f7 (stale) Mirror 11: 0xd68fd8f7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3283fb8a Mirror 12: 0x3283fb8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000264 1789131846.543016 mapread 0x00f3ec thru 0x011e5c (0x2a71 bytes) 000265 1789131846.561353 mapwrite 0x01e1f6 thru 0x02ca9f (0xe8aa bytes) 000266 1789131846.750793 read 0x03c677 thru 0x03ffff (0x3989 bytes) 000268 1789131846.763119 read 0x037091 thru 0x03ecc8 (0x7c38 bytes) 000269 1789131846.777344 write 0x007b30 thru 0x0097f0 (0x1cc1 bytes) 000270 1789131846.778877 read 0x019bf9 thru 0x027f80 (0xe388 bytes) 000271 1789131846.781645 mapwrite 0x007440 thru 0x0092e1 (0x1ea2 bytes) 000272 1789131846.855693 trunc from 0x040000 to 0x0232d7 (0x1cd28 bytes) 000273 1789131846.926196 mapwrite 0x033250 thru 0x036151 (0x2f02 bytes) 000274 1789131847.051136 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x36152): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36152): Mirror 2: 0xacbe4650 (stale) Mirror 5: 0xacbe4650 (stale) Mirror 7: 0xacbe4650 (stale) Mirror 8: 0xacbe4650 (stale) Mirror 10: 0xacbe4650 (stale) Mirror 11: 0xacbe4650 (stale) Mirror 12: 0x15e52703 (stale) CRC-32 checksum value for chunk [0, 0x36152): Mirror 1: 0xe1e5d9df Mirror 13: 0xe1e5d9df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36152: skipped 000275 1789131848.287295 trunc from 0x036152 to 0x03ebfe (0x8aad bytes) 000277 1789131848.426102 read 0x02d717 thru 0x03966e (0xbf58 bytes) 000281 1789131848.441991 mapwrite 0x011616 thru 0x01ff60 (0xe94b bytes) 000282 1789131848.589954 mapwrite 0x03c1a2 thru 0x03eb04 (0x2963 bytes) 000283 1789131848.648014 write 0x0231a7 thru 0x0292d3 (0x612d bytes) 000284 1789131848.655952 write 0x02e8df thru 0x03c1f8 (0xd91a bytes) 000285 1789131848.664303 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3ebff): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebff): Mirror 2: 0xdc700467 (stale) Mirror 5: 0xdc700467 (stale) Mirror 7: 0xdc700467 (stale) Mirror 8: 0xdc700467 (stale) Mirror 10: 0xdc700467 (stale) Mirror 11: 0xdc700467 (stale) Mirror 12: 0x3b8b2ed4 (stale) Mirror 13: 0x1d8ad80b (stale) CRC-32 checksum value for chunk [0, 0x3ebff): Mirror 1: 0x8877f4ea Mirror 14: 0x8877f4ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebff: skipped 000287 1789131850.039806 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ebff): Mirror 2: 0xdc700467 (stale) Mirror 5: 0xdc700467 (stale) Mirror 7: 0xdc700467 (stale) Mirror 8: 0xdc700467 (stale) Mirror 10: 0xdc700467 (stale) Mirror 11: 0xdc700467 (stale) Mirror 12: 0x3b8b2ed4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebff): Mirror 2: 0xdc700467 (stale) Mirror 5: 0xdc700467 (stale) Mirror 7: 0xdc700467 (stale) Mirror 8: 0xdc700467 (stale) Mirror 10: 0xdc700467 (stale) Mirror 11: 0xdc700467 (stale) Mirror 12: 0x3b8b2ed4 (stale) CRC-32 checksum value for chunk [0, 0x3ebff): Mirror 1: 0x8877f4ea Mirror 14: 0x8877f4ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebff: skipped 000288 1789131850.777165 write 0x02d0c0 thru 0x02fd41 (0x2c82 bytes) 000289 1789131850.894721 mapread 0x03c746 thru 0x03ebfe (0x24b9 bytes) 000290 1789131850.936730 trunc from 0x03ebff to 0x00eb87 (0x30077 bytes) 000291 1789131850.972148 mapwrite 0x000c65 thru 0x0020db (0x1477 bytes) 000295 1789131851.091832 trunc from 0x00eb88 to 0x020b16 (0x11f8f bytes) 000297 1789131851.126255 trunc from 0x020b17 to 0x024316 (0x3800 bytes) 000298 1789131851.156298 trunc from 0x024317 to 0x0332ac (0xef96 bytes) 000299 1789131851.178563 trunc from 0x0332ad to 0x014556 (0x1ed56 bytes) 000301 1789131851.200810 mapwrite 0x031c68 thru 0x0342c5 (0x265e bytes) 000303 1789131851.267945 mapread 0x0315fe thru 0x0342c5 (0x2cc8 bytes) 000305 1789131851.270586 trunc from 0x0342c6 to 0x0313d0 (0x2ef5 bytes) 000306 1789131851.297990 read 0x029e94 thru 0x030a63 (0x6bd0 bytes) 000308 1789131851.304456 write 0x0226dc thru 0x0239cf (0x12f4 bytes) 000309 1789131851.312233 mapwrite 0x02fd0b thru 0x03f4ef (0xf7e5 bytes) 000310 1789131851.473220 read 0x005867 thru 0x0132b0 (0xda4a bytes) 000312 1789131851.485813 mapread 0x03488b thru 0x03d90e (0x9084 bytes) 000314 1789131851.487222 read 0x033ca2 thru 0x037853 (0x3bb2 bytes) 000315 1789131851.489849 mapwrite 0x006f54 thru 0x00aa0d (0x3aba bytes) 000316 1789131851.556214 mapwrite 0x012db3 thru 0x01d165 (0xa3b3 bytes) 000317 1789131851.677778 read 0x00957a thru 0x00b4e1 (0x1f68 bytes) 000318 1789131851.681302 read 0x018d8a thru 0x01e406 (0x567d bytes) 000319 1789131851.683801 read 0x03f27a thru 0x03f4ef (0x276 bytes) 000320 1789131851.685694 mapwrite 0x003bc8 thru 0x00c6d3 (0x8b0c bytes) 000321 1789131851.826137 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f4f0): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f4f0): Mirror 2: 0x2fa546ef (stale) Mirror 5: 0x2fa546ef (stale) Mirror 7: 0x2fa546ef (stale) Mirror 8: 0x2fa546ef (stale) Mirror 10: 0x2fa546ef (stale) Mirror 11: 0x2fa546ef (stale) Mirror 12: 0xd928ce58 (stale) Mirror 14: 0xb9e7b7e0 (stale) CRC-32 checksum value for chunk [0, 0x3f4f0): Mirror 1: 0xe1a74c42 Mirror 15: 0xe1a74c42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f4f0: skipped 000322 1789131853.546919 read 0x03e11c thru 0x03e6bb (0x5a0 bytes) 000328 1789131853.559206 trunc from 0x03f4f0 to 0x039463 (0x608c bytes) 000329 1789131853.794914 write 0x022391 thru 0x03228c (0xfefc bytes) 000330 1789131853.817796 mapread 0x01d298 thru 0x01ed0b (0x1a74 bytes) 000332 1789131853.851777 trunc from 0x039464 to 0x00d82f (0x2bc34 bytes) 000333 1789131853.902839 mapwrite 0x01b5e5 thru 0x01cf3f (0x195b bytes) 000336 1789131854.014435 mapwrite 0x01c954 thru 0x020805 (0x3eb2 bytes) 000338 1789131854.090068 write 0x00061a thru 0x0078b0 (0x7297 bytes) 000339 1789131854.106246 mapread 0x01fd6c thru 0x020805 (0xa9a bytes) 000340 1789131854.110731 write 0x0019e5 thru 0x0066f6 (0x4d12 bytes) 000342 1789131854.113289 write 0x03a425 thru 0x03ffff (0x5bdb bytes) 000344 1789131854.117161 trunc from 0x040000 to 0x03e7c3 (0x183c bytes) 000348 1789131854.145227 read 0x03029a thru 0x03d676 (0xd3dd bytes) 000349 1789131854.160492 mapread 0x016349 thru 0x01fcc4 (0x997c bytes) 000351 1789131854.162150 mapread 0x004ccb thru 0x008e5f (0x4195 bytes) 000353 1789131854.164857 mapread 0x01209f thru 0x0135e3 (0x1545 bytes) 000354 1789131854.165863 mapwrite 0x013ad8 thru 0x021982 (0xdeab bytes) 000355 1789131854.231924 read 0x0192b4 thru 0x01d95b (0x46a8 bytes) 000356 1789131854.232508 trunc from 0x03e7c4 to 0x027619 (0x171aa bytes) 000358 1789131854.252915 mapwrite 0x03466d thru 0x03ffff (0xb993 bytes) 000361 1789131854.351331 mapwrite 0x029ad0 thru 0x034fbf (0xb4f0 bytes) 000363 1789131854.419701 write 0x0389f9 thru 0x038f47 (0x54f bytes) 000364 1789131854.425045 MIRROR_RESYNC 10 mirrors 000366 1789131856.838638 trunc from 0x040000 to 0x0010ac (0x3ef53 bytes) 000369 1789131856.995785 mapwrite 0x031aa8 thru 0x033b80 (0x20d9 bytes) 000371 1789131857.270240 read 0x017d6b thru 0x019dfb (0x2091 bytes) 000372 1789131857.292449 trunc from 0x033b81 to 0x00669a (0x2d4e6 bytes) 000373 1789131857.347192 read 0x00102f thru 0x0035a5 (0x2577 bytes) 000375 1789131857.377746 write 0x03cfe7 thru 0x03ffff (0x3019 bytes) 000376 1789131857.393684 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdc3f8d33 (stale) Mirror 5: 0xdc3f8d33 (stale) Mirror 7: 0xdc3f8d33 (stale) Mirror 8: 0xdc3f8d33 (stale) Mirror 10: 0xdc3f8d33 (stale) Mirror 11: 0xdc3f8d33 (stale) Mirror 12: 0xdc3f8d33 (stale) Mirror 15: 0xdc3f8d33 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdc3f8d33 (stale) Mirror 5: 0xdc3f8d33 (stale) Mirror 7: 0xdc3f8d33 (stale) Mirror 8: 0xdc3f8d33 (stale) Mirror 10: 0xdc3f8d33 (stale) Mirror 11: 0xdc3f8d33 (stale) Mirror 12: 0xdc3f8d33 (stale) Mirror 15: 0xdc3f8d33 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000377 1789131858.698375 mapread 0x039592 thru 0x03ff72 (0x69e1 bytes) 000378 1789131858.736356 read 0x010f8b thru 0x020392 (0xf408 bytes) 000380 1789131858.749193 mapwrite 0x028c4d thru 0x037c9d (0xf051 bytes) 000383 1789131859.002240 write 0x022aae thru 0x026dc1 (0x4314 bytes) 000384 1789131859.039166 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdc3f8d33 (stale) Mirror 5: 0xdc3f8d33 (stale) Mirror 7: 0xdc3f8d33 (stale) Mirror 8: 0xdc3f8d33 (stale) Mirror 10: 0xdc3f8d33 (stale) Mirror 11: 0xdc3f8d33 (stale) Mirror 12: 0xdc3f8d33 (stale) Mirror 15: 0xdc3f8d33 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xca14aaf4 Mirror 16: 0xca14aaf4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000386 1789131860.722501 write 0x010554 thru 0x0196f8 (0x91a5 bytes) 000387 1789131860.907739 write 0x02a0a1 thru 0x033b36 (0x9a96 bytes) 000388 1789131860.928007 trunc from 0x040000 to 0x03c73c (0x38c3 bytes) 000390 1789131861.000614 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3c73d): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c73d): Mirror 2: 0xa29fc722 (stale) Mirror 5: 0xa29fc722 (stale) Mirror 7: 0xa29fc722 (stale) Mirror 8: 0xa29fc722 (stale) Mirror 10: 0xa29fc722 (stale) Mirror 11: 0xa29fc722 (stale) Mirror 12: 0xa29fc722 (stale) Mirror 15: 0xa29fc722 (stale) Mirror 16: 0xdd8fe6a7 (stale) CRC-32 checksum value for chunk [0, 0x3c73d): Mirror 1: 0x47d682f2 Mirror 17: 0x47d682f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c73d: skipped 000391 1789131863.233645 MIRROR_RESYNC 11 mirrors 000392 1789131867.079723 read 0x01375b thru 0x01ff02 (0xc7a8 bytes) 000393 1789131867.120147 read 0x03543e thru 0x0384f9 (0x30bc bytes) 000394 1789131867.133856 read 0x023b71 thru 0x0290bd (0x554d bytes) 000395 1789131867.136112 write 0x03c015 thru 0x03ffff (0x3feb bytes) 000396 1789131867.232289 mapread 0x036da5 thru 0x03ffff (0x925b bytes) 000397 1789131867.234760 mapwrite 0x023b1a thru 0x033336 (0xf81d bytes) 000399 1789131867.305948 mapwrite 0x01df34 thru 0x024325 (0x63f2 bytes) 000400 1789131867.364477 write 0x001c24 thru 0x01031f (0xe6fc bytes) 000402 1789131867.369191 read 0x03a640 thru 0x03b64d (0x100e bytes) 000404 1789131867.375793 mapread 0x004f80 thru 0x00fd07 (0xad88 bytes) 000406 1789131867.379307 read 0x029d8e thru 0x02a931 (0xba4 bytes) 000407 1789131867.380499 mapread 0x0092c1 thru 0x00e19b (0x4edb bytes) 000409 1789131867.382675 read 0x03890e thru 0x03f3fe (0x6af1 bytes) 000410 1789131867.387910 MIRROR_RESYNC 11 mirrors 000411 1789131870.414739 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) 000413 1789131871.059837 read 0x01fdb0 thru 0x024e51 (0x50a2 bytes) 000415 1789131871.072657 write 0x02736b thru 0x027873 (0x509 bytes) 000417 1789131871.209271 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x25a9455d (stale) Mirror 5: 0x25a9455d (stale) Mirror 7: 0x25a9455d (stale) Mirror 8: 0x25a9455d (stale) Mirror 10: 0x25a9455d (stale) Mirror 11: 0x25a9455d (stale) Mirror 12: 0x25a9455d (stale) Mirror 15: 0x25a9455d (stale) Mirror 17: 0x25a9455d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x70d95594 Mirror 18: 0x70d95594 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000420 1789131872.806030 mapread 0x022b29 thru 0x028b53 (0x602b bytes) 000421 1789131872.826500 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x25a9455d (stale) Mirror 5: 0x25a9455d (stale) Mirror 7: 0x25a9455d (stale) Mirror 8: 0x25a9455d (stale) Mirror 10: 0x25a9455d (stale) Mirror 11: 0x25a9455d (stale) Mirror 12: 0x25a9455d (stale) Mirror 15: 0x25a9455d (stale) Mirror 17: 0x25a9455d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x25a9455d (stale) Mirror 5: 0x25a9455d (stale) Mirror 7: 0x25a9455d (stale) Mirror 8: 0x25a9455d (stale) Mirror 10: 0x25a9455d (stale) Mirror 11: 0x25a9455d (stale) Mirror 12: 0x25a9455d (stale) Mirror 15: 0x25a9455d (stale) Mirror 17: 0x25a9455d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000424 1789131873.463039 mapread 0x024a27 thru 0x0331c2 (0xe79c bytes) 000425 1789131873.500066 trunc from 0x040000 to 0x0292c7 (0x16d38 bytes) 000428 1789131873.546067 mapread 0x0053cc thru 0x012ba7 (0xd7dc bytes) 000429 1789131873.610674 read 0x01f030 thru 0x028809 (0x97da bytes) 000432 1789131873.665613 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x292c8): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x292c8): Mirror 2: 0x77990a52 (stale) Mirror 5: 0x77990a52 (stale) Mirror 7: 0x77990a52 (stale) Mirror 8: 0x77990a52 (stale) Mirror 10: 0x77990a52 (stale) Mirror 11: 0x77990a52 (stale) Mirror 12: 0x77990a52 (stale) Mirror 15: 0x77990a52 (stale) Mirror 17: 0x77990a52 (stale) CRC-32 checksum value for chunk [0, 0x292c8): Mirror 1: 0xe4eaeac8 Mirror 18: 0xe4eaeac8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x292c8: skipped 000434 1789131875.812424 MIRROR_RESYNC 11 mirrors 000435 1789131879.603215 trunc from 0x0292c8 to 0x00be6d (0x1d45a bytes) 000436 1789131879.782266 mapread 0x00b7f4 thru 0x00be6d (0x67a bytes) 000439 1789131879.793141 mapwrite 0x03a181 thru 0x03ffff (0x5e7f bytes) 000443 1789131879.944453 mapread 0x03594e thru 0x038f97 (0x364a bytes) 000444 1789131879.952360 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfb75ebbb (stale) Mirror 5: 0xfb75ebbb (stale) Mirror 7: 0xfb75ebbb (stale) Mirror 8: 0xfb75ebbb (stale) Mirror 11: 0xfb75ebbb (stale) Mirror 12: 0xfb75ebbb (stale) Mirror 15: 0xfb75ebbb (stale) Mirror 17: 0xfb75ebbb (stale) Mirror 18: 0xfb75ebbb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfb75ebbb (stale) Mirror 5: 0xfb75ebbb (stale) Mirror 7: 0xfb75ebbb (stale) Mirror 8: 0xfb75ebbb (stale) Mirror 11: 0xfb75ebbb (stale) Mirror 12: 0xfb75ebbb (stale) Mirror 15: 0xfb75ebbb (stale) Mirror 17: 0xfb75ebbb (stale) Mirror 18: 0xfb75ebbb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000445 1789131881.124696 mapread 0x018a3a thru 0x01a817 (0x1dde bytes) 000446 1789131881.230886 mapread 0x030f25 thru 0x03fd85 (0xee61 bytes) 000447 1789131881.275072 mapread 0x01b306 thru 0x027784 (0xc47f bytes) 000452 1789131881.305384 trunc from 0x040000 to 0x013e52 (0x2c1ad bytes) 000453 1789131881.355086 trunc from 0x013e53 to 0x037bdc (0x23d8a bytes) 000454 1789131881.408130 MIRROR_RESYNC 10 mirrors 000456 1789131883.467950 mapread 0x00c590 thru 0x010048 (0x3ab9 bytes) 000457 1789131883.536411 write 0x021938 thru 0x02b9a2 (0xa06b bytes) 000458 1789131883.746792 MIRROR_RESYNC 10 mirrors 000459 1789131886.218483 MIRROR_EXTEND to 11 mirrors 000462 1789131887.616593 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) 000463 1789131888.398879 read 0x00516f thru 0x00674b (0x15dd bytes) 000464 1789131888.405122 write 0x0108c9 thru 0x0155cd (0x4d05 bytes) 000465 1789131888.523134 read 0x024cf1 thru 0x03337b (0xe68b bytes) 000466 1789131888.547070 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37bdd): Mirror 5: 0xafbee455 (stale) Mirror 7: 0xafbee455 (stale) Mirror 8: 0xafbee455 (stale) Mirror 11: 0xafbee455 (stale) Mirror 12: 0xafbee455 (stale) Mirror 17: 0xafbee455 (stale) Mirror 18: 0xafbee455 (stale) Mirror 19: 0xafbee455 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37bdd): Mirror 5: 0xafbee455 (stale) Mirror 7: 0xafbee455 (stale) Mirror 8: 0xafbee455 (stale) Mirror 11: 0xafbee455 (stale) Mirror 12: 0xafbee455 (stale) Mirror 17: 0xafbee455 (stale) Mirror 18: 0xafbee455 (stale) Mirror 19: 0xafbee455 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37bdd: skipped 000468 1789131889.253811 write 0x0264be thru 0x029a02 (0x3545 bytes) 000469 1789131889.268573 write 0x012efa thru 0x021935 (0xea3c bytes) 000470 1789131889.284256 mapread 0x00edc3 thru 0x015c41 (0x6e7f bytes) 000472 1789131889.313183 read 0x007316 thru 0x013128 (0xbe13 bytes) 000475 1789131889.322747 mapwrite 0x00b6be thru 0x0179d4 (0xc317 bytes) 000476 1789131889.393869 read 0x00d275 thru 0x0176da (0xa466 bytes) 000479 1789131889.395645 read 0x00d1e3 thru 0x01bda8 (0xebc6 bytes) 000480 1789131889.402954 MIRROR_RESYNC 9 mirrors 000481 1789131891.783792 mapwrite 0x01abe3 thru 0x028e34 (0xe252 bytes) 000482 1789131892.072349 trunc from 0x037bdd to 0x015743 (0x22499 bytes) 000483 1789131892.118446 write 0x037aaa thru 0x03ad19 (0x3270 bytes) 000484 1789131892.122379 trunc from 0x03ad1a to 0x009ee6 (0x30e33 bytes) 000486 1789131892.155344 read 0x005c71 thru 0x009ee6 (0x4276 bytes) 000489 1789131892.175499 trunc from 0x009ee7 to 0x00f8b7 (0x59d1 bytes) 000490 1789131892.260608 MIRROR_RESYNC 9 mirrors 000491 1789131893.719807 write 0x01cd6b thru 0x02020e (0x34a4 bytes) 000494 1789131893.876141 mapread 0x0110a0 thru 0x014499 (0x33fa bytes) 000495 1789131893.908018 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2020f): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2020f): Mirror 5: 0x4a46503d (stale) Mirror 7: 0x4a46503d (stale) Mirror 8: 0x4a46503d (stale) Mirror 11: 0x4a46503d (stale) Mirror 12: 0x4a46503d (stale) Mirror 17: 0x4a46503d (stale) Mirror 18: 0x4a46503d (stale) Mirror 19: 0x4a46503d (stale) CRC-32 checksum value for chunk [0, 0x2020f): Mirror 1: 0xe41f296f Mirror 20: 0xe41f296f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2020f: skipped 000500 1789131895.277087 read 0x017f81 thru 0x02020e (0x828e bytes) 000501 1789131895.290557 read 0x01407c thru 0x01c3cf (0x8354 bytes) 000508 1789131895.314188 write 0x016046 thru 0x018f25 (0x2ee0 bytes) 000509 1789131895.396037 trunc from 0x02020f to 0x015437 (0xadd7 bytes) 000514 1789131895.421597 mapwrite 0x028844 thru 0x02f455 (0x6c12 bytes) 000517 1789131895.503820 mapwrite 0x035577 thru 0x03ffff (0xaa89 bytes) 000518 1789131895.594458 write 0x03d843 thru 0x03ffff (0x27bd bytes) 000520 1789131895.597710 write 0x006a36 thru 0x00de76 (0x7441 bytes) 000524 1789131895.619181 mapread 0x03bd10 thru 0x03e410 (0x2701 bytes) 000529 1789131895.624209 mapwrite 0x03cbcf thru 0x03ebc0 (0x1ff2 bytes) 000530 1789131895.662460 write 0x00b7b2 thru 0x015e42 (0xa691 bytes) 000531 1789131895.668571 mapread 0x01db6b thru 0x025ac7 (0x7f5d bytes) 000534 1789131895.686114 mapwrite 0x03783d thru 0x039628 (0x1dec bytes) 000535 1789131895.737891 write 0x006cf3 thru 0x00fb23 (0x8e31 bytes) 000537 1789131895.740463 trunc from 0x040000 to 0x0330b9 (0xcf46 bytes) 000538 1789131895.762741 write 0x03697e thru 0x0387dc (0x1e5f bytes) 000539 1789131895.763803 read 0x0153a5 thru 0x01df36 (0x8b92 bytes) 000540 1789131895.773422 mapwrite 0x01acbb thru 0x027f7c (0xd2c2 bytes) 000541 1789131895.827486 read 0x017025 thru 0x01cacc (0x5aa8 bytes) 000542 1789131895.836400 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x387dd): Mirror 5: 0x76df9d23 (stale) Mirror 7: 0x76df9d23 (stale) Mirror 8: 0x76df9d23 (stale) Mirror 12: 0x76df9d23 (stale) Mirror 17: 0x76df9d23 (stale) Mirror 18: 0x76df9d23 (stale) Mirror 19: 0x76df9d23 (stale) Mirror 20: 0x1569c168 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x387dd): Mirror 5: 0x76df9d23 (stale) Mirror 7: 0x76df9d23 (stale) Mirror 8: 0x76df9d23 (stale) Mirror 12: 0x76df9d23 (stale) Mirror 17: 0x76df9d23 (stale) Mirror 18: 0x76df9d23 (stale) Mirror 19: 0x76df9d23 (stale) Mirror 20: 0x1569c168 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x387dd: skipped 000543 1789131896.489722 mapwrite 0x01d6db thru 0x01e688 (0xfae bytes) 000544 1789131896.574987 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x387dd): Mirror 5: 0x76df9d23 (stale) Mirror 7: 0x76df9d23 (stale) Mirror 8: 0x76df9d23 (stale) Mirror 17: 0x76df9d23 (stale) Mirror 18: 0x76df9d23 (stale) Mirror 19: 0x76df9d23 (stale) Mirror 20: 0x1569c168 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x387dd): Mirror 5: 0x76df9d23 (stale) Mirror 7: 0x76df9d23 (stale) Mirror 8: 0x76df9d23 (stale) Mirror 17: 0x76df9d23 (stale) Mirror 18: 0x76df9d23 (stale) Mirror 19: 0x76df9d23 (stale) Mirror 20: 0x1569c168 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x387dd: skipped 000548 1789131897.223058 mapread 0x0164f0 thru 0x02159a (0xb0ab bytes) 000549 1789131897.266802 mapread 0x02d693 thru 0x02f807 (0x2175 bytes) 000550 1789131897.278052 trunc from 0x0387dd to 0x0201fa (0x185e2 bytes) 000551 1789131897.298754 mapwrite 0x02e288 thru 0x033aa0 (0x5819 bytes) 000553 1789131897.372274 read 0x02f40a thru 0x0339a7 (0x459e bytes) 000555 1789131897.373632 mapwrite 0x01c84c thru 0x02b4e4 (0xec99 bytes) 000556 1789131897.426390 read 0x02c0af thru 0x02e4d0 (0x2422 bytes) 000557 1789131897.427438 mapread 0x033526 thru 0x0338af (0x38a bytes) 000560 1789131897.431148 write 0x01e11f thru 0x01ef3f (0xe21 bytes) 000562 1789131897.433063 mapread 0x012c01 thru 0x01b1bb (0x85bb bytes) 000563 1789131897.434439 read 0x000856 thru 0x009002 (0x87ad bytes) 000564 1789131897.445057 mapread 0x008766 thru 0x00a6da (0x1f75 bytes) 000566 1789131897.447172 mapread 0x015408 thru 0x01dc11 (0x880a bytes) 000568 1789131897.453266 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x33aa1): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33aa1): Mirror 5: 0x9de5e7f3 (stale) Mirror 7: 0x9de5e7f3 (stale) Mirror 8: 0x9de5e7f3 (stale) Mirror 17: 0x9de5e7f3 (stale) Mirror 18: 0x9de5e7f3 (stale) Mirror 19: 0x9de5e7f3 (stale) Mirror 20: 0xe467aa25 (stale) CRC-32 checksum value for chunk [0, 0x33aa1): Mirror 1: 0x3baf5961 Mirror 21: 0x3baf5961 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33aa1: skipped 000569 1789131898.795209 read 0x0162ff thru 0x01affd (0x4cff bytes) 000571 1789131898.813955 MIRROR_RESYNC 9 mirrors 000572 1789131900.625164 mapwrite 0x00a0eb thru 0x010550 (0x6466 bytes) 000574 1789131900.929724 write 0x00ad4b thru 0x018e6f (0xe125 bytes) 000575 1789131900.957337 MIRROR_RESYNC 9 mirrors 000576 1789131904.009197 trunc from 0x033aa1 to 0x013250 (0x20850 bytes) 000580 1789131904.212751 mapwrite 0x030fff thru 0x039f78 (0x8f7a bytes) 000581 1789131904.401223 trunc from 0x039f79 to 0x039f7d (0x5 bytes) 000582 1789131904.425988 write 0x02d125 thru 0x037386 (0xa262 bytes) 000583 1789131904.427448 trunc from 0x039f7e to 0x005b3c (0x34441 bytes) 000585 1789131904.461739 mapread 0x002828 thru 0x005b3c (0x3315 bytes) 000586 1789131904.486483 trunc from 0x005b3d to 0x00d1aa (0x766e bytes) 000590 1789131904.548209 write 0x010a73 thru 0x01ee12 (0xe3a0 bytes) 000591 1789131904.550036 trunc from 0x01ee13 to 0x03e1fd (0x1f3eb bytes) 000592 1789131904.635266 mapwrite 0x023de5 thru 0x033d12 (0xff2e bytes) 000593 1789131904.955442 mapread 0x01eb27 thru 0x0253ad (0x6887 bytes) 000596 1789131904.961988 mapread 0x02a084 thru 0x038ad8 (0xea55 bytes) 000597 1789131904.983053 write 0x03afcd thru 0x03ffff (0x5033 bytes) 000599 1789131904.985037 write 0x028010 thru 0x029a68 (0x1a59 bytes) 000601 1789131904.992690 mapwrite 0x00dfc7 thru 0x0106a3 (0x26dd bytes) 000604 1789131905.104364 MIRROR_RESYNC 9 mirrors 000606 1789131907.313184 trunc from 0x040000 to 0x03c888 (0x3777 bytes) 000607 1789131907.526735 mapwrite 0x037970 thru 0x03c642 (0x4cd3 bytes) 000608 1789131907.716379 read 0x01c2ca thru 0x02a980 (0xe6b7 bytes) 000609 1789131907.753449 mapwrite 0x00bf70 thru 0x014f71 (0x9002 bytes) 000610 1789131907.958086 MIRROR_RESYNC 9 mirrors 000611 1789131910.288083 mapwrite 0x008ff6 thru 0x00a316 (0x1321 bytes) 000612 1789131910.567121 mapread 0x02cbeb thru 0x0383b7 (0xb7cd bytes) 000613 1789131910.608423 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3c889): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c889): Mirror 5: 0x2458da47 (stale) Mirror 7: 0x2458da47 (stale) Mirror 8: 0x2458da47 (stale) Mirror 17: 0x2458da47 (stale) Mirror 18: 0x2458da47 (stale) Mirror 19: 0x2458da47 (stale) Mirror 20: 0x2458da47 (stale) Mirror 21: 0x2458da47 (stale) CRC-32 checksum value for chunk [0, 0x3c889): Mirror 1: 0x40823658 Mirror 22: 0x40823658 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c889: skipped 000614 1789131912.245036 MIRROR_RESYNC 10 mirrors 000615 1789131915.277676 MIRROR_RESYNC 10 mirrors 000616 1789131916.537145 read 0x002a79 thru 0x003b09 (0x1091 bytes) 000617 1789131916.546355 write 0x012597 thru 0x01b2af (0x8d19 bytes) 000618 1789131916.686203 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3c889): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c889): Mirror 5: 0x40823658 (stale) Mirror 7: 0x40823658 (stale) Mirror 8: 0x40823658 (stale) Mirror 17: 0x40823658 (stale) Mirror 18: 0x40823658 (stale) Mirror 19: 0x40823658 (stale) Mirror 20: 0x40823658 (stale) Mirror 21: 0x40823658 (stale) Mirror 22: 0x40823658 (stale) CRC-32 checksum value for chunk [0, 0x3c889): Mirror 1: 0x8daa9154 Mirror 23: 0x8daa9154 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c889: skipped 000619 1789131918.538414 trunc from 0x03c889 to 0x00b07a (0x3180e bytes) 000620 1789131918.661281 mapwrite 0x024c40 thru 0x027319 (0x26da bytes) 000624 1789131918.798931 read 0x0057ae thru 0x008348 (0x2b9b bytes) 000626 1789131918.814022 write 0x037c97 thru 0x03ffff (0x8369 bytes) 000628 1789131918.828376 read 0x001b53 thru 0x00adff (0x92ad bytes) 000629 1789131918.870697 mapwrite 0x0318b7 thru 0x03917f (0x78c9 bytes) 000631 1789131918.975277 write 0x02393d thru 0x02a3aa (0x6a6e bytes) 000632 1789131918.991327 MIRROR_RESYNC 11 mirrors 000634 1789131922.629862 write 0x00d761 thru 0x013022 (0x58c2 bytes) 000635 1789131922.698243 write 0x01ed7d thru 0x01f840 (0xac4 bytes) 000636 1789131922.713341 MIRROR_RESYNC 11 mirrors 000638 1789131925.508228 read 0x035757 thru 0x03ffff (0xa8a9 bytes) 000639 1789131925.540061 trunc from 0x040000 to 0x01a5ec (0x25a13 bytes) 000641 1789131925.689063 trunc from 0x01a5ed to 0x02d165 (0x12b79 bytes) 000642 1789131925.744979 write 0x03e555 thru 0x03ffff (0x1aab bytes) 000643 1789131925.746421 read 0x021222 thru 0x026bc6 (0x59a5 bytes) 000645 1789131925.766573 mapread 0x03386e thru 0x0351d7 (0x196a bytes) 000646 1789131925.768438 write 0x03b698 thru 0x03d59f (0x1f08 bytes) 000648 1789131925.772305 read 0x032ad4 thru 0x039500 (0x6a2d bytes) 000649 1789131925.773884 trunc from 0x040000 to 0x00ecf9 (0x31306 bytes) 000650 1789131925.802161 mapread 0x007e21 thru 0x00938e (0x156e bytes) 000651 1789131925.809047 write 0x00ff7a thru 0x01eb3a (0xebc1 bytes) 000653 1789131925.822121 MIRROR_RESYNC 11 mirrors 000654 1789131928.804819 write 0x007027 thru 0x007418 (0x3f2 bytes) 000655 1789131928.872003 mapwrite 0x01fa17 thru 0x028d3f (0x9329 bytes) 000657 1789131928.976426 mapwrite 0x02d6da thru 0x0378c6 (0xa1ed bytes) 000658 1789131929.055371 trunc from 0x0378c7 to 0x03eda6 (0x74e0 bytes) 000659 1789131929.076703 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3eda7): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eda7): Mirror 5: 0xf5d71fe6 (stale) Mirror 7: 0xf5d71fe6 (stale) Mirror 8: 0xf5d71fe6 (stale) Mirror 17: 0xf5d71fe6 (stale) Mirror 18: 0xf5d71fe6 (stale) Mirror 19: 0xf5d71fe6 (stale) Mirror 20: 0xf5d71fe6 (stale) Mirror 21: 0xf5d71fe6 (stale) Mirror 22: 0xf5d71fe6 (stale) Mirror 23: 0xf5d71fe6 (stale) CRC-32 checksum value for chunk [0, 0x3eda7): Mirror 1: 0xb17b4dcf Mirror 24: 0xb17b4dcf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eda7: skipped 000660 1789131930.864220 write 0x023bbf thru 0x02aa55 (0x6e97 bytes) 000661 1789131930.998440 mapwrite 0x00614c thru 0x00fcb1 (0x9b66 bytes) 000662 1789131931.096839 trunc from 0x03eda7 to 0x02665e (0x18748 bytes) 000664 1789131931.133559 MIRROR_RESYNC 12 mirrors 000665 1789131933.382464 mapwrite 0x02051a thru 0x02649d (0x5f84 bytes) 000666 1789131933.614354 trunc from 0x02665f to 0x035a4e (0xf3f0 bytes) 000667 1789131933.661755 write 0x033a00 thru 0x03ffff (0xc600 bytes) 000669 1789131933.676194 write 0x0220c3 thru 0x0290fd (0x703b bytes) 000671 1789131933.692137 trunc from 0x040000 to 0x02b348 (0x14cb7 bytes) 000672 1789131933.746677 mapread 0x022902 thru 0x029222 (0x6921 bytes) 000674 1789131933.762454 trunc from 0x02b349 to 0x0009f9 (0x2a94f bytes) 000675 1789131933.811545 write 0x02a969 thru 0x02ae64 (0x4fc bytes) 000676 1789131933.813622 mapwrite 0x000458 thru 0x00e65c (0xe205 bytes) 000677 1789131933.954309 read 0x003629 thru 0x0087f9 (0x51d1 bytes) 000678 1789131933.968119 MIRROR_RESYNC 12 mirrors 000680 1789131937.504372 trunc from 0x02ae65 to 0x03beaf (0x1104b bytes) 000682 1789131937.697389 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3beb0): Mirror 5: 0xbbcced1b (stale) Mirror 7: 0xbbcced1b (stale) Mirror 8: 0xbbcced1b (stale) Mirror 17: 0xbbcced1b (stale) Mirror 18: 0xbbcced1b (stale) Mirror 19: 0xbbcced1b (stale) Mirror 20: 0xbbcced1b (stale) Mirror 21: 0xbbcced1b (stale) Mirror 22: 0xbbcced1b (stale) Mirror 23: 0xbbcced1b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beb0): Mirror 5: 0xbbcced1b (stale) Mirror 7: 0xbbcced1b (stale) Mirror 8: 0xbbcced1b (stale) Mirror 17: 0xbbcced1b (stale) Mirror 18: 0xbbcced1b (stale) Mirror 19: 0xbbcced1b (stale) Mirror 20: 0xbbcced1b (stale) Mirror 21: 0xbbcced1b (stale) Mirror 22: 0xbbcced1b (stale) Mirror 23: 0xbbcced1b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beb0: skipped 000683 1789131938.762196 mapread 0x006063 thru 0x00ce76 (0x6e14 bytes) 000684 1789131938.797896 mapread 0x00e8d0 thru 0x014dde (0x650f bytes) 000685 1789131938.817145 mapwrite 0x0205b2 thru 0x02eb4a (0xe599 bytes) 000686 1789131938.944043 mapread 0x012c44 thru 0x0151e1 (0x259e bytes) 000687 1789131938.945100 mapread 0x021128 thru 0x02f222 (0xe0fb bytes) 000688 1789131938.946140 mapwrite 0x031a3c thru 0x03bd6b (0xa330 bytes) 000690 1789131939.125053 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3beb0): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beb0): Mirror 5: 0xbbcced1b (stale) Mirror 7: 0xbbcced1b (stale) Mirror 8: 0xbbcced1b (stale) Mirror 17: 0xbbcced1b (stale) Mirror 18: 0xbbcced1b (stale) Mirror 19: 0xbbcced1b (stale) Mirror 20: 0xbbcced1b (stale) Mirror 21: 0xbbcced1b (stale) Mirror 22: 0xbbcced1b (stale) Mirror 23: 0xbbcced1b (stale) CRC-32 checksum value for chunk [0, 0x3beb0): Mirror 1: 0x47aa7324 Mirror 24: 0x47aa7324 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beb0: skipped 000691 1789131940.962126 write 0x000c9a thru 0x00b9fc (0xad63 bytes) 000692 1789131941.172876 trunc from 0x03beb0 to 0x02284a (0x19665 bytes) 000693 1789131941.234873 mapread 0x01cae2 thru 0x02284a (0x5d69 bytes) 000695 1789131941.268746 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2284b): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2284b): Mirror 5: 0x2a709e85 (stale) Mirror 7: 0x2a709e85 (stale) Mirror 8: 0x2a709e85 (stale) Mirror 17: 0x2a709e85 (stale) Mirror 18: 0x2a709e85 (stale) Mirror 19: 0x2a709e85 (stale) Mirror 20: 0x2a709e85 (stale) Mirror 21: 0x2a709e85 (stale) Mirror 22: 0x2a709e85 (stale) Mirror 23: 0x2a709e85 (stale) Mirror 24: 0x8f4be235 (stale) CRC-32 checksum value for chunk [0, 0x2284b): Mirror 1: 0xc790ea55 Mirror 25: 0xc790ea55 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2284b: skipped 000697 1789131942.669485 mapwrite 0x0014c9 thru 0x0054e1 (0x4019 bytes) 000700 1789131942.819853 read 0x01b1c1 thru 0x02284a (0x768a bytes) 000703 1789131942.837276 mapread 0x01b832 thru 0x02284a (0x7019 bytes) 000704 1789131942.839021 trunc from 0x02284b to 0x017877 (0xafd3 bytes) 000707 1789131942.892369 mapread 0x004608 thru 0x004dea (0x7e3 bytes) 000708 1789131942.899617 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17878): Mirror 5: 0xcf952265 (stale) Mirror 7: 0xcf952265 (stale) Mirror 8: 0xcf952265 (stale) Mirror 18: 0xcf952265 (stale) Mirror 19: 0xcf952265 (stale) Mirror 20: 0xcf952265 (stale) Mirror 21: 0xcf952265 (stale) Mirror 22: 0xcf952265 (stale) Mirror 23: 0xcf952265 (stale) Mirror 24: 0xcf952265 (stale) Mirror 25: 0xb7551a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17878): Mirror 5: 0xcf952265 (stale) Mirror 7: 0xcf952265 (stale) Mirror 8: 0xcf952265 (stale) Mirror 18: 0xcf952265 (stale) Mirror 19: 0xcf952265 (stale) Mirror 20: 0xcf952265 (stale) Mirror 21: 0xcf952265 (stale) Mirror 22: 0xcf952265 (stale) Mirror 23: 0xcf952265 (stale) Mirror 24: 0xcf952265 (stale) Mirror 25: 0xb7551a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17878: skipped 000710 1789131943.455279 mapread 0x012011 thru 0x017877 (0x5867 bytes) 000712 1789131943.476964 read 0x00be65 thru 0x017877 (0xba13 bytes) 000713 1789131943.486335 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x17878): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17878): Mirror 5: 0xcf952265 (stale) Mirror 7: 0xcf952265 (stale) Mirror 8: 0xcf952265 (stale) Mirror 18: 0xcf952265 (stale) Mirror 19: 0xcf952265 (stale) Mirror 20: 0xcf952265 (stale) Mirror 21: 0xcf952265 (stale) Mirror 22: 0xcf952265 (stale) Mirror 23: 0xcf952265 (stale) Mirror 24: 0xcf952265 (stale) Mirror 25: 0xb7551a0 (stale) CRC-32 checksum value for chunk [0, 0x17878): Mirror 1: 0x3fa750df Mirror 26: 0x3fa750df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17878: skipped 000714 1789131944.788964 trunc from 0x017878 to 0x037652 (0x1fddb bytes) 000718 1789131945.012808 write 0x028373 thru 0x031faa (0x9c38 bytes) 000719 1789131945.035936 write 0x0228c3 thru 0x02f57d (0xccbb bytes) 000720 1789131945.054207 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x37653): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37653): Mirror 5: 0x7fe68cad (stale) Mirror 7: 0x7fe68cad (stale) Mirror 8: 0x7fe68cad (stale) Mirror 18: 0x7fe68cad (stale) Mirror 19: 0x7fe68cad (stale) Mirror 20: 0x7fe68cad (stale) Mirror 21: 0x7fe68cad (stale) Mirror 22: 0x7fe68cad (stale) Mirror 23: 0x7fe68cad (stale) Mirror 24: 0x1256b6c3 (stale) Mirror 25: 0xccc820e7 (stale) Mirror 26: 0x41940d59 (stale) CRC-32 checksum value for chunk [0, 0x37653): Mirror 1: 0x79ea4749 Mirror 27: 0x79ea4749 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37653: skipped 000722 1789131946.949017 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x37653): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37653): Mirror 5: 0x7fe68cad (stale) Mirror 7: 0x7fe68cad (stale) Mirror 8: 0x7fe68cad (stale) Mirror 18: 0x7fe68cad (stale) Mirror 19: 0x7fe68cad (stale) Mirror 20: 0x7fe68cad (stale) Mirror 21: 0x7fe68cad (stale) Mirror 22: 0x7fe68cad (stale) Mirror 23: 0x7fe68cad (stale) Mirror 24: 0x1256b6c3 (stale) Mirror 25: 0xccc820e7 (stale) Mirror 26: 0x41940d59 (stale) CRC-32 checksum value for chunk [0, 0x37653): Mirror 1: 0x79ea4749 Mirror 27: 0x79ea4749 Mirror 28: 0x79ea4749 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37653: skipped 000724 1789131948.387026 read 0x011571 thru 0x019b79 (0x8609 bytes) 000728 1789131948.399877 mapwrite 0x03af24 thru 0x03ffff (0x50dc bytes) 000730 1789131948.613039 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x798a89aa (stale) Mirror 7: 0x798a89aa (stale) Mirror 8: 0x798a89aa (stale) Mirror 18: 0x798a89aa (stale) Mirror 19: 0x798a89aa (stale) Mirror 20: 0x798a89aa (stale) Mirror 21: 0x798a89aa (stale) Mirror 22: 0x798a89aa (stale) Mirror 23: 0x798a89aa (stale) Mirror 24: 0x1ae1dd97 (stale) Mirror 25: 0xe1c4e36 (stale) Mirror 26: 0xe7de9252 (stale) Mirror 27: 0x767303f3 (stale) Mirror 28: 0x767303f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe59246a5 Mirror 29: 0xe59246a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000731 1789131950.626705 mapwrite 0x02fe93 thru 0x03aa30 (0xab9e bytes) 000732 1789131950.985566 read 0x00b47d thru 0x00de6d (0x29f1 bytes) 000734 1789131950.997673 mapread 0x02538d thru 0x02bdef (0x6a63 bytes) 000737 1789131951.029989 mapread 0x0039da thru 0x013971 (0xff98 bytes) 000739 1789131951.071030 read 0x0380ab thru 0x03dea6 (0x5dfc bytes) 000740 1789131951.074711 trunc from 0x040000 to 0x034e39 (0xb1c6 bytes) 000742 1789131951.120854 write 0x037ce4 thru 0x03847e (0x79b bytes) 000744 1789131951.125000 read 0x006b84 thru 0x00e033 (0x74b0 bytes) 000746 1789131951.129239 mapwrite 0x0189f7 thru 0x02536b (0xc975 bytes) 000748 1789131951.234322 mapwrite 0x026488 thru 0x0352ec (0xee65 bytes) 000749 1789131951.317374 read 0x00c263 thru 0x0155f3 (0x9391 bytes) 000750 1789131951.319259 read 0x00b266 thru 0x0159e2 (0xa77d bytes) 000754 1789131951.326382 mapwrite 0x03670d thru 0x03db37 (0x742b bytes) 000755 1789131951.475151 MIRROR_RESYNC 16 mirrors 000758 1789131954.896354 write 0x031ca8 thru 0x035e92 (0x41eb bytes) 000759 1789131954.999239 trunc from 0x03db38 to 0x013f38 (0x29bff bytes) 000760 1789131955.034480 mapread 0x013222 thru 0x013f38 (0xd17 bytes) 000764 1789131955.044249 write 0x03bd82 thru 0x03e8af (0x2b2e bytes) 000772 1789131955.053945 read 0x02a202 thru 0x036ce4 (0xcae3 bytes) 000773 1789131955.063285 read 0x01c7c0 thru 0x01e57d (0x1dbe bytes) 000774 1789131955.076135 trunc from 0x03e8b0 to 0x00a18d (0x34722 bytes) 000777 1789131955.111759 read 0x008658 thru 0x00a18d (0x1b36 bytes) 000780 1789131955.114745 mapread 0x004116 thru 0x00a18d (0x6078 bytes) 000781 1789131955.116920 read 0x005f78 thru 0x00a18d (0x4216 bytes) 000786 1789131955.125116 MIRROR_RESYNC 16 mirrors 000787 1789131957.695079 mapread 0x0070ed thru 0x00a18d (0x30a1 bytes) 000788 1789131957.718899 trunc from 0x00a18e to 0x01bd2a (0x11b9d bytes) 000790 1789131957.832773 mapwrite 0x03797a thru 0x03ffff (0x8686 bytes) 000791 1789131957.941687 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd40ebc6d (stale) Mirror 8: 0xd40ebc6d (stale) Mirror 18: 0xd40ebc6d (stale) Mirror 19: 0xd40ebc6d (stale) Mirror 20: 0xd40ebc6d (stale) Mirror 21: 0xd40ebc6d (stale) Mirror 22: 0xd40ebc6d (stale) Mirror 23: 0xd40ebc6d (stale) Mirror 24: 0xd40ebc6d (stale) Mirror 25: 0xd40ebc6d (stale) Mirror 26: 0xd40ebc6d (stale) Mirror 27: 0xd40ebc6d (stale) Mirror 28: 0xd40ebc6d (stale) Mirror 29: 0xd40ebc6d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd40ebc6d (stale) Mirror 8: 0xd40ebc6d (stale) Mirror 18: 0xd40ebc6d (stale) Mirror 19: 0xd40ebc6d (stale) Mirror 20: 0xd40ebc6d (stale) Mirror 21: 0xd40ebc6d (stale) Mirror 22: 0xd40ebc6d (stale) Mirror 23: 0xd40ebc6d (stale) Mirror 24: 0xd40ebc6d (stale) Mirror 25: 0xd40ebc6d (stale) Mirror 26: 0xd40ebc6d (stale) Mirror 27: 0xd40ebc6d (stale) Mirror 28: 0xd40ebc6d (stale) Mirror 29: 0xd40ebc6d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000792 1789131959.132861 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd40ebc6d (stale) Mirror 8: 0xd40ebc6d (stale) Mirror 18: 0xd40ebc6d (stale) Mirror 19: 0xd40ebc6d (stale) Mirror 20: 0xd40ebc6d (stale) Mirror 21: 0xd40ebc6d (stale) Mirror 23: 0xd40ebc6d (stale) Mirror 24: 0xd40ebc6d (stale) Mirror 25: 0xd40ebc6d (stale) Mirror 26: 0xd40ebc6d (stale) Mirror 27: 0xd40ebc6d (stale) Mirror 28: 0xd40ebc6d (stale) Mirror 29: 0xd40ebc6d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd40ebc6d (stale) Mirror 8: 0xd40ebc6d (stale) Mirror 18: 0xd40ebc6d (stale) Mirror 19: 0xd40ebc6d (stale) Mirror 20: 0xd40ebc6d (stale) Mirror 21: 0xd40ebc6d (stale) Mirror 23: 0xd40ebc6d (stale) Mirror 24: 0xd40ebc6d (stale) Mirror 25: 0xd40ebc6d (stale) Mirror 26: 0xd40ebc6d (stale) Mirror 27: 0xd40ebc6d (stale) Mirror 28: 0xd40ebc6d (stale) Mirror 29: 0xd40ebc6d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000795 1789131959.950180 mapread 0x02fcab thru 0x03467e (0x49d4 bytes) 000798 1789131960.008114 mapwrite 0x01dc55 thru 0x02823a (0xa5e6 bytes) 000799 1789131960.105913 write 0x02a85b thru 0x02d857 (0x2ffd bytes) 000800 1789131960.107298 read 0x031c34 thru 0x039efd (0x82ca bytes) 000801 1789131960.108693 read 0x03d6de thru 0x03ffff (0x2922 bytes) 000803 1789131960.120372 read 0x0226cc thru 0x0307eb (0xe120 bytes) 000805 1789131960.127146 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd40ebc6d (stale) Mirror 8: 0xd40ebc6d (stale) Mirror 18: 0xd40ebc6d (stale) Mirror 19: 0xd40ebc6d (stale) Mirror 20: 0xd40ebc6d (stale) Mirror 21: 0xd40ebc6d (stale) Mirror 23: 0xd40ebc6d (stale) Mirror 24: 0xd40ebc6d (stale) Mirror 25: 0xd40ebc6d (stale) Mirror 26: 0xd40ebc6d (stale) Mirror 27: 0xd40ebc6d (stale) Mirror 28: 0xd40ebc6d (stale) Mirror 29: 0xd40ebc6d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x30d625dc Mirror 30: 0x30d625dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000807 1789131961.710086 MIRROR_SPLIT mirror 14 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd40ebc6d (stale) Mirror 8: 0xd40ebc6d (stale) Mirror 18: 0xd40ebc6d (stale) Mirror 19: 0xd40ebc6d (stale) Mirror 20: 0xd40ebc6d (stale) Mirror 21: 0xd40ebc6d (stale) Mirror 23: 0xd40ebc6d (stale) Mirror 24: 0xd40ebc6d (stale) Mirror 25: 0xd40ebc6d (stale) Mirror 26: 0xd40ebc6d (stale) Mirror 27: 0xd40ebc6d (stale) Mirror 28: 0xd40ebc6d (stale) Mirror 29: 0xd40ebc6d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd40ebc6d (stale) Mirror 8: 0xd40ebc6d (stale) Mirror 18: 0xd40ebc6d (stale) Mirror 19: 0xd40ebc6d (stale) Mirror 20: 0xd40ebc6d (stale) Mirror 21: 0xd40ebc6d (stale) Mirror 23: 0xd40ebc6d (stale) Mirror 24: 0xd40ebc6d (stale) Mirror 25: 0xd40ebc6d (stale) Mirror 26: 0xd40ebc6d (stale) Mirror 27: 0xd40ebc6d (stale) Mirror 28: 0xd40ebc6d (stale) Mirror 29: 0xd40ebc6d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000809 1789131962.654253 mapwrite 0x003075 thru 0x004d72 (0x1cfe bytes) 000811 1789131962.838192 mapread 0x036967 thru 0x03cfda (0x6674 bytes) 000814 1789131962.855489 mapwrite 0x034d1a thru 0x03e751 (0x9a38 bytes) 000815 1789131963.015361 MIRROR_RESYNC 14 mirrors 000817 1789131965.801872 trunc from 0x040000 to 0x03b9b4 (0x464b bytes) 000819 1789131965.885362 read 0x01081c thru 0x01c278 (0xba5d bytes) 000821 1789131965.894435 write 0x025639 thru 0x02f5a5 (0x9f6d bytes) 000823 1789131965.911424 MIRROR_RESYNC 14 mirrors 000827 1789131967.738783 MIRROR_EXTEND to 15 mirrors 000828 1789131968.974502 mapread 0x030062 thru 0x03b9b4 (0xb953 bytes) 000829 1789131969.046501 read 0x023355 thru 0x03195d (0xe609 bytes) 000830 1789131969.060119 mapwrite 0x005957 thru 0x0092b5 (0x395f bytes) 000831 1789131969.418407 mapwrite 0x0397b2 thru 0x03ffff (0x684e bytes) 000832 1789131969.536491 write 0x022dc2 thru 0x02a652 (0x7891 bytes) 000833 1789131969.566364 write 0x0354cb thru 0x03ac95 (0x57cb bytes) 000837 1789131969.574905 write 0x00aac9 thru 0x00f002 (0x453a bytes) 000838 1789131969.577600 write 0x0320d9 thru 0x03adec (0x8d14 bytes) 000840 1789131969.588409 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5320287 (stale) Mirror 8: 0x5320287 (stale) Mirror 18: 0x5320287 (stale) Mirror 19: 0x5320287 (stale) Mirror 20: 0x5320287 (stale) Mirror 21: 0x5320287 (stale) Mirror 23: 0x5320287 (stale) Mirror 24: 0x5320287 (stale) Mirror 25: 0x5320287 (stale) Mirror 26: 0x5320287 (stale) Mirror 27: 0x5320287 (stale) Mirror 28: 0x5320287 (stale) Mirror 29: 0x5320287 (stale) Mirror 30: 0x5320287 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbc546516 Mirror 31: 0xbc546516 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000842 1789131971.399752 write 0x038bea thru 0x03ce6b (0x4282 bytes) 000843 1789131971.521989 MIRROR_RESYNC 16 mirrors 000849 1789131974.846689 write 0x011717 thru 0x018e85 (0x776f bytes) 000850 1789131975.063606 trunc from 0x040000 to 0x00b40b (0x34bf4 bytes) 000853 1789131975.116286 read 0x0052e7 thru 0x00b40b (0x6125 bytes) 000855 1789131975.155421 write 0x00c17a thru 0x01bb3b (0xf9c2 bytes) 000857 1789131975.163147 mapread 0x00d94f thru 0x014621 (0x6cd3 bytes) 000858 1789131975.186397 MIRROR_SPLIT mirror 10 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bb3c): Mirror 7: 0x11e65495 (stale) Mirror 8: 0x11e65495 (stale) Mirror 18: 0x11e65495 (stale) Mirror 19: 0x11e65495 (stale) Mirror 20: 0x11e65495 (stale) Mirror 21: 0x11e65495 (stale) Mirror 23: 0x11e65495 (stale) Mirror 24: 0x11e65495 (stale) Mirror 25: 0x11e65495 (stale) Mirror 27: 0x11e65495 (stale) Mirror 28: 0x11e65495 (stale) Mirror 29: 0x11e65495 (stale) Mirror 30: 0x11e65495 (stale) Mirror 31: 0x11e65495 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bb3c): Mirror 7: 0x11e65495 (stale) Mirror 8: 0x11e65495 (stale) Mirror 18: 0x11e65495 (stale) Mirror 19: 0x11e65495 (stale) Mirror 20: 0x11e65495 (stale) Mirror 21: 0x11e65495 (stale) Mirror 23: 0x11e65495 (stale) Mirror 24: 0x11e65495 (stale) Mirror 25: 0x11e65495 (stale) Mirror 27: 0x11e65495 (stale) Mirror 28: 0x11e65495 (stale) Mirror 29: 0x11e65495 (stale) Mirror 30: 0x11e65495 (stale) Mirror 31: 0x11e65495 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bb3c: skipped 000859 1789131976.268074 trunc from 0x01bb3c to 0x00c436 (0xf705 bytes) 000860 1789131976.289736 write 0x02b15b thru 0x036951 (0xb7f7 bytes) 000861 1789131976.292741 trunc from 0x036952 to 0x02de25 (0x8b2c bytes) 000864 1789131976.313174 trunc from 0x02de26 to 0x035727 (0x7902 bytes) 000865 1789131976.345575 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35728): Mirror 7: 0xe5f22c01 (stale) Mirror 8: 0xe5f22c01 (stale) Mirror 18: 0xe5f22c01 (stale) Mirror 20: 0xe5f22c01 (stale) Mirror 21: 0xe5f22c01 (stale) Mirror 23: 0xe5f22c01 (stale) Mirror 24: 0xe5f22c01 (stale) Mirror 25: 0xe5f22c01 (stale) Mirror 27: 0xe5f22c01 (stale) Mirror 28: 0xe5f22c01 (stale) Mirror 29: 0xe5f22c01 (stale) Mirror 30: 0xe5f22c01 (stale) Mirror 31: 0xe5f22c01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35728): Mirror 7: 0xe5f22c01 (stale) Mirror 8: 0xe5f22c01 (stale) Mirror 18: 0xe5f22c01 (stale) Mirror 20: 0xe5f22c01 (stale) Mirror 21: 0xe5f22c01 (stale) Mirror 23: 0xe5f22c01 (stale) Mirror 24: 0xe5f22c01 (stale) Mirror 25: 0xe5f22c01 (stale) Mirror 27: 0xe5f22c01 (stale) Mirror 28: 0xe5f22c01 (stale) Mirror 29: 0xe5f22c01 (stale) Mirror 30: 0xe5f22c01 (stale) Mirror 31: 0xe5f22c01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35728: skipped 000866 1789131977.069048 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x35728): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35728): Mirror 7: 0xe5f22c01 (stale) Mirror 8: 0xe5f22c01 (stale) Mirror 18: 0xe5f22c01 (stale) Mirror 20: 0xe5f22c01 (stale) Mirror 21: 0xe5f22c01 (stale) Mirror 23: 0xe5f22c01 (stale) Mirror 24: 0xe5f22c01 (stale) Mirror 25: 0xe5f22c01 (stale) Mirror 27: 0xe5f22c01 (stale) Mirror 28: 0xe5f22c01 (stale) Mirror 29: 0xe5f22c01 (stale) Mirror 30: 0xe5f22c01 (stale) Mirror 31: 0xe5f22c01 (stale) CRC-32 checksum value for chunk [0, 0x35728): Mirror 1: 0x1bac1cf1 Mirror 32: 0x1bac1cf1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35728: skipped 000871 1789131978.932284 write 0x011dfd thru 0x013bce (0x1dd2 bytes) 000873 1789131979.138935 mapread 0x0311ff thru 0x035727 (0x4529 bytes) 000874 1789131979.209260 read 0x02725c thru 0x030c36 (0x99db bytes) 000875 1789131979.232472 mapwrite 0x011419 thru 0x01e45a (0xd042 bytes) 000876 1789131979.408086 mapread 0x0326d9 thru 0x035727 (0x304f bytes) 000877 1789131979.411178 mapread 0x02bf37 thru 0x035727 (0x97f1 bytes) 000879 1789131979.419642 mapwrite 0x03b320 thru 0x03ffff (0x4ce0 bytes) 000881 1789131979.598827 trunc from 0x040000 to 0x02aab6 (0x15549 bytes) 000882 1789131979.652465 write 0x03b553 thru 0x03cc39 (0x16e7 bytes) 000883 1789131979.661969 mapread 0x03afd0 thru 0x03cc39 (0x1c6a bytes) 000885 1789131979.681212 read 0x006c94 thru 0x00f9e6 (0x8d53 bytes) 000886 1789131979.696957 mapread 0x032619 thru 0x03cc39 (0xa621 bytes) 000887 1789131979.699614 mapwrite 0x03ab43 thru 0x03e2e2 (0x37a0 bytes) 000889 1789131979.812044 read 0x03612a thru 0x03e2e2 (0x81b9 bytes) 000890 1789131979.812643 write 0x00da03 thru 0x00ee60 (0x145e bytes) 000891 1789131979.813466 mapread 0x001613 thru 0x00c434 (0xae22 bytes) 000892 1789131979.814280 mapwrite 0x028d86 thru 0x036ce7 (0xdf62 bytes) 000893 1789131979.908892 trunc from 0x03e2e3 to 0x03cd5f (0x1583 bytes) 000894 1789131979.958095 write 0x00be4f thru 0x013645 (0x77f7 bytes) 000895 1789131979.963039 trunc from 0x03cd60 to 0x013f03 (0x28e5c bytes) 000896 1789131980.010785 mapread 0x00441d thru 0x00b22c (0x6e10 bytes) 000898 1789131980.015057 trunc from 0x013f04 to 0x0212dd (0xd3da bytes) 000902 1789131980.063613 read 0x01ebdd thru 0x0212dd (0x2701 bytes) 000903 1789131980.102792 trunc from 0x0212de to 0x033c2b (0x1294e bytes) 000904 1789131980.131235 mapread 0x00ab7d thru 0x00dfd2 (0x3456 bytes) 000906 1789131980.132788 mapwrite 0x038239 thru 0x03ffff (0x7dc7 bytes) 000907 1789131980.325925 trunc from 0x040000 to 0x038ec2 (0x713d bytes) 000909 1789131980.401419 write 0x031800 thru 0x03c7d3 (0xafd4 bytes) 000910 1789131980.402963 read 0x014424 thru 0x020dc7 (0xc9a4 bytes) 000912 1789131980.414229 trunc from 0x03c7d4 to 0x02aea2 (0x11931 bytes) 000916 1789131980.491458 write 0x00fda1 thru 0x01270e (0x296e bytes) 000917 1789131980.497742 trunc from 0x02aea3 to 0x0060b4 (0x24dee bytes) 000918 1789131980.534956 write 0x02b451 thru 0x02f61c (0x41cc bytes) 000922 1789131980.544769 mapwrite 0x024ede thru 0x034976 (0xfa99 bytes) 000923 1789131980.686594 write 0x02dc2a thru 0x03c922 (0xecf9 bytes) 000925 1789131980.696360 mapread 0x035c9c thru 0x03c922 (0x6c87 bytes) 000926 1789131980.697485 write 0x03b15e thru 0x03ffff (0x4ea2 bytes) 000927 1789131980.710486 mapwrite 0x0012d1 thru 0x00ca95 (0xb7c5 bytes) 000928 1789131980.846073 write 0x0029d8 thru 0x009b79 (0x71a2 bytes) 000931 1789131980.857026 mapwrite 0x01829c thru 0x019657 (0x13bc bytes) 000932 1789131981.063827 MIRROR_SPLIT mirror 2 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x4fd3c885 (stale) Mirror 18: 0x4fd3c885 (stale) Mirror 20: 0x4fd3c885 (stale) Mirror 21: 0x4fd3c885 (stale) Mirror 23: 0x4fd3c885 (stale) Mirror 24: 0x4fd3c885 (stale) Mirror 25: 0x4fd3c885 (stale) Mirror 27: 0x4fd3c885 (stale) Mirror 28: 0x4fd3c885 (stale) Mirror 29: 0x4fd3c885 (stale) Mirror 30: 0x4fd3c885 (stale) Mirror 31: 0x4fd3c885 (stale) Mirror 32: 0xf918aa73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x4fd3c885 (stale) Mirror 18: 0x4fd3c885 (stale) Mirror 20: 0x4fd3c885 (stale) Mirror 21: 0x4fd3c885 (stale) Mirror 23: 0x4fd3c885 (stale) Mirror 24: 0x4fd3c885 (stale) Mirror 25: 0x4fd3c885 (stale) Mirror 27: 0x4fd3c885 (stale) Mirror 28: 0x4fd3c885 (stale) Mirror 29: 0x4fd3c885 (stale) Mirror 30: 0x4fd3c885 (stale) Mirror 31: 0x4fd3c885 (stale) Mirror 32: 0xf918aa73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000933 1789131982.242423 write 0x00ffd0 thru 0x016674 (0x66a5 bytes) 000935 1789131982.290204 mapread 0x01ce5e thru 0x02540f (0x85b2 bytes) 000936 1789131982.313445 mapread 0x031fb6 thru 0x035da6 (0x3df1 bytes) 000939 1789131982.344864 trunc from 0x040000 to 0x00bf5d (0x340a2 bytes) 000944 1789131982.410248 trunc from 0x00bf5e to 0x001a22 (0xa53b bytes) 000945 1789131982.465800 mapread 0x001824 thru 0x001a22 (0x1ff bytes) 000948 1789131982.532709 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a23): Mirror 7: 0x5c4214c5 (stale) Mirror 18: 0x5c4214c5 (stale) Mirror 20: 0x5c4214c5 (stale) Mirror 21: 0x5c4214c5 (stale) Mirror 23: 0x5c4214c5 (stale) Mirror 24: 0x5c4214c5 (stale) Mirror 25: 0x5c4214c5 (stale) Mirror 27: 0x5c4214c5 (stale) Mirror 29: 0x5c4214c5 (stale) Mirror 30: 0x5c4214c5 (stale) Mirror 31: 0x5c4214c5 (stale) Mirror 32: 0x5c4214c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a23): Mirror 7: 0x5c4214c5 (stale) Mirror 18: 0x5c4214c5 (stale) Mirror 20: 0x5c4214c5 (stale) Mirror 21: 0x5c4214c5 (stale) Mirror 23: 0x5c4214c5 (stale) Mirror 24: 0x5c4214c5 (stale) Mirror 25: 0x5c4214c5 (stale) Mirror 27: 0x5c4214c5 (stale) Mirror 29: 0x5c4214c5 (stale) Mirror 30: 0x5c4214c5 (stale) Mirror 31: 0x5c4214c5 (stale) Mirror 32: 0x5c4214c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a23: skipped 000949 1789131983.509416 read 0x001436 thru 0x001a22 (0x5ed bytes) 000950 1789131983.517044 read 0x00048f thru 0x001a22 (0x1594 bytes) 000952 1789131983.524810 mapwrite 0x000ba7 thru 0x008393 (0x77ed bytes) 000953 1789131983.773550 write 0x03c968 thru 0x03ed36 (0x23cf bytes) 000955 1789131983.789770 read 0x0071e4 thru 0x0119ba (0xa7d7 bytes) 000956 1789131983.822971 mapwrite 0x01b7e7 thru 0x01cc43 (0x145d bytes) 000958 1789131983.942850 MIRROR_RESYNC 13 mirrors 000959 1789131988.700579 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) 000962 1789131989.613562 read 0x00c0b2 thru 0x015bd4 (0x9b23 bytes) 000964 1789131989.658869 write 0x027203 thru 0x02f6ea (0x84e8 bytes) 000965 1789131989.845449 trunc from 0x03ed37 to 0x03a420 (0x4916 bytes) 000966 1789131989.865945 write 0x016112 thru 0x02028a (0xa179 bytes) 000968 1789131989.881072 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a421): Mirror 18: 0xb73a8476 (stale) Mirror 20: 0xb73a8476 (stale) Mirror 21: 0xb73a8476 (stale) Mirror 23: 0xb73a8476 (stale) Mirror 24: 0xb73a8476 (stale) Mirror 25: 0xb73a8476 (stale) Mirror 27: 0xb73a8476 (stale) Mirror 29: 0xb73a8476 (stale) Mirror 30: 0xb73a8476 (stale) Mirror 32: 0xb73a8476 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a421): Mirror 18: 0xb73a8476 (stale) Mirror 20: 0xb73a8476 (stale) Mirror 21: 0xb73a8476 (stale) Mirror 23: 0xb73a8476 (stale) Mirror 24: 0xb73a8476 (stale) Mirror 25: 0xb73a8476 (stale) Mirror 27: 0xb73a8476 (stale) Mirror 29: 0xb73a8476 (stale) Mirror 30: 0xb73a8476 (stale) Mirror 32: 0xb73a8476 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a421: skipped 000970 1789131990.608386 write 0x02ac94 thru 0x02e67b (0x39e8 bytes) 000972 1789131990.621105 trunc from 0x03a421 to 0x017ee0 (0x22540 bytes) 000973 1789131990.646292 write 0x00e8be thru 0x0191be (0xa901 bytes) 000976 1789131990.657880 read 0x0062db thru 0x00f8a6 (0x95cc bytes) 000981 1789131990.672035 mapwrite 0x03fdb7 thru 0x03ffff (0x249 bytes) 000982 1789131990.769869 mapwrite 0x023b9f thru 0x023f1a (0x37c bytes) 000983 1789131990.834877 mapwrite 0x00f025 thru 0x014951 (0x592d bytes) 000985 1789131990.906386 write 0x00b06c thru 0x018b7e (0xdb13 bytes) 000988 1789131990.915242 trunc from 0x040000 to 0x033b90 (0xc46f bytes) 000990 1789131990.964466 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x165:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33b91): Mirror 18: 0x92dc5711 (stale) Mirror 20: 0x92dc5711 (stale) Mirror 23: 0x92dc5711 (stale) Mirror 24: 0x92dc5711 (stale) Mirror 25: 0x92dc5711 (stale) Mirror 27: 0x92dc5711 (stale) Mirror 29: 0x92dc5711 (stale) Mirror 30: 0x92dc5711 (stale) Mirror 32: 0x92dc5711 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b91): Mirror 18: 0x92dc5711 (stale) Mirror 20: 0x92dc5711 (stale) Mirror 23: 0x92dc5711 (stale) Mirror 24: 0x92dc5711 (stale) Mirror 25: 0x92dc5711 (stale) Mirror 27: 0x92dc5711 (stale) Mirror 29: 0x92dc5711 (stale) Mirror 30: 0x92dc5711 (stale) Mirror 32: 0x92dc5711 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b91: skipped 000991 1789131991.763922 trunc from 0x033b91 to 0x02a68e (0x9502 bytes) 000992 1789131991.803038 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2a68f): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a68f): Mirror 18: 0x1ea02a1e (stale) Mirror 20: 0x1ea02a1e (stale) Mirror 23: 0x1ea02a1e (stale) Mirror 24: 0x1ea02a1e (stale) Mirror 25: 0x1ea02a1e (stale) Mirror 27: 0x1ea02a1e (stale) Mirror 29: 0x1ea02a1e (stale) Mirror 30: 0x1ea02a1e (stale) Mirror 32: 0x1ea02a1e (stale) CRC-32 checksum value for chunk [0, 0x2a68f): Mirror 1: 0x99c7794e Mirror 33: 0x99c7794e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a68f: skipped 000996 1789131993.051413 write 0x038d5d thru 0x03e4f0 (0x5794 bytes) 000999 1789131993.198876 trunc from 0x03e4f1 to 0x017f8e (0x26562 bytes) All operations completed A-OK!