== sanity-flr test 70a: flr mode fsx test ================ 01:15:22 (1789449322) Seed set to 9324 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1789449324.723774 MIRROR_EXTEND to 2 mirrors 000002 1789449325.483664 write 0x034a44 thru 0x03ffff (0xb5bc bytes) 000004 1789449325.608159 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) 000005 1789449325.923768 mapread 0x01d4bf thru 0x0296ea (0xc22c bytes) 000006 1789449326.021513 mapwrite 0x03ce0d thru 0x03ffff (0x31f3 bytes) 000007 1789449326.194601 punch from 0x020e46 to 0x02824d (0x7408 bytes) 000008 1789449326.200575 mapwrite 0x01ab66 thru 0x0268b0 (0xbd4b bytes) truncating to largest ever: 0x17e52 000009 1789449326.260114 trunc from 0x040000 to 0x017e51 (0x281ae bytes) 000011 1789449326.292367 read 0x007a12 thru 0x00c6fa (0x4ce9 bytes) truncating to largest ever: 0x282cc 000013 1789449326.304173 trunc from 0x017e52 to 0x0282cb (0x1047a bytes) 000014 1789449326.328153 mapwrite 0x025e0f thru 0x02be6b (0x605d bytes) 000022 1789449326.445654 read 0x01ef8a thru 0x01f1c9 (0x240 bytes) 000025 1789449326.453372 mapread 0x029e39 thru 0x02be6b (0x2033 bytes) 000028 1789449326.458388 mapread 0x02bdb7 thru 0x02be6b (0xb5 bytes) 000030 1789449326.461345 write 0x01a48b thru 0x01bb8b (0x1701 bytes) 000031 1789449326.486796 punch from 0x00202a to 0x003014 (0xfeb bytes) 000035 1789449326.516782 read 0x023d97 thru 0x02ac17 (0x6e81 bytes) 000036 1789449326.518208 trunc from 0x02be6c to 0x016b1f (0x1534c bytes) 000037 1789449326.559806 mapwrite 0x00b355 thru 0x00e45f (0x310b bytes) 000038 1789449326.702853 mapread 0x00db36 thru 0x016b1f (0x8fea bytes) 000040 1789449326.714913 write 0x0026f8 thru 0x00a85a (0x8163 bytes) 000041 1789449326.744956 trunc from 0x016b20 to 0x00366a (0x134b5 bytes) 000043 1789449326.812528 write 0x01f0e7 thru 0x027a56 (0x8970 bytes) 000044 1789449326.819209 read 0x000498 thru 0x009755 (0x92be bytes) 000047 1789449326.873541 write 0x01d3c9 thru 0x0246fa (0x7332 bytes) 000049 1789449326.896829 mapread 0x00ab5b thru 0x013d49 (0x91ef bytes) 000050 1789449326.905699 read 0x003c91 thru 0x00f4ec (0xb85c bytes) 000051 1789449326.914054 mapread 0x0095eb thru 0x012a31 (0x9447 bytes) 000052 1789449326.936179 mapwrite 0x00a433 thru 0x01a362 (0xff30 bytes) truncating to largest ever: 0x3de4e 000055 1789449327.069576 trunc from 0x027a57 to 0x03de4d (0x163f7 bytes) 000058 1789449327.145479 MIRROR_EXTEND to 2 mirrors 000060 1789449328.372763 mapread 0x0336d2 thru 0x03de4d (0xa77c bytes) 000063 1789449328.426469 MIRROR_EXTEND to 3 mirrors 000064 1789449329.712629 read 0x039570 thru 0x03db9e (0x462f bytes) 000065 1789449329.733106 punch from 0x0371c7 to 0x03a2d2 (0x310c bytes) 000068 1789449329.865205 trunc from 0x03de4e to 0x0257ee (0x1865f bytes) 000069 1789449329.900554 mapread 0x00503f thru 0x006008 (0xfca bytes) 000070 1789449329.915786 trunc from 0x0257ef to 0x01da51 (0x7d9d bytes) 000072 1789449329.947617 mapwrite 0x021f46 thru 0x023ed6 (0x1f91 bytes) 000073 1789449330.037363 read 0x019313 thru 0x023ed6 (0xabc4 bytes) 000075 1789449330.074178 punch from 0x014c82 to 0x020456 (0xb7d5 bytes) 000076 1789449330.084887 read 0x00922b thru 0x00fb32 (0x6908 bytes) 000077 1789449330.086142 mapread 0x0190e8 thru 0x01fe9e (0x6db7 bytes) 000078 1789449330.110212 read 0x015108 thru 0x020109 (0xb002 bytes) 000079 1789449330.111218 read 0x01c348 thru 0x023ed6 (0x7b8f bytes) 000080 1789449330.115447 trunc from 0x023ed7 to 0x0351bf (0x112e9 bytes) 000082 1789449330.153081 mapread 0x02c118 thru 0x0322c4 (0x61ad bytes) 000083 1789449330.171298 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x351c0): Mirror 3: 0x803ecb9e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351c0): Mirror 3: 0x803ecb9e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351c0: skipped 000084 1789449330.746155 punch from 0x008d96 to 0x00ad04 (0x1f6f bytes) 000085 1789449330.761559 write 0x002d1f thru 0x011190 (0xe472 bytes) 000087 1789449330.782858 mapwrite 0x0286ad thru 0x0375e7 (0xef3b bytes) 000088 1789449330.961943 mapwrite 0x028f34 thru 0x035bb7 (0xcc84 bytes) 000089 1789449331.044220 punch from 0x033c4b to 0x0375e7 (0x399d bytes) 000091 1789449331.057193 trunc from 0x0375e8 to 0x00075a (0x36e8d bytes) 000092 1789449331.083440 punch from 0x000345 to 0x00075a (0x416 bytes) 000093 1789449331.097027 punch from 0x0005a4 to 0x00075a (0x1b7 bytes) 000094 1789449331.107992 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x75b): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x75b): Mirror 3: 0x87ce4f0f (stale) CRC-32 checksum value for chunk [0, 0x75b): Mirror 1: 0x87ce4f0f Mirror 4: 0x87ce4f0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x75b: skipped 000095 1789449332.209664 trunc from 0x00075b to 0x01aff8 (0x1a89e bytes) 000096 1789449332.352814 mapwrite 0x01dfe3 thru 0x0208be (0x28dc bytes) 000097 1789449332.514143 punch from 0x008d28 to 0x015a18 (0xccf1 bytes) 000098 1789449332.522001 punch from 0x01445e to 0x019106 (0x4ca9 bytes) 000099 1789449332.532692 trunc from 0x0208bf to 0x031a5f (0x111a1 bytes) 000100 1789449332.551807 mapwrite 0x01b2e3 thru 0x021edb (0x6bf9 bytes) 000101 1789449332.617659 read 0x02b4c4 thru 0x031a5f (0x659c bytes) 000102 1789449332.629521 trunc from 0x031a60 to 0x032e6a (0x140b bytes) 000104 1789449332.652899 punch from 0x01ab97 to 0x0290a1 (0xe50b bytes) 000105 1789449332.661195 mapwrite 0x01d629 thru 0x027b19 (0xa4f1 bytes) 000106 1789449332.740664 trunc from 0x032e6b to 0x03c694 (0x982a bytes) 000107 1789449332.768444 mapread 0x026dfd thru 0x02ba24 (0x4c28 bytes) 000109 1789449332.771513 punch from 0x00eccc to 0x016a0a (0x7d3f bytes) 000110 1789449332.782021 mapread 0x02923f thru 0x03057a (0x733c bytes) 000112 1789449332.800599 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c695): Mirror 3: 0x823858df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c695): Mirror 3: 0x823858df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c695: skipped 000113 1789449333.258658 read 0x016303 thru 0x024ae7 (0xe7e5 bytes) 000114 1789449333.281714 trunc from 0x03c695 to 0x0076b3 (0x34fe1 bytes) 000117 1789449333.328779 write 0x020fe0 thru 0x02306e (0x208f bytes) 000118 1789449333.329915 write 0x01e79a thru 0x02387a (0x50e1 bytes) 000119 1789449333.334090 punch from 0x0138f6 to 0x01a17a (0x6885 bytes) 000120 1789449333.382860 read 0x00ccfb thru 0x017479 (0xa77f bytes) 000122 1789449333.396964 mapread 0x020c23 thru 0x02387a (0x2c58 bytes) 000124 1789449333.400713 read 0x012e23 thru 0x01dab7 (0xac95 bytes) 000126 1789449333.405498 read 0x0104c8 thru 0x015443 (0x4f7c bytes) 000127 1789449333.411588 write 0x021edc thru 0x02de2d (0xbf52 bytes) 000128 1789449333.413191 read 0x00dc47 thru 0x01bcb8 (0xe072 bytes) 000132 1789449333.423466 read 0x01d286 thru 0x02684e (0x95c9 bytes) 000133 1789449333.427931 mapwrite 0x03740e thru 0x03f58d (0x8180 bytes) 000134 1789449333.539954 mapwrite 0x037bd1 thru 0x03ffff (0x842f bytes) 000135 1789449333.642372 MIRROR_RESYNC 2 mirrors 000136 1789449334.399060 read 0x02db91 thru 0x03aa1d (0xce8d bytes) 000137 1789449334.409142 mapread 0x00c15f thru 0x0100da (0x3f7c bytes) 000139 1789449334.446221 punch from 0x032ee6 to 0x03ffff (0xd11a bytes) 000141 1789449334.569437 trunc from 0x040000 to 0x002f0d (0x3d0f2 bytes) 000144 1789449334.597333 read 0x000ca1 thru 0x002f0d (0x226d bytes) 000145 1789449334.602945 write 0x0192be thru 0x01f5da (0x631d bytes) 000148 1789449334.605903 write 0x03898e thru 0x03ffff (0x7672 bytes) 000150 1789449334.609091 mapwrite 0x007fcd thru 0x008ab4 (0xae8 bytes) 000152 1789449334.692562 punch from 0x00dd1f to 0x01aeb9 (0xd19b bytes) 000153 1789449334.703204 punch from 0x016ce9 to 0x022cab (0xbfc3 bytes) 000154 1789449334.714441 write 0x029f7e thru 0x033ee7 (0x9f6a bytes) 000156 1789449334.716323 mapread 0x02f2fd thru 0x0312a2 (0x1fa6 bytes) 000157 1789449334.717644 mapwrite 0x0268c6 thru 0x0290fc (0x2837 bytes) 000160 1789449334.786845 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) 000162 1789449334.936970 write 0x026fa4 thru 0x032082 (0xb0df bytes) 000167 1789449334.953346 punch from 0x012a09 to 0x0183c7 (0x59bf bytes) 000169 1789449334.985936 read 0x002b1e thru 0x00784e (0x4d31 bytes) 000170 1789449335.000306 mapread 0x01ae51 thru 0x01d1a5 (0x2355 bytes) 000171 1789449335.024033 mapread 0x003087 thru 0x009cee (0x6c68 bytes) 000173 1789449335.046988 read 0x02affc thru 0x02bc9c (0xca1 bytes) 000174 1789449335.047870 mapread 0x007835 thru 0x00823c (0xa08 bytes) 000175 1789449335.052132 mapread 0x03bce0 thru 0x03ffff (0x4320 bytes) 000176 1789449335.084035 punch from 0x00186e to 0x00c94f (0xb0e2 bytes) 000177 1789449335.095129 read 0x02c3e5 thru 0x038d28 (0xc944 bytes) 000181 1789449335.099223 mapwrite 0x001050 thru 0x0011a8 (0x159 bytes) 000182 1789449335.169711 write 0x01393a thru 0x01eec5 (0xb58c bytes) 000183 1789449335.174046 mapread 0x0322ea thru 0x0356fa (0x3411 bytes) 000185 1789449335.176181 read 0x03eef8 thru 0x03ffff (0x1108 bytes) 000186 1789449335.178418 punch from 0x03e410 to 0x03ffff (0x1bf0 bytes) 000188 1789449335.200985 punch from 0x028870 to 0x02af61 (0x26f2 bytes) 000189 1789449335.213699 write 0x01edef thru 0x027b7c (0x8d8e bytes) 000191 1789449335.216633 punch from 0x01e441 to 0x02d24b (0xee0b bytes) 000192 1789449335.235986 write 0x03cac5 thru 0x03ffff (0x353b bytes) 000193 1789449335.237574 write 0x01eaf6 thru 0x022f97 (0x44a2 bytes) 000194 1789449335.263717 trunc from 0x040000 to 0x01459c (0x2ba63 bytes) 000196 1789449335.284365 write 0x002363 thru 0x00e6a7 (0xc345 bytes) 000197 1789449335.285686 write 0x036c95 thru 0x03af41 (0x42ad bytes) 000199 1789449335.287903 read 0x0265e7 thru 0x0306f4 (0xa10e bytes) 000201 1789449335.296371 read 0x011185 thru 0x01bab3 (0xa92f bytes) 000204 1789449335.298186 trunc from 0x03af42 to 0x037591 (0x39b0 bytes) 000205 1789449335.310623 mapread 0x0023da thru 0x00b9a7 (0x95ce bytes) 000206 1789449335.313950 mapread 0x009b30 thru 0x01563b (0xbb0c bytes) 000207 1789449335.316028 read 0x012263 thru 0x0195ec (0x738a bytes) 000210 1789449335.318928 punch from 0x01d384 to 0x0223e0 (0x505d bytes) 000211 1789449335.331081 mapread 0x00e0f7 thru 0x01207f (0x3f89 bytes) 000213 1789449335.332648 punch from 0x02ba0e to 0x02d8dd (0x1ed0 bytes) 000214 1789449335.338211 write 0x03a7b5 thru 0x03ffff (0x584b bytes) 000217 1789449335.345658 MIRROR_EXTEND to 2 mirrors 000220 1789449336.313702 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) 000221 1789449336.524738 mapwrite 0x02c3ce thru 0x031c5f (0x5892 bytes) 000222 1789449336.681160 mapwrite 0x00a7d3 thru 0x01755f (0xcd8d bytes) 000227 1789449336.817332 mapread 0x035228 thru 0x03eea7 (0x9c80 bytes) 000230 1789449336.841448 punch from 0x004e1e to 0x01097e (0xbb61 bytes) 000231 1789449336.868200 punch from 0x028d71 to 0x02e87f (0x5b0f bytes) 000233 1789449336.886471 write 0x035082 thru 0x03ffff (0xaf7e bytes) 000235 1789449336.895354 mapwrite 0x0189c3 thru 0x01f6a5 (0x6ce3 bytes) 000236 1789449336.995412 punch from 0x01ea94 to 0x020df1 (0x235e bytes) 000237 1789449337.028953 mapread 0x0238e2 thru 0x02a351 (0x6a70 bytes) 000239 1789449337.041566 write 0x021abe thru 0x030be6 (0xf129 bytes) 000241 1789449337.049478 MIRROR_EXTEND to 2 mirrors 000242 1789449338.658954 write 0x00b554 thru 0x0134d3 (0x7f80 bytes) 000243 1789449338.872440 write 0x013836 thru 0x01de6d (0xa638 bytes) 000244 1789449338.883020 read 0x031707 thru 0x039bff (0x84f9 bytes) 000245 1789449338.895953 read 0x01ba98 thru 0x023033 (0x759c bytes) 000246 1789449338.922296 trunc from 0x040000 to 0x0255b7 (0x1aa48 bytes) 000247 1789449339.011894 mapread 0x0042ba thru 0x00c4d3 (0x821a bytes) 000248 1789449339.014680 read 0x01f26b thru 0x0255b7 (0x634d bytes) 000249 1789449339.018859 read 0x00d0eb thru 0x015322 (0x8238 bytes) 000251 1789449339.023095 read 0x00ddb9 thru 0x01a021 (0xc269 bytes) 000252 1789449339.025115 write 0x006f0b thru 0x00a77e (0x3874 bytes) 000253 1789449339.044827 mapwrite 0x014268 thru 0x016563 (0x22fc bytes) 000255 1789449339.225978 read 0x01481f thru 0x01efbf (0xa7a1 bytes) 000256 1789449339.226816 punch from 0x00b850 to 0x00bc7e (0x42f bytes) 000257 1789449339.256007 mapwrite 0x01a1cb thru 0x01a763 (0x599 bytes) 000258 1789449339.385132 write 0x000ad4 thru 0x00dea2 (0xd3cf bytes) 000260 1789449339.386988 punch from 0x019e49 to 0x0255b7 (0xb76f bytes) 000261 1789449339.432691 mapread 0x00a3ec thru 0x00f325 (0x4f3a bytes) 000263 1789449339.458956 read 0x019f7b thru 0x0255b7 (0xb63d bytes) 000264 1789449339.492638 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x255b8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x255b8): Mirror 2: 0xb0b23059 (stale) CRC-32 checksum value for chunk [0, 0x255b8): Mirror 1: 0x842b1dd7 Mirror 3: 0x842b1dd7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x255b8: skipped 000265 1789449341.028887 mapwrite 0x0117f4 thru 0x018ff1 (0x77fe bytes) 000267 1789449341.279325 mapread 0x01dbee thru 0x0255b7 (0x79ca bytes) 000269 1789449341.308041 write 0x033b1a thru 0x03dd66 (0xa24d bytes) 000270 1789449341.319012 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3dd67): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd67): Mirror 2: 0xf5f6f25 (stale) Mirror 3: 0xd4b878b (stale) CRC-32 checksum value for chunk [0, 0x3dd67): Mirror 1: 0x880c4822 Mirror 4: 0x880c4822 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd67: skipped 000271 1789449343.518897 trunc from 0x03dd67 to 0x02bfa3 (0x11dc3 bytes) 000273 1789449343.720400 mapread 0x0072d2 thru 0x014000 (0xcd2f bytes) 000275 1789449343.767230 read 0x00395f thru 0x00c67d (0x8d1f bytes) 000276 1789449343.769954 mapwrite 0x01397f thru 0x019ed8 (0x655a bytes) 000277 1789449343.859380 write 0x03c35c thru 0x03ffff (0x3ca4 bytes) 000280 1789449343.881023 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xffa60de5 (stale) Mirror 3: 0x3fdf1bf1 (stale) Mirror 4: 0x373b9b86 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x25e4707d Mirror 5: 0x25e4707d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000281 1789449346.183640 trunc from 0x040000 to 0x0297aa (0x16855 bytes) 000283 1789449346.310387 mapwrite 0x02201e thru 0x031ac6 (0xfaa9 bytes) 000286 1789449346.627690 mapread 0x009865 thru 0x00de85 (0x4621 bytes) 000288 1789449346.679903 trunc from 0x031ac7 to 0x030abe (0x1008 bytes) 000290 1789449346.728785 trunc from 0x030abf to 0x039461 (0x89a3 bytes) 000291 1789449346.756473 read 0x02290e thru 0x025b90 (0x3283 bytes) 000292 1789449346.757780 punch from 0x0221f5 to 0x030e61 (0xec6d bytes) 000293 1789449346.770617 read 0x036733 thru 0x039461 (0x2d2f bytes) 000294 1789449346.783402 mapwrite 0x03bd98 thru 0x03ffff (0x4268 bytes) 000295 1789449347.020873 read 0x01fa1b thru 0x02aa01 (0xafe7 bytes) 000296 1789449347.027620 write 0x03da79 thru 0x03ffff (0x2587 bytes) 000297 1789449347.034425 punch from 0x00a78e to 0x01566f (0xaee2 bytes) 000298 1789449347.083186 mapread 0x024b49 thru 0x02a411 (0x58c9 bytes) 000299 1789449347.090257 punch from 0x02b99d to 0x03546f (0x9ad3 bytes) 000300 1789449347.110194 trunc from 0x040000 to 0x033c6a (0xc395 bytes) 000301 1789449347.135004 punch from 0x0219ce to 0x02eccb (0xd2fe bytes) 000302 1789449347.148396 trunc from 0x033c6b to 0x008b5c (0x2b10e bytes) 000303 1789449347.191831 mapwrite 0x00e661 thru 0x011582 (0x2f22 bytes) 000305 1789449347.380565 write 0x031905 thru 0x037a14 (0x6110 bytes) 000306 1789449347.382963 punch from 0x02ab54 to 0x02d0d2 (0x257f bytes) 000310 1789449347.422683 trunc from 0x037a15 to 0x006280 (0x31794 bytes) 000312 1789449347.477109 mapwrite 0x0261de thru 0x026431 (0x254 bytes) 000313 1789449347.621166 mapwrite 0x025156 thru 0x02ad17 (0x5bc2 bytes) 000314 1789449347.851135 mapread 0x00ca72 thru 0x00f6f6 (0x2c85 bytes) 000315 1789449347.883569 write 0x01cade thru 0x027944 (0xae67 bytes) 000316 1789449347.884765 mapwrite 0x02af7b thru 0x0317db (0x6861 bytes) 000317 1789449348.083470 trunc from 0x0317dc to 0x02f423 (0x23b8 bytes) 000318 1789449348.117722 read 0x01d914 thru 0x02a295 (0xc982 bytes) 000319 1789449348.119110 read 0x022a27 thru 0x02f423 (0xc9fd bytes) 000320 1789449348.131826 mapread 0x02bcbd thru 0x02f423 (0x3767 bytes) 000322 1789449348.141526 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f424): Mirror 3: 0x366bce99 (stale) Mirror 4: 0x942b6385 (stale) Mirror 5: 0xef5fe4ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f424): Mirror 3: 0x366bce99 (stale) Mirror 4: 0x942b6385 (stale) Mirror 5: 0xef5fe4ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f424: skipped 000323 1789449348.852824 read 0x0024d1 thru 0x006494 (0x3fc4 bytes) 000324 1789449348.868563 write 0x03b3a5 thru 0x03ffff (0x4c5b bytes) 000326 1789449348.872014 mapwrite 0x015bb2 thru 0x0187bb (0x2c0a bytes) 000327 1789449349.070289 mapread 0x018b24 thru 0x02352d (0xaa0a bytes) 000328 1789449349.089515 mapwrite 0x020b22 thru 0x02140e (0x8ed bytes) 000330 1789449349.188357 mapwrite 0x022e56 thru 0x0295f6 (0x67a1 bytes) 000331 1789449349.386042 punch from 0x00c677 to 0x015bea (0x9574 bytes) 000332 1789449349.423909 write 0x005dbf thru 0x010e26 (0xb068 bytes) 000333 1789449349.471881 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3fdf1bf1 (stale) Mirror 5: 0x25e4707d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3fdf1bf1 (stale) Mirror 5: 0x25e4707d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000336 1789449350.238524 trunc from 0x040000 to 0x034470 (0xbb8f bytes) 000338 1789449350.301169 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34471): Mirror 5: 0xc6d79418 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34471): Mirror 5: 0xc6d79418 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34471: skipped 000339 1789449350.769888 mapwrite 0x015cfe thru 0x01e068 (0x836b bytes) 000340 1789449350.934305 read 0x0287f0 thru 0x029606 (0xe17 bytes) 000343 1789449350.952865 trunc from 0x034471 to 0x0136d8 (0x20d98 bytes) 000344 1789449350.995340 mapread 0x00f0c8 thru 0x0136d8 (0x4611 bytes) 000346 1789449351.013112 write 0x029c70 thru 0x034382 (0xa713 bytes) 000347 1789449351.015393 mapread 0x004875 thru 0x00b95d (0x70e9 bytes) 000348 1789449351.026131 mapwrite 0x03288d thru 0x03ffff (0xd773 bytes) 000349 1789449351.170553 trunc from 0x040000 to 0x0079a8 (0x38657 bytes) 000350 1789449351.191428 trunc from 0x0079a9 to 0x009c88 (0x22e0 bytes) 000352 1789449351.246309 write 0x004bb9 thru 0x0145c0 (0xfa08 bytes) 000355 1789449351.277145 trunc from 0x0145c1 to 0x010c8e (0x3932 bytes) 000356 1789449351.354095 write 0x02bd29 thru 0x02c294 (0x56c bytes) 000357 1789449351.362331 mapwrite 0x00bf93 thru 0x012cf2 (0x6d60 bytes) 000358 1789449351.501614 punch from 0x0012d2 to 0x00ee34 (0xdb63 bytes) 000359 1789449351.530803 trunc from 0x02c295 to 0x02bc10 (0x684 bytes) 000360 1789449351.593427 punch from 0x015a6f to 0x01b13b (0x56cd bytes) 000361 1789449351.603350 read 0x018396 thru 0x0244d9 (0xc144 bytes) 000362 1789449351.645113 mapwrite 0x020add thru 0x029210 (0x8734 bytes) 000364 1789449351.721367 read 0x01ba1d thru 0x02773f (0xbd23 bytes) 000365 1789449351.722979 mapwrite 0x038f2e thru 0x03d78f (0x4862 bytes) 000366 1789449351.890736 read 0x015b25 thru 0x025a65 (0xff41 bytes) 000367 1789449351.907462 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d790): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d790): Mirror 5: 0x609ccfd7 (stale) CRC-32 checksum value for chunk [0, 0x3d790): Mirror 1: 0xe279358d Mirror 6: 0xe279358d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d790: skipped 000368 1789449353.385716 MIRROR_RESYNC 3 mirrors 000369 1789449354.471369 trunc from 0x03d790 to 0x02cb15 (0x10c7a bytes) 000370 1789449354.579127 write 0x02ca6e thru 0x03a333 (0xd8c6 bytes) 000371 1789449354.619103 MIRROR_RESYNC 3 mirrors 000373 1789449356.192788 read 0x0093a0 thru 0x011def (0x8a50 bytes) 000374 1789449356.207673 trunc from 0x03a334 to 0x00048a (0x39ea9 bytes) 000375 1789449356.306226 trunc from 0x00048b to 0x02b6ac (0x2b222 bytes) 000376 1789449356.336976 punch from 0x02321a to 0x026430 (0x3217 bytes) 000377 1789449356.347308 read 0x006510 thru 0x0155a8 (0xf099 bytes) 000378 1789449356.359296 mapread 0x02854c thru 0x028901 (0x3b6 bytes) 000379 1789449356.360587 read 0x00e2bb thru 0x01c65b (0xe3a1 bytes) 000381 1789449356.367810 mapwrite 0x03bf31 thru 0x03ef39 (0x3009 bytes) 000384 1789449356.515306 read 0x009300 thru 0x00e1ca (0x4ecb bytes) 000386 1789449356.523792 punch from 0x010331 to 0x01d728 (0xd3f8 bytes) 000387 1789449356.536802 trunc from 0x03ef3a to 0x01be2a (0x2310f bytes) 000388 1789449356.583769 mapread 0x00c505 thru 0x015cd0 (0x97cc bytes) 000389 1789449356.603026 read 0x011283 thru 0x0167f4 (0x5572 bytes) 000390 1789449356.607038 mapread 0x018f24 thru 0x01b4fe (0x25db bytes) 000391 1789449356.619075 write 0x019b0e thru 0x023ddd (0xa2d0 bytes) 000392 1789449356.638427 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x23dde): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23dde): Mirror 5: 0x5a2ee2f8 (stale) Mirror 6: 0x5a2ee2f8 (stale) CRC-32 checksum value for chunk [0, 0x23dde): Mirror 1: 0xb08e75fc Mirror 7: 0xb08e75fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23dde: skipped 000393 1789449358.949721 mapwrite 0x0256bd thru 0x0302ab (0xabef bytes) 000394 1789449359.217157 write 0x034383 thru 0x03ffff (0xbc7d bytes) 000395 1789449359.218541 mapread 0x009897 thru 0x011cc5 (0x842f bytes) 000396 1789449359.240718 mapwrite 0x01ed7c thru 0x029d26 (0xafab bytes) 000398 1789449359.409048 write 0x0352f7 thru 0x03aade (0x57e8 bytes) 000399 1789449359.410075 punch from 0x01f7fa to 0x02d22a (0xda31 bytes) 000400 1789449359.471010 punch from 0x008d21 to 0x00fa98 (0x6d78 bytes) 000401 1789449359.504823 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x99ea411e (stale) Mirror 6: 0x99ea411e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x99ea411e (stale) Mirror 6: 0x99ea411e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000402 1789449360.255443 mapwrite 0x02604e thru 0x02b8e3 (0x5896 bytes) 000406 1789449360.420037 mapwrite 0x00d562 thru 0x01478b (0x722a bytes) 000407 1789449360.623308 mapread 0x0331c7 thru 0x03dfa0 (0xadda bytes) 000408 1789449360.709673 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x99ea411e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x99ea411e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000409 1789449361.308695 write 0x02e313 thru 0x03c14a (0xde38 bytes) 000410 1789449361.324752 mapwrite 0x024ed6 thru 0x031656 (0xc781 bytes) 000411 1789449361.497325 punch from 0x0125e1 to 0x0211cb (0xebeb bytes) 000412 1789449361.509511 write 0x018f45 thru 0x0199bf (0xa7b bytes) 000413 1789449361.526068 mapwrite 0x02b3be thru 0x0380c9 (0xcd0c bytes) 000414 1789449361.605792 mapwrite 0x018ad8 thru 0x028ab2 (0xffdb bytes) 000415 1789449361.705809 mapread 0x0075bc thru 0x00f5a4 (0x7fe9 bytes) 000416 1789449361.719421 mapwrite 0x00dbb6 thru 0x014f1b (0x7366 bytes) 000417 1789449361.788475 mapwrite 0x00b341 thru 0x00e540 (0x3200 bytes) 000418 1789449361.874596 MIRROR_RESYNC 2 mirrors 000420 1789449363.229164 MIRROR_RESYNC 2 mirrors 000422 1789449363.727571 write 0x032460 thru 0x03e7fa (0xc39b bytes) 000423 1789449363.857535 write 0x029b9f thru 0x03723f (0xd6a1 bytes) 000424 1789449363.866876 read 0x02bf62 thru 0x034b6b (0x8c0a bytes) 000426 1789449363.873486 MIRROR_RESYNC 2 mirrors 000427 1789449365.003059 MIRROR_RESYNC 2 mirrors 000428 1789449365.569622 trunc from 0x040000 to 0x039ab3 (0x654c bytes) 000429 1789449365.749141 trunc from 0x039ab4 to 0x0202cb (0x197e8 bytes) 000431 1789449365.787536 mapwrite 0x033dd0 thru 0x036240 (0x2471 bytes) 000432 1789449366.014043 mapread 0x00200a thru 0x00e62f (0xc626 bytes) 000433 1789449366.029884 read 0x03607f thru 0x036240 (0x1c2 bytes) 000434 1789449366.037092 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) 000435 1789449366.376849 MIRROR_EXTEND to 2 mirrors 000437 1789449367.842735 read 0x022b55 thru 0x030738 (0xdbe4 bytes) 000440 1789449367.859704 mapwrite 0x003c66 thru 0x00ecd8 (0xb073 bytes) 000441 1789449368.201309 trunc from 0x036241 to 0x03b694 (0x5454 bytes) 000442 1789449368.277682 trunc from 0x03b695 to 0x00c606 (0x2f08e bytes) 000443 1789449368.330405 mapwrite 0x00a7f6 thru 0x00c2a5 (0x1ab0 bytes) 000444 1789449368.427860 read 0x001771 thru 0x001c75 (0x505 bytes) 000445 1789449368.428551 punch from 0x0086d5 to 0x00c606 (0x3f32 bytes) 000446 1789449368.437418 trunc from 0x00c607 to 0x0172f7 (0xacf1 bytes) 000447 1789449368.461961 mapwrite 0x01c54d thru 0x020fff (0x4ab3 bytes) 000448 1789449368.666121 write 0x0092ea thru 0x00c42d (0x3144 bytes) 000449 1789449368.668071 read 0x015360 thru 0x020af5 (0xb796 bytes) 000450 1789449368.669859 mapwrite 0x000ce7 thru 0x0051ee (0x4508 bytes) 000451 1789449368.752077 mapwrite 0x036e4c thru 0x03ffff (0x91b4 bytes) 000452 1789449368.903048 MIRROR_RESYNC 2 mirrors 000453 1789449370.267401 MIRROR_EXTEND to 3 mirrors 000454 1789449371.391991 write 0x03dbb7 thru 0x03ffff (0x2449 bytes) 000455 1789449371.478920 read 0x023c95 thru 0x030314 (0xc680 bytes) 000456 1789449371.489374 punch from 0x016534 to 0x01d8db (0x73a8 bytes) 000457 1789449371.500404 mapread 0x02f4ca thru 0x03b557 (0xc08e bytes) 000458 1789449371.521966 write 0x0033fc thru 0x003c0c (0x811 bytes) 000459 1789449371.536547 MIRROR_RESYNC 3 mirrors 000460 1789449372.928842 mapwrite 0x014c8e thru 0x015acf (0xe42 bytes) 000461 1789449373.252398 mapread 0x01b044 thru 0x024ea4 (0x9e61 bytes) 000463 1789449373.270767 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4fdfb1d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4fdfb1d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000464 1789449373.689830 read 0x016d4d thru 0x0212bd (0xa571 bytes) 000465 1789449373.702463 write 0x0049e1 thru 0x0101b0 (0xb7d0 bytes) 000467 1789449373.713439 punch from 0x034b3f to 0x03bcc9 (0x718b bytes) 000470 1789449373.730894 trunc from 0x040000 to 0x008b9f (0x37460 bytes) 000471 1789449373.753977 mapwrite 0x00aebb thru 0x01802c (0xd172 bytes) 000473 1789449373.885427 read 0x0142ac thru 0x01802c (0x3d81 bytes) 000474 1789449373.888418 mapread 0x009c44 thru 0x00a841 (0xbfe bytes) 000477 1789449373.901993 MIRROR_RESYNC 2 mirrors 000478 1789449374.834664 trunc from 0x01802d to 0x01fe3a (0x7e0e bytes) 000479 1789449374.936071 punch from 0x013daf to 0x01ede3 (0xb035 bytes) 000482 1789449374.942653 mapread 0x014dcc thru 0x01b27f (0x64b4 bytes) 000484 1789449374.980197 MIRROR_RESYNC 2 mirrors 000487 1789449375.755563 punch from 0x0037bc to 0x00914d (0x5992 bytes) 000489 1789449375.856827 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1fe3b): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fe3b): Mirror 3: 0xf134f0c1 (stale) CRC-32 checksum value for chunk [0, 0x1fe3b): Mirror 1: 0xf6fe55b1 Mirror 4: 0xf6fe55b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fe3b: skipped 000492 1789449377.405791 punch from 0x014f7a to 0x01521b (0x2a2 bytes) 000493 1789449377.538156 mapread 0x0196ce thru 0x01cc67 (0x359a bytes) 000495 1789449377.593586 trunc from 0x01fe3b to 0x035017 (0x151dd bytes) 000496 1789449377.641341 write 0x037131 thru 0x03f5a2 (0x8472 bytes) 000497 1789449377.645438 read 0x00486a thru 0x008d84 (0x451b bytes) 000499 1789449377.660345 mapwrite 0x02b47f thru 0x031dbb (0x693d bytes) 000500 1789449377.835700 write 0x02da88 thru 0x036ef5 (0x946e bytes) 000502 1789449377.844906 read 0x010c45 thru 0x01f446 (0xe802 bytes) 000503 1789449377.875690 mapread 0x031633 thru 0x0360e2 (0x4ab0 bytes) 000504 1789449377.876889 trunc from 0x03f5a3 to 0x03686e (0x8d34 bytes) 000505 1789449377.916319 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3686f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3686f): Mirror 3: 0x57218803 (stale) Mirror 4: 0x4ac02eb (stale) CRC-32 checksum value for chunk [0, 0x3686f): Mirror 1: 0xaf34f646 Mirror 5: 0xaf34f646 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3686f: skipped 000506 1789449379.171343 mapwrite 0x02566b thru 0x028731 (0x30c7 bytes) 000508 1789449379.390069 read 0x0029d0 thru 0x002cee (0x31f bytes) 000510 1789449379.400481 punch from 0x0298c2 to 0x03686e (0xcfad bytes) 000512 1789449379.412482 MIRROR_RESYNC 4 mirrors 000513 1789449380.835983 read 0x00b04f thru 0x0122a1 (0x7253 bytes) 000517 1789449380.849426 punch from 0x019a8d to 0x027e9c (0xe410 bytes) 000520 1789449380.970086 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3686f): Mirror 4: 0x12c16328 (stale) Mirror 5: 0x12c16328 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3686f): Mirror 4: 0x12c16328 (stale) Mirror 5: 0x12c16328 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3686f: skipped 000522 1789449381.591829 mapwrite 0x0035ad thru 0x0069d1 (0x3425 bytes) 000523 1789449381.737898 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3686f): Mirror 5: 0x12c16328 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3686f): Mirror 5: 0x12c16328 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3686f: skipped 000524 1789449382.203080 mapwrite 0x01faa8 thru 0x02f30b (0xf864 bytes) 000527 1789449382.330700 mapread 0x03601c thru 0x03686e (0x853 bytes) 000528 1789449382.347553 write 0x000a53 thru 0x003892 (0x2e40 bytes) 000529 1789449382.366571 mapwrite 0x00e347 thru 0x011da0 (0x3a5a bytes) 000531 1789449382.479834 read 0x00fe1b thru 0x019a26 (0x9c0c bytes) 000533 1789449382.489473 trunc from 0x03686f to 0x0388bf (0x2051 bytes) 000535 1789449382.526852 punch from 0x00a20a to 0x00a5bc (0x3b3 bytes) 000536 1789449382.536580 mapwrite 0x029a99 thru 0x02fa4b (0x5fb3 bytes) 000537 1789449382.625007 trunc from 0x0388c0 to 0x020303 (0x185bc bytes) 000538 1789449382.654130 punch from 0x01001f to 0x01ed59 (0xed3b bytes) 000540 1789449382.665932 mapwrite 0x016804 thru 0x022f98 (0xc795 bytes) 000541 1789449382.802340 mapread 0x016041 thru 0x018dce (0x2d8e bytes) 000545 1789449382.810682 write 0x03ce05 thru 0x03ffff (0x31fb bytes) 000546 1789449382.820273 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) 000547 1789449383.047515 mapread 0x0158a4 thru 0x020071 (0xa7ce bytes) 000548 1789449383.110971 mapread 0x004114 thru 0x012c2d (0xeb1a bytes) 000549 1789449383.126350 read 0x0177d6 thru 0x018672 (0xe9d bytes) 000550 1789449383.128284 punch from 0x015c97 to 0x01e377 (0x86e1 bytes) 000552 1789449383.138110 mapwrite 0x00a1fa thru 0x00c920 (0x2727 bytes) 000553 1789449383.218321 read 0x020c4a thru 0x0226be (0x1a75 bytes) 000554 1789449383.219832 read 0x027f7c thru 0x02bf0c (0x3f91 bytes) 000555 1789449383.237691 punch from 0x031edd to 0x033a3d (0x1b61 bytes) 000557 1789449383.246271 mapread 0x01c1e3 thru 0x0265fb (0xa419 bytes) 000558 1789449383.248044 read 0x020e5c thru 0x02bec7 (0xb06c bytes) 000559 1789449383.250146 mapwrite 0x029dee thru 0x031532 (0x7745 bytes) 000560 1789449383.339540 mapwrite 0x0101c3 thru 0x01060b (0x449 bytes) 000561 1789449383.454429 mapwrite 0x000eb3 thru 0x00e461 (0xd5af bytes) 000563 1789449383.538115 mapread 0x0087c2 thru 0x015e28 (0xd667 bytes) 000564 1789449383.540192 punch from 0x026817 to 0x028d15 (0x24ff bytes) 000565 1789449383.548813 mapread 0x021326 thru 0x0299f7 (0x86d2 bytes) 000566 1789449383.568438 mapread 0x0350ce thru 0x03dfb1 (0x8ee4 bytes) 000568 1789449383.571017 mapwrite 0x03941f thru 0x03ad77 (0x1959 bytes) 000569 1789449383.637139 mapread 0x033b98 thru 0x03f75a (0xbbc3 bytes) 000573 1789449383.645346 write 0x004753 thru 0x009b8c (0x543a bytes) 000574 1789449383.648157 trunc from 0x040000 to 0x01a0a6 (0x25f59 bytes) 000575 1789449383.679391 write 0x019115 thru 0x024d3f (0xbc2b bytes) 000578 1789449383.691664 mapread 0x021ea4 thru 0x022648 (0x7a5 bytes) 000580 1789449383.699135 read 0x0140fb thru 0x01ffa6 (0xbeac bytes) 000582 1789449383.700223 mapread 0x01fb31 thru 0x024d3f (0x520f bytes) 000583 1789449383.702497 write 0x022215 thru 0x02c111 (0x9efd bytes) 000586 1789449383.708063 trunc from 0x02c112 to 0x02cf45 (0xe34 bytes) 000588 1789449383.736979 mapread 0x00d7e5 thru 0x012d3b (0x5557 bytes) 000589 1789449383.740048 read 0x0268f5 thru 0x02cf45 (0x6651 bytes) 000590 1789449383.741023 trunc from 0x02cf46 to 0x01e363 (0xebe2 bytes) 000591 1789449383.776472 write 0x00c457 thru 0x00cbac (0x756 bytes) 000594 1789449383.781126 trunc from 0x01e364 to 0x00c9cf (0x11994 bytes) 000595 1789449383.819113 read 0x003cbd thru 0x00c9cf (0x8d13 bytes) 000596 1789449383.820965 punch from 0x000f6d to 0x00c8e1 (0xb975 bytes) 000598 1789449383.849303 trunc from 0x00c9d0 to 0x0122a9 (0x58da bytes) 000599 1789449383.875056 write 0x02ced9 thru 0x02d418 (0x540 bytes) 000600 1789449383.884050 MIRROR_EXTEND to 2 mirrors 000601 1789449385.045772 write 0x016ca8 thru 0x01f6d1 (0x8a2a bytes) 000603 1789449385.135559 MIRROR_RESYNC 2 mirrors 000604 1789449386.150055 trunc from 0x02d419 to 0x00a32e (0x230ea bytes) 000605 1789449386.243825 punch from 0x004b2c to 0x00a32e (0x5803 bytes) 000607 1789449386.253622 read 0x003e3a thru 0x008e6c (0x5033 bytes) 000608 1789449386.264000 write 0x003eec thru 0x00f5dd (0xb6f2 bytes) 000609 1789449386.265818 mapwrite 0x01c4b8 thru 0x0216d4 (0x521d bytes) 000610 1789449386.376586 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x216d5): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x216d5): Mirror 2: 0xd6208937 (stale) CRC-32 checksum value for chunk [0, 0x216d5): Mirror 1: 0x86e9b823 Mirror 3: 0x86e9b823 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x216d5: skipped 000611 1789449387.509829 mapwrite 0x00af13 thru 0x0103ef (0x54dd bytes) 000612 1789449387.861719 punch from 0x00995b to 0x01490d (0xafb3 bytes) 000613 1789449387.876125 mapread 0x017b8a thru 0x02168a (0x9b01 bytes) 000615 1789449387.897817 trunc from 0x0216d5 to 0x036b99 (0x154c5 bytes) 000616 1789449387.995983 punch from 0x02de2f to 0x02f6ad (0x187f bytes) 000617 1789449388.002207 mapwrite 0x032eb0 thru 0x034779 (0x18ca bytes) 000619 1789449388.060230 read 0x01ebf6 thru 0x02b61c (0xca27 bytes) 000620 1789449388.068475 read 0x02fb5f thru 0x036b99 (0x703b bytes) 000621 1789449388.069077 mapread 0x035330 thru 0x036b99 (0x186a bytes) 000623 1789449388.070931 mapread 0x01cc7d thru 0x02c756 (0xfada bytes) 000625 1789449388.072878 mapread 0x00eedc thru 0x013d5b (0x4e80 bytes) 000627 1789449388.086476 punch from 0x01656a to 0x025a0b (0xf4a2 bytes) 000628 1789449388.091894 write 0x0070c0 thru 0x011d5f (0xaca0 bytes) 000629 1789449388.093628 trunc from 0x036b9a to 0x02ea09 (0x8190 bytes) 000631 1789449388.112886 trunc from 0x02ea0a to 0x036b76 (0x816d bytes) 000634 1789449388.133909 mapwrite 0x00f761 thru 0x018255 (0x8af5 bytes) 000635 1789449388.200988 trunc from 0x036b77 to 0x03940c (0x2896 bytes) 000636 1789449388.218176 mapwrite 0x0326a9 thru 0x036c4d (0x45a5 bytes) 000637 1789449388.318789 write 0x021deb thru 0x026ded (0x5003 bytes) 000638 1789449388.326979 mapwrite 0x013c5f thru 0x0156dc (0x1a7e bytes) 000639 1789449388.389940 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3940d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3940d): Mirror 2: 0x80084a30 (stale) Mirror 3: 0x1f1d87fb (stale) CRC-32 checksum value for chunk [0, 0x3940d): Mirror 1: 0xd791f073 Mirror 4: 0xd791f073 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3940d: skipped 000640 1789449389.228780 mapread 0x01f69a thru 0x02b2fd (0xbc64 bytes) 000641 1789449389.315661 trunc from 0x03940d to 0x00d340 (0x2c0cc bytes) 000642 1789449389.524007 mapwrite 0x020903 thru 0x02de45 (0xd543 bytes) 000643 1789449389.687395 MIRROR_RESYNC 4 mirrors 000644 1789449390.926927 read 0x0262a1 thru 0x028ea1 (0x2c01 bytes) 000645 1789449390.936913 mapwrite 0x003dee thru 0x00fb27 (0xbd3a bytes) 000646 1789449391.174700 mapwrite 0x01e31b thru 0x01fc9d (0x1983 bytes) 000649 1789449391.255747 punch from 0x005e6b to 0x00cc0a (0x6da0 bytes) 000650 1789449391.264929 read 0x02a2c8 thru 0x02de45 (0x3b7e bytes) 000652 1789449391.284443 trunc from 0x02de46 to 0x008bfc (0x25249 bytes) 000653 1789449391.314420 punch from 0x000cbc to 0x008bfc (0x7f41 bytes) 000654 1789449391.333122 mapread 0x000896 thru 0x0066ad (0x5e18 bytes) 000655 1789449391.388210 mapwrite 0x0196d4 thru 0x01ae00 (0x172d bytes) 000658 1789449391.478360 write 0x01f1ce thru 0x0204b2 (0x12e5 bytes) 000659 1789449391.479850 mapwrite 0x02ab71 thru 0x0349d6 (0x9e66 bytes) 000661 1789449391.592939 write 0x02c959 thru 0x03835b (0xba03 bytes) 000664 1789449391.597382 punch from 0x018d06 to 0x0208e1 (0x7bdc bytes) 000666 1789449391.613918 punch from 0x00e6cd to 0x01a537 (0xbe6b bytes) 000667 1789449391.619739 write 0x03684d thru 0x03c371 (0x5b25 bytes) 000668 1789449391.621775 trunc from 0x03c372 to 0x005b00 (0x36871 bytes) 000669 1789449391.645827 write 0x038254 thru 0x03ffff (0x7dac bytes) 000670 1789449391.647435 punch from 0x02ce3a to 0x03b692 (0xe859 bytes) 000672 1789449391.666395 mapwrite 0x030b24 thru 0x037fc5 (0x74a2 bytes) 000673 1789449391.758333 mapread 0x017d30 thru 0x026fc1 (0xf292 bytes) 000674 1789449391.849368 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1de3b217 (stale) Mirror 4: 0x1de3b217 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1de3b217 (stale) Mirror 4: 0x1de3b217 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000675 1789449392.219714 mapwrite 0x019e9a thru 0x0243b3 (0xa51a bytes) 000676 1789449392.348205 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1de3b217 (stale) Mirror 4: 0x1de3b217 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa753de8c Mirror 5: 0xa753de8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000679 1789449393.257345 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1de3b217 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1de3b217 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa753de8c Mirror 5: 0xa753de8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000681 1789449394.040511 trunc from 0x040000 to 0x0178ca (0x28735 bytes) 000682 1789449394.195978 punch from 0x015308 to 0x0178ca (0x25c3 bytes) 000685 1789449394.205441 trunc from 0x0178cb to 0x02fa2a (0x18160 bytes) 000688 1789449394.242879 read 0x013598 thru 0x015484 (0x1eed bytes) 000689 1789449394.249189 mapwrite 0x00f236 thru 0x01340b (0x41d6 bytes) 000690 1789449394.350832 read 0x018f26 thru 0x01e2d8 (0x53b3 bytes) 000693 1789449394.378771 read 0x00e9d3 thru 0x01916e (0xa79c bytes) 000694 1789449394.379983 punch from 0x012862 to 0x01934e (0x6aed bytes) 000695 1789449394.395018 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2fa2b): Mirror 2: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa2b): Mirror 2: 0x9b6530f5 (stale) Mirror 5: 0xcdfa377c (stale) CRC-32 checksum value for chunk [0, 0x2fa2b): Mirror 1: 0xcc5be467 Mirror 6: 0xcc5be467 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa2b: skipped 000699 1789449395.822009 MIRROR_RESYNC 4 mirrors 000701 1789449397.001938 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) 000702 1789449397.568891 mapwrite 0x034dd7 thru 0x03ffff (0xb229 bytes) 000703 1789449397.899673 punch from 0x03d665 to 0x03ffff (0x299b bytes) 000704 1789449397.919051 mapread 0x012a72 thru 0x01b685 (0x8c14 bytes) 000706 1789449397.980066 mapread 0x00d1b1 thru 0x013a18 (0x6868 bytes) 000707 1789449397.981150 mapread 0x00fb17 thru 0x0122cb (0x27b5 bytes) 000708 1789449397.993134 write 0x02e206 thru 0x03b07e (0xce79 bytes) 000709 1789449398.020622 write 0x015010 thru 0x015919 (0x90a bytes) 000711 1789449398.031431 punch from 0x00c07f to 0x013082 (0x7004 bytes) 000712 1789449398.059801 mapwrite 0x030de0 thru 0x03fa95 (0xecb6 bytes) 000713 1789449398.168881 mapwrite 0x031481 thru 0x03d61e (0xc19e bytes) 000715 1789449398.236515 trunc from 0x040000 to 0x0279a6 (0x18659 bytes) 000716 1789449398.262752 mapwrite 0x03872e thru 0x03939d (0xc70 bytes) 000717 1789449398.343874 mapwrite 0x032aae thru 0x03f5da (0xcb2d bytes) 000721 1789449398.441757 mapwrite 0x0374e6 thru 0x03ffff (0x8b1a bytes) 000722 1789449398.514805 write 0x03b05d thru 0x03e177 (0x311b bytes) 000724 1789449398.518189 read 0x02b752 thru 0x02f535 (0x3de4 bytes) 000727 1789449398.532841 mapread 0x03b356 thru 0x03ffff (0x4caa bytes) 000728 1789449398.535059 mapwrite 0x0226ef thru 0x02d17d (0xaa8f bytes) 000733 1789449398.623144 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x4cfac4d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x4cfac4d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000735 1789449398.974596 read 0x03a679 thru 0x03ffff (0x5987 bytes) 000736 1789449398.990793 mapread 0x017561 thru 0x022de4 (0xb884 bytes) 000739 1789449399.024693 mapread 0x0000b2 thru 0x000e00 (0xd4f bytes) 000740 1789449399.036403 mapwrite 0x012c33 thru 0x01b62d (0x89fb bytes) 000741 1789449399.088804 read 0x037f94 thru 0x03fbf7 (0x7c64 bytes) 000742 1789449399.102084 mapwrite 0x00731f thru 0x016067 (0xed49 bytes) 000743 1789449399.171007 MIRROR_RESYNC 2 mirrors 000744 1789449400.209804 trunc from 0x040000 to 0x031c81 (0xe37e bytes) 000746 1789449400.373643 read 0x00e7f7 thru 0x015ade (0x72e8 bytes) 000747 1789449400.391916 trunc from 0x031c82 to 0x033eae (0x222d bytes) 000748 1789449400.430471 mapwrite 0x01efc2 thru 0x02705b (0x809a bytes) 000751 1789449400.529715 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) 000753 1789449400.773926 read 0x020b69 thru 0x025e8a (0x5322 bytes) 000756 1789449400.794200 mapread 0x021db2 thru 0x0271f6 (0x5445 bytes) 000763 1789449400.822748 trunc from 0x033eaf to 0x019cdf (0x1a1cf bytes) 000764 1789449400.859698 mapwrite 0x01556e thru 0x024683 (0xf116 bytes) 000765 1789449400.965638 trunc from 0x024684 to 0x00f18d (0x154f6 bytes) 000766 1789449400.980588 mapread 0x000240 thru 0x00556a (0x532b bytes) 000768 1789449400.992618 punch from 0x0003f7 to 0x00f18d (0xed97 bytes) 000769 1789449400.998852 trunc from 0x00f18e to 0x02de9b (0x1ed0e bytes) 000771 1789449401.016903 punch from 0x02582c to 0x02de9b (0x8670 bytes) 000772 1789449401.023066 mapwrite 0x01bc69 thru 0x0279c0 (0xbd58 bytes) 000773 1789449401.108512 mapwrite 0x014785 thru 0x01a388 (0x5c04 bytes) 000774 1789449401.165869 punch from 0x010e8f to 0x011518 (0x68a bytes) 000776 1789449401.172677 mapread 0x0275a9 thru 0x02de9b (0x68f3 bytes) 000777 1789449401.187793 mapwrite 0x01f888 thru 0x02b9ce (0xc147 bytes) 000779 1789449401.265026 trunc from 0x02de9c to 0x010ecd (0x1cfce bytes) 000780 1789449401.302148 read 0x004f17 thru 0x010ecd (0xbfb7 bytes) 000781 1789449401.317196 mapwrite 0x03f86f thru 0x03ffff (0x791 bytes) 000782 1789449401.454053 mapwrite 0x01ffe1 thru 0x0285fb (0x861b bytes) 000783 1789449401.518997 read 0x0238c6 thru 0x02e3dc (0xab17 bytes) 000784 1789449401.519985 read 0x00535e thru 0x00be38 (0x6adb bytes) 000787 1789449401.523185 mapread 0x035dff thru 0x03874e (0x2950 bytes) 000788 1789449401.524675 mapread 0x0248c6 thru 0x025b30 (0x126b bytes) 000791 1789449401.529841 trunc from 0x040000 to 0x00c179 (0x33e86 bytes) 000792 1789449401.550274 mapwrite 0x01f16e thru 0x028aba (0x994d bytes) 000795 1789449401.730778 mapread 0x00dc7e thru 0x0116dd (0x3a60 bytes) 000796 1789449401.734003 mapread 0x00b549 thru 0x012c93 (0x774b bytes) 000797 1789449401.739679 mapread 0x016e8a thru 0x0234d1 (0xc648 bytes) 000798 1789449401.742097 mapread 0x005c95 thru 0x009795 (0x3b01 bytes) 000799 1789449401.743912 trunc from 0x028abb to 0x027649 (0x1471 bytes) 000802 1789449401.770804 mapwrite 0x01d178 thru 0x02c522 (0xf3ab bytes) 000803 1789449401.869442 trunc from 0x02c523 to 0x031cd8 (0x57b6 bytes) 000806 1789449401.903383 trunc from 0x031cd9 to 0x030c4d (0x108b bytes) 000807 1789449401.927387 mapwrite 0x00f20b thru 0x0158f5 (0x66eb bytes) 000809 1789449402.057986 read 0x0168e6 thru 0x01a664 (0x3d7f bytes) 000810 1789449402.059911 write 0x01dae8 thru 0x0268a1 (0x8dba bytes) 000812 1789449402.071621 mapread 0x01c9d6 thru 0x0293d3 (0xc9fe bytes) 000816 1789449402.081428 trunc from 0x030c4e to 0x02bb98 (0x50b5 bytes) 000817 1789449402.138779 punch from 0x005f49 to 0x00f272 (0x932a bytes) 000819 1789449402.174350 trunc from 0x02bb99 to 0x03bd1b (0x10183 bytes) 000820 1789449402.195587 mapwrite 0x02ab1b thru 0x030343 (0x5829 bytes) 000823 1789449402.269915 trunc from 0x03bd1c to 0x003c9b (0x38080 bytes) 000826 1789449402.293140 write 0x00875f thru 0x010659 (0x7efb bytes) 000827 1789449402.295719 read 0x005d40 thru 0x010659 (0xa91a bytes) 000830 1789449402.308944 mapwrite 0x0242ca thru 0x02c8e8 (0x861f bytes) 000834 1789449402.434674 mapwrite 0x03976b thru 0x03ffff (0x6895 bytes) 000836 1789449402.565720 punch from 0x038a41 to 0x03ffff (0x75bf bytes) 000838 1789449402.580975 write 0x039024 thru 0x03ffff (0x6fdc bytes) 000839 1789449402.598792 read 0x00e657 thru 0x011622 (0x2fcc bytes) 000840 1789449402.603014 mapread 0x03848b thru 0x03ffff (0x7b75 bytes) 000843 1789449402.630984 mapread 0x0145da thru 0x01e0e7 (0x9b0e bytes) 000845 1789449402.633667 write 0x007fb4 thru 0x010a84 (0x8ad1 bytes) 000846 1789449402.639611 punch from 0x02dac0 to 0x030869 (0x2daa bytes) 000848 1789449402.685821 mapread 0x00e82b thru 0x0145ef (0x5dc5 bytes) 000850 1789449402.689579 write 0x03c95a thru 0x03ffff (0x36a6 bytes) 000851 1789449402.698430 mapwrite 0x033f53 thru 0x03905c (0x510a bytes) 000852 1789449402.827702 mapread 0x03ba89 thru 0x03ffff (0x4577 bytes) 000853 1789449402.828788 punch from 0x004ef2 to 0x007556 (0x2665 bytes) 000854 1789449402.838970 punch from 0x0166e5 to 0x01a0f8 (0x3a14 bytes) 000855 1789449402.848775 write 0x02797f thru 0x02ea2a (0x70ac bytes) 000856 1789449402.857862 trunc from 0x040000 to 0x00396d (0x3c692 bytes) 000857 1789449402.885957 mapwrite 0x01876e thru 0x01d758 (0x4feb bytes) 000858 1789449403.032954 write 0x035c2e thru 0x03dbea (0x7fbd bytes) 000862 1789449403.043808 MIRROR_EXTEND to 2 mirrors 000863 1789449404.057599 write 0x0266a8 thru 0x02a73e (0x4097 bytes) 000864 1789449404.181053 write 0x03eac1 thru 0x03ffff (0x153f bytes) 000865 1789449404.182830 write 0x038b4f thru 0x03ffff (0x74b1 bytes) 000866 1789449404.191151 punch from 0x02ce5b to 0x02e270 (0x1416 bytes) 000867 1789449404.206850 trunc from 0x040000 to 0x02a6c8 (0x15937 bytes) 000868 1789449404.229928 mapwrite 0x03fab4 thru 0x03ffff (0x54c bytes) 000871 1789449404.319558 mapread 0x012ead thru 0x019bd7 (0x6d2b bytes) 000872 1789449404.352965 write 0x03dce4 thru 0x03ffff (0x231c bytes) 000873 1789449404.360078 mapread 0x00414d thru 0x00cf36 (0x8dea bytes) 000874 1789449404.372162 punch from 0x014a51 to 0x019959 (0x4f09 bytes) 000875 1789449404.383026 mapwrite 0x0008bd thru 0x00bc1d (0xb361 bytes) 000876 1789449404.442784 read 0x00f70b thru 0x0193a5 (0x9c9b bytes) 000877 1789449404.454674 write 0x005ef0 thru 0x00f578 (0x9689 bytes) 000878 1789449404.457194 trunc from 0x040000 to 0x03b076 (0x4f89 bytes) 000879 1789449404.481901 trunc from 0x03b077 to 0x0373f5 (0x3c81 bytes) 000881 1789449404.516018 write 0x03293b thru 0x039e7d (0x7543 bytes) 000882 1789449404.528125 MIRROR_RESYNC 2 mirrors 000883 1789449405.495650 trunc from 0x039e7e to 0x00fb84 (0x2a2f9 bytes) 000884 1789449405.613474 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xfb85): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfb85): Mirror 2: 0x5c6c92f3 (stale) CRC-32 checksum value for chunk [0, 0xfb85): Mirror 1: 0x5c6c92f3 Mirror 3: 0x5c6c92f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfb85: skipped 000885 1789449406.767771 trunc from 0x00fb85 to 0x01108b (0x1507 bytes) 000887 1789449406.878574 mapread 0x00f535 thru 0x01108b (0x1b57 bytes) 000888 1789449406.921445 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1108c): Mirror 3: 0x11fff7c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1108c): Mirror 3: 0x11fff7c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1108c: skipped 000889 1789449407.451606 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1108c): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1108c): Mirror 3: 0x11fff7c7 (stale) CRC-32 checksum value for chunk [0, 0x1108c): Mirror 1: 0x11fff7c7 Mirror 4: 0x11fff7c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1108c: skipped 000891 1789449409.025047 mapread 0x00f55f thru 0x01108b (0x1b2d bytes) 000892 1789449409.056766 write 0x003743 thru 0x00bd22 (0x85e0 bytes) 000894 1789449409.284614 mapwrite 0x02181e thru 0x02ab70 (0x9353 bytes) 000896 1789449409.528164 mapwrite 0x00dc7b thru 0x010e38 (0x31be bytes) 000898 1789449409.655791 read 0x01b7c0 thru 0x02500a (0x984b bytes) 000900 1789449409.679977 MIRROR_RESYNC 3 mirrors 000901 1789449410.958289 MIRROR_EXTEND to 4 mirrors 000902 1789449411.992526 mapwrite 0x014672 thru 0x01a79a (0x6129 bytes) 000904 1789449412.278350 trunc from 0x02ab71 to 0x011b32 (0x1903e bytes) 000905 1789449412.319576 mapwrite 0x025f9a thru 0x02adb5 (0x4e1c bytes) 000907 1789449412.423450 mapwrite 0x026cd9 thru 0x035009 (0xe331 bytes) 000909 1789449412.519846 mapread 0x02b95f thru 0x035009 (0x96ab bytes) 000910 1789449412.520847 mapread 0x0060eb thru 0x013528 (0xd43e bytes) 000911 1789449412.541513 mapwrite 0x00923e thru 0x012711 (0x94d4 bytes) 000912 1789449412.595987 punch from 0x00772d to 0x00ea98 (0x736c bytes) 000915 1789449412.603096 mapread 0x004a3a thru 0x012b91 (0xe158 bytes) 000916 1789449412.622583 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3500a): Mirror 4: 0x1534bca8 (stale) Mirror 5: 0x1534bca8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3500a): Mirror 4: 0x1534bca8 (stale) Mirror 5: 0x1534bca8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3500a: skipped 000917 1789449413.046576 mapread 0x007709 thru 0x007a3a (0x332 bytes) 000918 1789449413.057644 MIRROR_RESYNC 3 mirrors 000919 1789449414.292171 punch from 0x01deb1 to 0x028507 (0xa657 bytes) 000920 1789449414.392377 read 0x003a66 thru 0x00b27b (0x7816 bytes) 000921 1789449414.406150 trunc from 0x03500a to 0x013743 (0x218c6 bytes) 000923 1789449414.434768 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x13744): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13744): Mirror 4: 0x79fb6729 (stale) Mirror 5: 0x79fb6729 (stale) CRC-32 checksum value for chunk [0, 0x13744): Mirror 1: 0x79fb6729 Mirror 6: 0x79fb6729 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13744: skipped 000924 1789449415.496397 mapread 0x00c613 thru 0x013743 (0x7131 bytes) 000926 1789449415.548428 trunc from 0x013744 to 0x025fd6 (0x12893 bytes) 000927 1789449415.844728 MIRROR_RESYNC 4 mirrors 000928 1789449417.382709 trunc from 0x025fd7 to 0x01a5ed (0xb9e9 bytes) 000929 1789449417.518224 mapwrite 0x0017ee thru 0x00c215 (0xaa28 bytes) 000930 1789449417.733795 mapwrite 0x02cea3 thru 0x0331e0 (0x633e bytes) 000931 1789449418.000612 write 0x0226c6 thru 0x025519 (0x2e54 bytes) 000932 1789449418.013657 mapread 0x02a296 thru 0x02ea08 (0x4773 bytes) 000933 1789449418.014702 trunc from 0x0331e1 to 0x01b643 (0x17b9d bytes) 000934 1789449418.050881 write 0x019981 thru 0x01d5bd (0x3c3d bytes) 000936 1789449418.061479 read 0x00212a thru 0x010924 (0xe7fb bytes) 000937 1789449418.062657 trunc from 0x01d5be to 0x01a614 (0x2fa9 bytes) 000938 1789449418.092714 mapread 0x019161 thru 0x01a614 (0x14b4 bytes) 000939 1789449418.101004 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a615): Mirror 4: 0xc4b70170 (stale) Mirror 5: 0xc4b70170 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a615): Mirror 4: 0xc4b70170 (stale) Mirror 5: 0xc4b70170 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a615: skipped 000940 1789449418.570648 mapread 0x00143f thru 0x00ce8d (0xba4f bytes) 000941 1789449418.607588 mapwrite 0x00bac2 thru 0x018bea (0xd129 bytes) 000943 1789449418.779281 punch from 0x014d30 to 0x01a614 (0x58e5 bytes) 000944 1789449418.799046 MIRROR_RESYNC 3 mirrors 000945 1789449419.758598 mapwrite 0x0053f9 thru 0x015078 (0xfc80 bytes) 000946 1789449419.981126 punch from 0x013270 to 0x01a614 (0x73a5 bytes) 000952 1789449419.996379 write 0x03833b thru 0x03ffff (0x7cc5 bytes) 000955 1789449420.001472 mapread 0x029cd9 thru 0x031b1c (0x7e44 bytes) 000956 1789449420.011631 punch from 0x00046c to 0x001a44 (0x15d9 bytes) 000957 1789449420.030411 punch from 0x00c6a7 to 0x00f49c (0x2df6 bytes) 000958 1789449420.035658 write 0x020495 thru 0x0239d2 (0x353e bytes) 000960 1789449420.046584 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x14b688fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x14b688fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000961 1789449420.481683 mapwrite 0x02c723 thru 0x0356ff (0x8fdd bytes) 000962 1789449420.556207 mapwrite 0x00f84d thru 0x017f12 (0x86c6 bytes) 000963 1789449420.622190 mapwrite 0x01d271 thru 0x024d55 (0x7ae5 bytes) 000964 1789449420.677192 read 0x01e66f thru 0x028b04 (0xa496 bytes) 000966 1789449420.683112 mapread 0x00f760 thru 0x01b31c (0xbbbd bytes) 000967 1789449420.684097 mapread 0x017f82 thru 0x01b2a2 (0x3321 bytes) 000968 1789449420.685824 write 0x005be3 thru 0x006848 (0xc66 bytes) 000969 1789449420.695702 trunc from 0x040000 to 0x037ea1 (0x815e bytes) 000972 1789449420.717414 mapread 0x015995 thru 0x019431 (0x3a9d bytes) 000973 1789449420.718441 mapwrite 0x0285ff thru 0x03253a (0x9f3c bytes) 000974 1789449420.795440 mapread 0x00e929 thru 0x018abd (0xa195 bytes) 000975 1789449420.797630 trunc from 0x037ea2 to 0x03c42f (0x458e bytes) 000977 1789449420.861658 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14a:0x0]: Invalid argument (22) 000978 1789449421.111545 punch from 0x01cdaa to 0x024cfd (0x7f54 bytes) 000979 1789449421.129022 MIRROR_EXTEND to 2 mirrors 000981 1789449422.047414 trunc from 0x03c430 to 0x01610b (0x26324 bytes) 000983 1789449422.180549 read 0x005a15 thru 0x00a3bf (0x49ab bytes) 000984 1789449422.193303 trunc from 0x01610c to 0x002cd7 (0x13434 bytes) 000985 1789449422.226571 read 0x000e1b thru 0x002cd7 (0x1ebd bytes) 000986 1789449422.239453 trunc from 0x002cd8 to 0x025588 (0x228b1 bytes) 000987 1789449422.265941 punch from 0x013d95 to 0x0200f5 (0xc361 bytes) 000989 1789449422.273689 write 0x02e20a thru 0x037e76 (0x9c6d bytes) 000991 1789449422.275607 mapwrite 0x01c60f thru 0x025424 (0x8e16 bytes) 000993 1789449422.421804 write 0x03bfe1 thru 0x03f503 (0x3523 bytes) 000994 1789449422.422854 punch from 0x0146ce to 0x022053 (0xd986 bytes) 000995 1789449422.446216 mapwrite 0x003128 thru 0x00adfc (0x7cd5 bytes) 000996 1789449422.542157 read 0x00e8b0 thru 0x01e39c (0xfaed bytes) 000997 1789449422.556266 punch from 0x01ddfb to 0x01df4f (0x155 bytes) 000998 1789449422.569519 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f504): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f504): Mirror 2: 0x3d8b6066 (stale) CRC-32 checksum value for chunk [0, 0x3f504): Mirror 1: 0x826cce47 Mirror 3: 0x826cce47 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f504: skipped 000999 1789449423.925330 punch from 0x037196 to 0x03f503 (0x836e bytes) 001000 1789449424.060871 punch from 0x0286bb to 0x0323f1 (0x9d37 bytes) All operations completed A-OK!