== sanity-flr test 70a: flr mode fsx test ================ 16:54:14 (1788814454) Seed set to 4455 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1788814456.044438 mapwrite 0x010e54 thru 0x016af3 (0x5ca0 bytes) 000004 1788814456.115963 write 0x032925 thru 0x03ffff (0xd6db bytes) 000005 1788814456.118086 read 0x02dbbb thru 0x0326e6 (0x4b2c bytes) truncating to largest ever: 0x246e2 000006 1788814456.124213 trunc from 0x040000 to 0x0246e1 (0x1b91e bytes) 000008 1788814456.140105 mapread 0x018250 thru 0x01b1f4 (0x2fa5 bytes) 000009 1788814456.149239 mapread 0x001143 thru 0x003e67 (0x2d25 bytes) 000010 1788814456.158433 trunc from 0x0246e2 to 0x011079 (0x13668 bytes) 000011 1788814456.173945 punch from 0x00dba7 to 0x011079 (0x34d3 bytes) 000013 1788814456.178430 mapread 0x00a4b0 thru 0x011079 (0x6bca bytes) 000016 1788814456.189470 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x2778a 000017 1788814456.916914 trunc from 0x01107a to 0x027789 (0x16710 bytes) 000018 1788814457.022486 mapwrite 0x01f6bc thru 0x025fdf (0x6924 bytes) 000019 1788814457.109184 write 0x016d4b thru 0x0227c8 (0xba7e bytes) 000021 1788814457.115906 mapwrite 0x005b68 thru 0x00937c (0x3815 bytes) 000023 1788814457.159010 write 0x037a94 thru 0x03ffff (0x856c bytes) 000027 1788814457.163790 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdada4c57 Mirror 3: 0xdada4c57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000028 1788814458.234578 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdada4c57 Mirror 3: 0xdada4c57 Mirror 4: 0xdada4c57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000032 1788814458.969870 MIRROR_SPLIT mirror 3 to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdada4c57 Mirror 3: 0xdada4c57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000033 1788814459.251097 write 0x00c7f9 thru 0x01903c (0xc844 bytes) 000034 1788814459.344360 punch from 0x00a9f5 to 0x01433c (0x9948 bytes) 000035 1788814459.356526 read 0x02b080 thru 0x032cb8 (0x7c39 bytes) 000036 1788814459.363304 mapwrite 0x0113bf thru 0x01c388 (0xafca bytes) 000037 1788814459.434904 write 0x03279f thru 0x03ae38 (0x869a bytes) 000038 1788814459.443028 mapread 0x026f29 thru 0x031ea9 (0xaf81 bytes) 000039 1788814459.452512 read 0x0090f8 thru 0x018780 (0xf689 bytes) 000041 1788814459.462874 write 0x015662 thru 0x02298f (0xd32e bytes) 000042 1788814459.468232 MIRROR_SPLIT mirror 1 to 2 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdada4c57 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdada4c57 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000044 1788814459.680415 write 0x028ced thru 0x029e37 (0x114b bytes) truncating to largest ever: 0x2f0c6 000045 1788814459.690099 trunc from 0x040000 to 0x02f0c5 (0x10f3a bytes) truncating to largest ever: 0x33dd4 000046 1788814459.715054 trunc from 0x02f0c6 to 0x033dd3 (0x4d0e bytes) 000049 1788814459.739525 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 3: 0x940ea26a (stale) CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 1: 0x48ce994d Mirror 4: 0x48ce994d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33dd4: skipped 000051 1788814460.555620 write 0x032047 thru 0x03246a (0x424 bytes) 000052 1788814460.640769 MIRROR_SPLIT mirror 2 to 2 mirrors CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 3: 0x940ea26a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 3: 0x940ea26a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33dd4: skipped 000054 1788814460.884560 trunc from 0x033dd4 to 0x0279a4 (0xc42f bytes) 000055 1788814460.901931 write 0x03f374 thru 0x03ffff (0xc8c bytes) 000056 1788814460.903337 punch from 0x02e2d5 to 0x02ec61 (0x98d bytes) 000057 1788814460.910645 mapwrite 0x02f9b3 thru 0x0319ca (0x2018 bytes) 000058 1788814460.958712 write 0x0152f8 thru 0x01a327 (0x5030 bytes) 000059 1788814460.967950 read 0x02584f thru 0x02e8f1 (0x90a3 bytes) 000060 1788814460.976349 read 0x032837 thru 0x034942 (0x210c bytes) 000061 1788814460.981004 MIRROR_RESYNC 2 mirrors 000062 1788814461.591192 punch from 0x029859 to 0x030503 (0x6cab bytes) 000064 1788814461.666159 mapread 0x02f5cf thru 0x03970f (0xa141 bytes) 000065 1788814461.682043 read 0x03b87e thru 0x03e67f (0x2e02 bytes) 000067 1788814461.694493 trunc from 0x040000 to 0x00fc15 (0x303ea bytes) 000070 1788814461.719302 mapread 0x002ca6 thru 0x004e6e (0x21c9 bytes) 000074 1788814461.737441 read 0x00d685 thru 0x00fc15 (0x2591 bytes) 000075 1788814461.739073 punch from 0x009c17 to 0x00bdf5 (0x21df bytes) 000076 1788814461.748375 trunc from 0x00fc16 to 0x02ad87 (0x1b172 bytes) 000077 1788814461.768790 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2ad88): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ad88): Mirror 3: 0xfc3c0ee4 (stale) CRC-32 checksum value for chunk [0, 0x2ad88): Mirror 1: 0xe4d88a48 Mirror 4: 0xe4d88a48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ad88: skipped 000078 1788814462.686010 mapread 0x018a0c thru 0x01e260 (0x5855 bytes) 000079 1788814462.723438 trunc from 0x02ad88 to 0x01f31c (0xba6b bytes) 000080 1788814462.825884 write 0x0397c7 thru 0x03c75f (0x2f99 bytes) 000081 1788814462.827714 punch from 0x006aa1 to 0x011a27 (0xaf87 bytes) 000082 1788814462.838556 write 0x0069bb thru 0x01234f (0xb995 bytes) 000083 1788814462.848519 mapwrite 0x00f035 thru 0x018fec (0x9fb8 bytes) 000087 1788814462.904808 mapwrite 0x03398c thru 0x033b61 (0x1d6 bytes) 000092 1788814462.966439 MIRROR_RESYNC 3 mirrors 000093 1788814463.858126 trunc from 0x03c760 to 0x029d57 (0x12a08 bytes) 000094 1788814463.950245 mapread 0x019188 thru 0x024faa (0xbe23 bytes) 000095 1788814463.982060 trunc from 0x029d58 to 0x01741b (0x1293c bytes) 000096 1788814464.004384 read 0x0026e7 thru 0x0036e0 (0xffa bytes) 000097 1788814464.011500 punch from 0x007706 to 0x008e5b (0x1756 bytes) 000098 1788814464.018110 punch from 0x00fa77 to 0x01741b (0x79a5 bytes) 000099 1788814464.036102 mapwrite 0x03afd3 thru 0x03ffff (0x502d bytes) 000100 1788814464.182625 read 0x01767f thru 0x0206b1 (0x9033 bytes) 000101 1788814464.201636 write 0x01e032 thru 0x02326c (0x523b bytes) 000102 1788814464.211113 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x10388d99 (stale) Mirror 4: 0x10388d99 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xebf82376 Mirror 5: 0xebf82376 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000103 1788814465.743839 MIRROR_RESYNC 4 mirrors 000104 1788814467.262750 mapread 0x03db36 thru 0x03ffff (0x24ca bytes) 000105 1788814467.278484 read 0x03c3c8 thru 0x03fd28 (0x3961 bytes) 000106 1788814467.279076 punch from 0x00bca6 to 0x018adc (0xce37 bytes) 000107 1788814467.345289 punch from 0x031a02 to 0x03890d (0x6f0c bytes) 000109 1788814467.350402 punch from 0x03c9e5 to 0x03d65c (0xc78 bytes) 000110 1788814467.355406 mapread 0x039f0e thru 0x03ffff (0x60f2 bytes) 000111 1788814467.363689 mapread 0x01822b thru 0x01ab58 (0x292e bytes) 000113 1788814467.370927 trunc from 0x040000 to 0x02850b (0x17af4 bytes) 000114 1788814467.388287 mapread 0x026e2e thru 0x02850b (0x16de bytes) 000118 1788814467.403904 write 0x019952 thru 0x01f396 (0x5a45 bytes) 000120 1788814467.407312 read 0x01aa9d thru 0x0271ce (0xc732 bytes) 000123 1788814467.411236 mapwrite 0x03f1f0 thru 0x03ffff (0xe10 bytes) 000124 1788814467.526004 write 0x01030b thru 0x014ec8 (0x4bbe bytes) 000125 1788814467.527848 write 0x03fdcf thru 0x03ffff (0x231 bytes) 000126 1788814467.530449 mapread 0x0299b6 thru 0x02d594 (0x3bdf bytes) 000127 1788814467.543388 MIRROR_RESYNC 4 mirrors 000128 1788814468.692222 read 0x02c33a thru 0x02eb52 (0x2819 bytes) 000130 1788814468.697338 mapread 0x0081f8 thru 0x014026 (0xbe2f bytes) truncating to largest ever: 0x34457 000132 1788814468.727815 trunc from 0x040000 to 0x034456 (0xbba9 bytes) 000133 1788814468.815307 write 0x002c3d thru 0x012806 (0xfbca bytes) 000135 1788814468.825373 trunc from 0x034457 to 0x00cdde (0x27678 bytes) 000137 1788814468.849045 trunc from 0x00cddf to 0x02e0c2 (0x212e4 bytes) truncating to largest ever: 0x3d2cb 000138 1788814468.866482 trunc from 0x02e0c3 to 0x03d2ca (0xf208 bytes) 000139 1788814468.884358 MIRROR_SPLIT mirror 1 to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d2cb): Mirror 4: 0x13b2a70f (stale) Mirror 5: 0x13b2a70f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2cb): Mirror 4: 0x13b2a70f (stale) Mirror 5: 0x13b2a70f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2cb: skipped 000142 1788814469.229971 mapwrite 0x0101c5 thru 0x01a168 (0x9fa4 bytes) 000143 1788814469.293107 trunc from 0x03d2cb to 0x0109af (0x2c91b bytes) 000144 1788814469.307933 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x109b0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x109b0): Mirror 4: 0x1242c6c0 (stale) Mirror 5: 0x1242c6c0 (stale) CRC-32 checksum value for chunk [0, 0x109b0): Mirror 1: 0xa20ca7a6 Mirror 6: 0xa20ca7a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x109b0: skipped 000145 1788814470.108679 mapread 0x00d5a1 thru 0x0109af (0x340f bytes) 000146 1788814470.129532 trunc from 0x0109b0 to 0x026481 (0x15ad2 bytes) 000147 1788814470.215337 mapwrite 0x014e3b thru 0x020496 (0xb65c bytes) 000149 1788814470.295297 write 0x0302ca thru 0x03cadf (0xc816 bytes) 000150 1788814470.297308 mapread 0x0253ef thru 0x03212f (0xcd41 bytes) 000151 1788814470.327593 MIRROR_SPLIT mirror 3 to 3 mirrors CRC-32 checksum value for chunk [0, 0x3cae0): Mirror 4: 0xca088fa6 (stale) Mirror 5: 0xca088fa6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cae0): Mirror 4: 0xca088fa6 (stale) Mirror 5: 0xca088fa6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cae0: skipped 000152 1788814470.567543 mapwrite 0x03fce1 thru 0x03ffff (0x31f bytes) 000154 1788814470.632951 mapwrite 0x02a2bf thru 0x035fba (0xbcfc bytes) 000155 1788814470.699912 read 0x005269 thru 0x00afb7 (0x5d4f bytes) 000156 1788814470.717052 MIRROR_RESYNC 3 mirrors 000157 1788814471.468178 punch from 0x000045 to 0x000dd6 (0xd92 bytes) 000158 1788814471.540802 MIRROR_RESYNC 3 mirrors 000159 1788814472.487941 write 0x01aeec thru 0x01f68d (0x47a2 bytes) 000162 1788814472.613703 mapwrite 0x00187c thru 0x002f26 (0x16ab bytes) 000165 1788814472.658781 mapwrite 0x005dbe thru 0x00d692 (0x78d5 bytes) 000166 1788814472.700850 write 0x03cabb thru 0x03ffff (0x3545 bytes) 000167 1788814472.705825 trunc from 0x040000 to 0x01afdc (0x25023 bytes) 000169 1788814472.726272 punch from 0x000331 to 0x0049a3 (0x4673 bytes) 000170 1788814472.731305 mapwrite 0x00156e thru 0x00e8cb (0xd35e bytes) 000171 1788814472.780052 read 0x010c2f thru 0x0150e4 (0x44b6 bytes) 000174 1788814472.789005 mapread 0x01254b thru 0x01afdc (0x8a92 bytes) 000175 1788814472.793352 mapread 0x0016c9 thru 0x005cdc (0x4614 bytes) 000177 1788814472.794429 mapread 0x00f0e3 thru 0x015eb2 (0x6dd0 bytes) 000179 1788814472.795772 mapread 0x0066ad thru 0x013d2c (0xd680 bytes) 000181 1788814472.797939 mapread 0x00901d thru 0x009d67 (0xd4b bytes) 000182 1788814472.798837 punch from 0x01524c to 0x01afdc (0x5d91 bytes) 000183 1788814472.804032 mapread 0x00cbdf thru 0x0156ca (0x8aec bytes) 000184 1788814472.815875 MIRROR_SPLIT mirror 2 to 2 mirrors CRC-32 checksum value for chunk [0, 0x1afdd): Mirror 4: 0x34832cd5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1afdd): Mirror 4: 0x34832cd5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1afdd: skipped 000185 1788814473.135386 read 0x017e47 thru 0x01a7a6 (0x2960 bytes) 000186 1788814473.145459 read 0x0033aa thru 0x00c16e (0x8dc5 bytes) 000189 1788814473.155160 write 0x03819b thru 0x03ffff (0x7e65 bytes) 000190 1788814473.157330 write 0x026b1d thru 0x02c0d5 (0x55b9 bytes) 000191 1788814473.164604 punch from 0x00c4ff to 0x00ff85 (0x3a87 bytes) 000192 1788814473.174440 read 0x0373e8 thru 0x03ffff (0x8c18 bytes) 000193 1788814473.175244 trunc from 0x040000 to 0x033b05 (0xc4fa bytes) 000194 1788814473.189393 mapread 0x03356e thru 0x033b05 (0x598 bytes) 000195 1788814473.190310 read 0x01d50e thru 0x01e24a (0xd3d bytes) 000196 1788814473.190874 read 0x01859a thru 0x018733 (0x19a bytes) 000197 1788814473.191386 punch from 0x00383b to 0x0064e9 (0x2caf bytes) 000198 1788814473.195989 trunc from 0x033b06 to 0x026838 (0xd2cd bytes) 000200 1788814473.212099 read 0x020057 thru 0x023d01 (0x3cab bytes) 000201 1788814473.213089 mapread 0x0021d4 thru 0x002603 (0x430 bytes) 000203 1788814473.215696 mapwrite 0x008c41 thru 0x01208c (0x944c bytes) 000204 1788814473.268180 read 0x000b45 thru 0x004370 (0x382c bytes) 000205 1788814473.278733 MIRROR_RESYNC 2 mirrors 000206 1788814473.930102 mapwrite 0x0106dc thru 0x016de4 (0x6709 bytes) 000208 1788814474.049226 trunc from 0x026839 to 0x00ec46 (0x17bf2 bytes) 000209 1788814474.092188 trunc from 0x00ec47 to 0x01e3ea (0xf7a4 bytes) 000210 1788814474.111716 trunc from 0x01e3eb to 0x0343d7 (0x15fed bytes) 000211 1788814474.127871 mapread 0x015150 thru 0x01c49b (0x734c bytes) 000212 1788814474.134473 mapwrite 0x00d36e thru 0x016a80 (0x9713 bytes) 000213 1788814474.178830 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x343d8): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x343d8): Mirror 4: 0xebb6805e (stale) CRC-32 checksum value for chunk [0, 0x343d8): Mirror 1: 0x954febfb Mirror 5: 0x954febfb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x343d8: skipped 000214 1788814474.982267 read 0x02adda thru 0x0343d7 (0x95fe bytes) 000216 1788814475.001806 write 0x00da84 thru 0x00e629 (0xba6 bytes) 000217 1788814475.072987 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x343d8): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x343d8): Mirror 4: 0xebb6805e (stale) Mirror 5: 0x954febfb (stale) CRC-32 checksum value for chunk [0, 0x343d8): Mirror 1: 0x9e2a6f48 Mirror 6: 0x9e2a6f48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x343d8: skipped 000218 1788814475.948439 write 0x038bed thru 0x03de36 (0x524a bytes) 000219 1788814476.048749 MIRROR_SPLIT mirror 2 to 3 mirrors CRC-32 checksum value for chunk [0, 0x3de37): Mirror 4: 0xae1c6bfc (stale) Mirror 6: 0x99f9fb6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de37): Mirror 4: 0xae1c6bfc (stale) Mirror 6: 0x99f9fb6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de37: skipped 000220 1788814476.392205 MIRROR_RESYNC 3 mirrors 000221 1788814477.284028 punch from 0x016ea3 to 0x01efed (0x814b bytes) 000222 1788814477.351620 trunc from 0x03de37 to 0x0293a6 (0x14a90 bytes) 000223 1788814477.377267 mapwrite 0x0017cd thru 0x00f9dc (0xe210 bytes) 000224 1788814477.444454 punch from 0x01e7c3 to 0x023f66 (0x57a4 bytes) 000225 1788814477.450042 read 0x022538 thru 0x0293a6 (0x6e6f bytes) 000227 1788814477.470377 punch from 0x0268c7 to 0x027b22 (0x125c bytes) 000228 1788814477.480269 MIRROR_SPLIT mirror 2 to 2 mirrors CRC-32 checksum value for chunk [0, 0x293a7): Mirror 4: 0x79dad5d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x293a7): Mirror 4: 0x79dad5d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x293a7: skipped 000229 1788814477.781261 punch from 0x008199 to 0x00d6d1 (0x5539 bytes) 000230 1788814477.793469 read 0x01d87e thru 0x027c3a (0xa3bd bytes) 000231 1788814477.805156 trunc from 0x0293a7 to 0x00bded (0x1d5b9 bytes) truncating to largest ever: 0x3d405 000232 1788814477.836075 trunc from 0x00bdee to 0x03d404 (0x31617 bytes) 000233 1788814477.861181 mapread 0x02b02f thru 0x032b52 (0x7b24 bytes) 000234 1788814477.880728 write 0x026bf2 thru 0x02f1cb (0x85da bytes) 000235 1788814477.882023 write 0x03de8b thru 0x03ffff (0x2175 bytes) truncating to largest ever: 0x3da85 000236 1788814477.886310 trunc from 0x040000 to 0x03da84 (0x257b bytes) 000237 1788814477.905944 trunc from 0x03da85 to 0x000ca2 (0x3cde2 bytes) 000238 1788814477.933218 read 0x000632 thru 0x000ca2 (0x671 bytes) 000239 1788814477.945258 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xca3): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xca3): Mirror 4: 0x863b1054 (stale) CRC-32 checksum value for chunk [0, 0xca3): Mirror 1: 0x863b1054 Mirror 5: 0x863b1054 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xca3: skipped 000241 1788814478.640566 trunc from 0x000ca3 to 0x009c5f (0x8fbd bytes) 000243 1788814478.718127 write 0x01b43c thru 0x0282d9 (0xce9e bytes) 000245 1788814478.723950 read 0x007914 thru 0x0094df (0x1bcc bytes) 000246 1788814478.734997 MIRROR_RESYNC 3 mirrors 000247 1788814479.726885 punch from 0x00dae8 to 0x01cd98 (0xf2b1 bytes) 000249 1788814479.765176 write 0x001e39 thru 0x00fce0 (0xdea8 bytes) 000251 1788814479.783734 trunc from 0x0282da to 0x01ed53 (0x9586 bytes) 000252 1788814479.819281 mapread 0x00811d thru 0x011f38 (0x9e1c bytes) 000253 1788814479.830383 read 0x0001fe thru 0x003b62 (0x3965 bytes) 000258 1788814479.837573 read 0x01321c thru 0x017fd1 (0x4db6 bytes) 000259 1788814479.845755 trunc from 0x01ed54 to 0x035d7c (0x17029 bytes) 000260 1788814479.866454 mapwrite 0x03b84a thru 0x03ffff (0x47b6 bytes) 000261 1788814479.953877 read 0x03ca78 thru 0x03ffff (0x3588 bytes) 000263 1788814479.954916 write 0x02d2f9 thru 0x02d37b (0x83 bytes) 000265 1788814479.958342 read 0x02ab83 thru 0x035d67 (0xb1e5 bytes) 000266 1788814479.970445 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf4fde279 (stale) Mirror 5: 0xf4fde279 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x19a8bdcb Mirror 6: 0x19a8bdcb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000270 1788814481.127316 mapwrite 0x00908f thru 0x00c63b (0x35ad bytes) 000271 1788814481.361127 read 0x01bf80 thru 0x0227d3 (0x6854 bytes) 000272 1788814481.382098 mapwrite 0x01e0d7 thru 0x02a5ac (0xc4d6 bytes) 000273 1788814481.499556 write 0x00d828 thru 0x01a7f9 (0xcfd2 bytes) 000274 1788814481.507121 punch from 0x038abd to 0x03e751 (0x5c95 bytes) 000276 1788814481.524789 write 0x0207ac thru 0x02f697 (0xeeec bytes) 000278 1788814481.533121 mapread 0x0385e7 thru 0x03ffff (0x7a19 bytes) 000282 1788814481.555715 punch from 0x0229cc to 0x0310d9 (0xe70e bytes) 000283 1788814481.591049 write 0x02535e thru 0x028179 (0x2e1c bytes) 000285 1788814481.607755 write 0x0057a5 thru 0x014db8 (0xf614 bytes) 000286 1788814481.610775 mapwrite 0x01fb51 thru 0x02996d (0x9e1d bytes) 000290 1788814481.705996 trunc from 0x040000 to 0x030ed5 (0xf12a bytes) 000293 1788814481.725989 write 0x03e7a0 thru 0x03ffff (0x1860 bytes) 000294 1788814481.727339 mapwrite 0x00dc0a thru 0x010a44 (0x2e3b bytes) 000295 1788814481.763928 trunc from 0x040000 to 0x02d7f5 (0x1280a bytes) 000297 1788814481.796246 write 0x017489 thru 0x02528e (0xde06 bytes) 000299 1788814481.799481 trunc from 0x02d7f6 to 0x03092a (0x3135 bytes) 000300 1788814481.812903 mapread 0x0265ed thru 0x029472 (0x2e86 bytes) 000301 1788814481.815848 read 0x002124 thru 0x0029c8 (0x8a5 bytes) 000302 1788814481.832123 MIRROR_RESYNC 4 mirrors 000303 1788814482.635068 MIRROR_RESYNC 4 mirrors 000304 1788814482.953802 punch from 0x030033 to 0x030459 (0x427 bytes) 000305 1788814483.022629 punch from 0x0214ea to 0x02595e (0x4475 bytes) 000306 1788814483.029159 mapread 0x00f275 thru 0x01a77d (0xb509 bytes) 000307 1788814483.063463 trunc from 0x03092b to 0x01503c (0x1b8ee bytes) 000308 1788814483.088299 read 0x010472 thru 0x01503c (0x4bcb bytes) 000309 1788814483.088996 mapread 0x0119f9 thru 0x014c2c (0x3234 bytes) 000310 1788814483.091139 mapread 0x013fb5 thru 0x01503c (0x1088 bytes) 000311 1788814483.093323 punch from 0x003bb9 to 0x010568 (0xc9b0 bytes) 000312 1788814483.097992 read 0x00171f thru 0x003739 (0x201b bytes) 000315 1788814483.108892 mapwrite 0x0171a0 thru 0x01ae5b (0x3cbc bytes) 000316 1788814483.177881 read 0x00836a thru 0x00b972 (0x3609 bytes) 000317 1788814483.182897 MIRROR_RESYNC 4 mirrors 000318 1788814483.982932 trunc from 0x01ae5c to 0x00dd17 (0xd144 bytes) 000319 1788814484.049614 write 0x000277 thru 0x005953 (0x56dd bytes) 000320 1788814484.055322 read 0x00456c thru 0x00dd17 (0x97ac bytes) 000321 1788814484.066446 punch from 0x000ff5 to 0x0053e6 (0x43f2 bytes) 000322 1788814484.083889 punch from 0x000f21 to 0x00daa8 (0xcb88 bytes) 000326 1788814484.091540 mapwrite 0x034356 thru 0x03fb41 (0xb7ec bytes) 000329 1788814484.175188 punch from 0x00eb8b to 0x01bb84 (0xcffa bytes) 000332 1788814484.178985 mapwrite 0x0289f5 thru 0x032f86 (0xa592 bytes) 000333 1788814484.322478 mapread 0x018d6d thru 0x025a5c (0xccf0 bytes) 000335 1788814484.338608 trunc from 0x03fb42 to 0x00cdd2 (0x32d6f bytes) 000336 1788814484.360955 mapwrite 0x03fe62 thru 0x03ffff (0x19e bytes) 000338 1788814484.429607 read 0x03fe12 thru 0x03ffff (0x1ee bytes) 000339 1788814484.430694 mapwrite 0x0213b1 thru 0x02f12b (0xdd7b bytes) 000341 1788814484.528342 read 0x024e3e thru 0x032f67 (0xe12a bytes) 000343 1788814484.533127 read 0x03018c thru 0x03a648 (0xa4bd bytes) 000344 1788814484.538984 mapread 0x03bc55 thru 0x03ffff (0x43ab bytes) 000345 1788814484.540234 write 0x01bdd1 thru 0x0298ab (0xdadb bytes) 000348 1788814484.554178 read 0x026ea0 thru 0x035293 (0xe3f4 bytes) 000350 1788814484.555994 mapwrite 0x0395e5 thru 0x03ffff (0x6a1b bytes) 000351 1788814484.630193 mapread 0x01c8e3 thru 0x025550 (0x8c6e bytes) 000352 1788814484.633913 write 0x02cb2a thru 0x0330df (0x65b6 bytes) 000353 1788814484.636622 punch from 0x031535 to 0x03419b (0x2c67 bytes) 000356 1788814484.654805 mapwrite 0x03237b thru 0x03a6e5 (0x836b bytes) 000357 1788814484.725051 punch from 0x005710 to 0x010bca (0xb4bb bytes) 000358 1788814484.738298 MIRROR_RESYNC 4 mirrors 000359 1788814485.904122 mapread 0x01d4d1 thru 0x029474 (0xbfa4 bytes) 000360 1788814485.929037 punch from 0x031910 to 0x03aeff (0x95f0 bytes) 000361 1788814486.000973 punch from 0x020da7 to 0x02e74e (0xd9a8 bytes) 000362 1788814486.006609 write 0x037284 thru 0x03972e (0x24ab bytes) 000364 1788814486.021223 write 0x0258dc thru 0x033b4f (0xe274 bytes) 000365 1788814486.038963 punch from 0x007fa1 to 0x014a88 (0xcae8 bytes) 000367 1788814486.058893 write 0x01f704 thru 0x02ef1a (0xf817 bytes) 000368 1788814486.068520 trunc from 0x040000 to 0x030fdc (0xf023 bytes) 000369 1788814486.093180 read 0x0143ef thru 0x01bf16 (0x7b28 bytes) 000370 1788814486.131129 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x30fdd): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30fdd): Mirror 4: 0x473992d7 (stale) Mirror 5: 0x473992d7 (stale) Mirror 6: 0x473992d7 (stale) CRC-32 checksum value for chunk [0, 0x30fdd): Mirror 1: 0xe1ba6c7f Mirror 7: 0xe1ba6c7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30fdd: skipped 000371 1788814487.151385 trunc from 0x030fdd to 0x003701 (0x2d8db bytes) 000372 1788814487.334586 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3702): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3702): Mirror 4: 0x35095a9f (stale) Mirror 5: 0x35095a9f (stale) Mirror 6: 0x35095a9f (stale) Mirror 7: 0x35095a9f (stale) CRC-32 checksum value for chunk [0, 0x3702): Mirror 1: 0x35095a9f Mirror 8: 0x35095a9f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3702: skipped 000373 1788814488.157070 mapwrite 0x013c01 thru 0x016a3e (0x2e3e bytes) 000374 1788814488.348853 punch from 0x01052d to 0x016a3e (0x6512 bytes) 000375 1788814488.353116 mapread 0x0022bc thru 0x00a785 (0x84ca bytes) 000376 1788814488.363574 punch from 0x013d96 to 0x01579e (0x1a09 bytes) 000378 1788814488.368875 trunc from 0x016a3f to 0x03b4f1 (0x24ab3 bytes) 000380 1788814488.389084 mapwrite 0x03af1e thru 0x03ffff (0x50e2 bytes) 000381 1788814488.442252 trunc from 0x040000 to 0x03276f (0xd890 bytes) 000382 1788814488.453771 write 0x004dd9 thru 0x01188e (0xcab6 bytes) 000383 1788814488.459061 mapread 0x0282c4 thru 0x02ac2c (0x2969 bytes) 000384 1788814488.471389 mapwrite 0x02d61d thru 0x03904e (0xba32 bytes) 000385 1788814488.547183 MIRROR_SPLIT mirror 1 to 5 mirrors CRC-32 checksum value for chunk [0, 0x3904f): Mirror 5: 0x5d485d4e (stale) Mirror 6: 0x5d485d4e (stale) Mirror 7: 0xfc025489 (stale) Mirror 8: 0x78780fee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3904f): Mirror 5: 0x5d485d4e (stale) Mirror 6: 0x5d485d4e (stale) Mirror 7: 0xfc025489 (stale) Mirror 8: 0x78780fee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3904f: skipped 000386 1788814488.798607 punch from 0x01110f to 0x01d1d0 (0xc0c2 bytes) 000387 1788814488.804868 mapwrite 0x0089b0 thru 0x00b18c (0x27dd bytes) 000389 1788814488.879754 punch from 0x01cbab to 0x01fa4d (0x2ea3 bytes) 000390 1788814488.894260 MIRROR_SPLIT mirror 3 to 4 mirrors CRC-32 checksum value for chunk [0, 0x3904f): Mirror 5: 0x5d485d4e (stale) Mirror 6: 0x5d485d4e (stale) Mirror 8: 0x78780fee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3904f): Mirror 5: 0x5d485d4e (stale) Mirror 6: 0x5d485d4e (stale) Mirror 8: 0x78780fee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3904f: skipped 000392 1788814489.148105 write 0x007dec thru 0x01375e (0xb973 bytes) 000393 1788814489.162354 MIRROR_RESYNC 4 mirrors 000394 1788814490.163528 mapwrite 0x03bba3 thru 0x03ffff (0x445d bytes) 000395 1788814490.328106 mapread 0x035295 thru 0x03fac1 (0xa82d bytes) 000397 1788814490.339440 mapwrite 0x01fe15 thru 0x0294ee (0x96da bytes) 000398 1788814490.403845 trunc from 0x040000 to 0x03596b (0xa694 bytes) 000399 1788814490.421941 mapread 0x01b26b thru 0x024a94 (0x982a bytes) 000400 1788814490.423171 mapread 0x02459e thru 0x031470 (0xced3 bytes) 000403 1788814490.426123 read 0x00f241 thru 0x01b098 (0xbe58 bytes) 000405 1788814490.437548 punch from 0x000938 to 0x00233c (0x1a05 bytes) 000406 1788814490.441809 read 0x01da99 thru 0x02583f (0x7da7 bytes) 000407 1788814490.442597 punch from 0x01031e to 0x01d3a9 (0xd08c bytes) 000409 1788814490.450613 MIRROR_SPLIT mirror 1 to 3 mirrors CRC-32 checksum value for chunk [0, 0x3596c): Mirror 6: 0x9c4a3620 (stale) Mirror 8: 0x9c4a3620 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3596c): Mirror 6: 0x9c4a3620 (stale) Mirror 8: 0x9c4a3620 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3596c: skipped 000410 1788814490.681939 trunc from 0x03596c to 0x0163dc (0x1f58f bytes) 000412 1788814490.693583 punch from 0x013aed to 0x0163dc (0x28f0 bytes) 000414 1788814490.696595 write 0x03b0b5 thru 0x03f502 (0x444e bytes) 000417 1788814490.698072 mapwrite 0x0291dd thru 0x033f63 (0xad87 bytes) 000418 1788814490.756672 write 0x02a386 thru 0x0349a2 (0xa61d bytes) 000419 1788814490.762078 mapwrite 0x01cacc thru 0x01e367 (0x189c bytes) 000420 1788814490.823129 trunc from 0x03f503 to 0x021a98 (0x1da6a bytes) 000423 1788814490.841198 mapread 0x0138e9 thru 0x01eea6 (0xb5be bytes) 000424 1788814490.851023 write 0x029c78 thru 0x02cf17 (0x32a0 bytes) 000426 1788814490.852595 mapwrite 0x03407f thru 0x03a2e4 (0x6266 bytes) 000427 1788814490.921038 read 0x0311b6 thru 0x03a2e4 (0x912f bytes) 000429 1788814490.923734 read 0x0158dd thru 0x019885 (0x3fa9 bytes) 000430 1788814490.924566 write 0x00ccd3 thru 0x012f26 (0x6254 bytes) 000431 1788814490.926130 mapread 0x019df2 thru 0x01e126 (0x4335 bytes) 000432 1788814490.927472 punch from 0x02b5da to 0x02e7ce (0x31f5 bytes) 000434 1788814490.940457 trunc from 0x03a2e5 to 0x00947e (0x30e66 bytes) 000435 1788814490.958398 MIRROR_SPLIT mirror 1 to 2 mirrors CRC-32 checksum value for chunk [0, 0x947f): Mirror 8: 0xd7460db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x947f): Mirror 8: 0xd7460db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x947f: skipped 000437 1788814491.259924 write 0x036b2b thru 0x03ffff (0x94d5 bytes) 000438 1788814491.264369 mapread 0x0363c2 thru 0x03849c (0x20db bytes) 000439 1788814491.265746 mapread 0x00ab26 thru 0x00b4a6 (0x981 bytes) 000440 1788814491.281390 MIRROR_RESYNC 2 mirrors 000441 1788814492.146711 trunc from 0x040000 to 0x0326af (0xd950 bytes) 000442 1788814492.265350 write 0x023df8 thru 0x02aec3 (0x70cc bytes) 000444 1788814492.276015 read 0x02b0bc thru 0x02feb7 (0x4dfc bytes) 000445 1788814492.288107 mapwrite 0x02c43a thru 0x03887a (0xc441 bytes) 000446 1788814492.380010 write 0x017263 thru 0x026fa5 (0xfd43 bytes) 000447 1788814492.387553 read 0x0014e8 thru 0x00377b (0x2294 bytes) 000448 1788814492.401149 punch from 0x0351fa to 0x035630 (0x437 bytes) 000449 1788814492.417960 punch from 0x01eb12 to 0x02292d (0x3e1c bytes) 000450 1788814492.423488 mapread 0x0332c2 thru 0x03439c (0x10db bytes) 000451 1788814492.425283 mapwrite 0x03c99f thru 0x03ce31 (0x493 bytes) 000452 1788814492.500091 mapwrite 0x03e266 thru 0x03ffff (0x1d9a bytes) 000453 1788814492.577698 MIRROR_RESYNC 2 mirrors 000454 1788814493.070220 trunc from 0x040000 to 0x011ca9 (0x2e356 bytes) 000455 1788814493.221509 write 0x032f40 thru 0x03ffff (0xd0c0 bytes) truncating to largest ever: 0x3de0f 000456 1788814493.223073 trunc from 0x040000 to 0x03de0e (0x21f1 bytes) 000457 1788814493.279592 write 0x000829 thru 0x00373c (0x2f14 bytes) 000459 1788814493.299904 read 0x02042c thru 0x025b1f (0x56f4 bytes) 000460 1788814493.316000 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3de0f): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de0f): Mirror 8: 0x63153615 (stale) CRC-32 checksum value for chunk [0, 0x3de0f): Mirror 1: 0xd5499c9e Mirror 9: 0xd5499c9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de0f: skipped 000461 1788814494.230245 trunc from 0x03de0f to 0x01b52f (0x228df bytes) 000462 1788814494.395343 MIRROR_RESYNC 3 mirrors 000463 1788814495.378102 trunc from 0x01b530 to 0x026bef (0xb6c0 bytes) 000464 1788814495.495341 punch from 0x01da04 to 0x026bef (0x91ec bytes) 000467 1788814495.502386 mapwrite 0x0126c6 thru 0x0185b3 (0x5eee bytes) 000469 1788814495.563633 trunc from 0x026bf0 to 0x005aeb (0x21104 bytes) 000470 1788814495.586415 write 0x0245ec thru 0x0312ac (0xccc1 bytes) 000472 1788814495.589635 mapread 0x021c21 thru 0x025f2b (0x430b bytes) 000473 1788814495.595804 write 0x00e0a0 thru 0x01b940 (0xd8a1 bytes) 000474 1788814495.599799 mapwrite 0x010a22 thru 0x0139f0 (0x2fcf bytes) 000476 1788814495.671930 read 0x02e088 thru 0x030d5e (0x2cd7 bytes) 000478 1788814495.673185 write 0x026f44 thru 0x02ea7a (0x7b37 bytes) 000479 1788814495.674254 read 0x02d55c thru 0x031079 (0x3b1e bytes) 000480 1788814495.676097 mapread 0x0231c0 thru 0x027f48 (0x4d89 bytes) 000481 1788814495.677203 read 0x00de85 thru 0x0113b9 (0x3535 bytes) 000482 1788814495.694995 mapread 0x0237c2 thru 0x02d477 (0x9cb6 bytes) 000486 1788814495.697438 read 0x00278f thru 0x0050ae (0x2920 bytes) 000487 1788814495.698362 mapread 0x00f234 thru 0x018fcf (0x9d9c bytes) 000488 1788814495.699709 trunc from 0x0312ad to 0x036f63 (0x5cb7 bytes) 000489 1788814495.715217 read 0x032ecc thru 0x036f63 (0x4098 bytes) 000490 1788814495.721420 punch from 0x029b74 to 0x035bc3 (0xc050 bytes) 000492 1788814495.736637 mapwrite 0x0041ff thru 0x00d036 (0x8e38 bytes) 000493 1788814495.813623 mapread 0x003919 thru 0x008be2 (0x52ca bytes) 000495 1788814495.814936 trunc from 0x036f64 to 0x01e781 (0x187e2 bytes) 000496 1788814495.842466 MIRROR_RESYNC 3 mirrors 000497 1788814496.686420 trunc from 0x01e782 to 0x0115f3 (0xd18e bytes) 000498 1788814496.775997 trunc from 0x0115f4 to 0x016565 (0x4f72 bytes) 000500 1788814496.797001 mapread 0x005c29 thru 0x01380f (0xdbe7 bytes) 000501 1788814496.816258 trunc from 0x016566 to 0x028b69 (0x12604 bytes) 000504 1788814496.836207 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x28b6a): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28b6a): Mirror 8: 0x776c222b (stale) Mirror 9: 0x776c222b (stale) CRC-32 checksum value for chunk [0, 0x28b6a): Mirror 1: 0xc078b6a3 Mirror 10: 0xc078b6a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28b6a: skipped 000505 1788814497.752673 read 0x013e49 thru 0x014675 (0x82d bytes) 000506 1788814497.758242 punch from 0x009407 to 0x01793e (0xe538 bytes) 000508 1788814497.848437 punch from 0x00df95 to 0x016e9f (0x8f0b bytes) 000509 1788814497.854326 read 0x018bca thru 0x0223b1 (0x97e8 bytes) 000510 1788814497.883107 read 0x00f24e thru 0x01d8e8 (0xe69b bytes) 000511 1788814497.884258 punch from 0x00912b to 0x017447 (0xe31d bytes) 000513 1788814497.889053 mapwrite 0x02d972 thru 0x03c956 (0xefe5 bytes) 000514 1788814498.026865 MIRROR_SPLIT mirror 1 to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c957): Mirror 9: 0x42ca2a6b (stale) Mirror 10: 0xea509f24 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c957): Mirror 9: 0x42ca2a6b (stale) Mirror 10: 0xea509f24 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c957: skipped 000515 1788814498.308106 trunc from 0x03c957 to 0x01b81b (0x2113b bytes) 000516 1788814498.327304 mapwrite 0x03f1be thru 0x03ffff (0xe42 bytes) 000517 1788814498.398024 write 0x01f26b thru 0x0280fd (0x8e93 bytes) 000518 1788814498.405708 mapread 0x00c35a thru 0x015735 (0x93dc bytes) 000519 1788814498.432924 write 0x0170f8 thru 0x019c7a (0x2b83 bytes) 000520 1788814498.447905 mapread 0x01eae6 thru 0x02bab1 (0xcfcc bytes) 000523 1788814498.475786 mapread 0x0300b1 thru 0x0379cd (0x791d bytes) 000524 1788814498.487922 write 0x03fbc0 thru 0x03ffff (0x440 bytes) 000525 1788814498.491273 punch from 0x006bc7 to 0x00f49f (0x88d9 bytes) 000526 1788814498.538124 MIRROR_RESYNC 3 mirrors 000528 1788814499.391216 punch from 0x02e709 to 0x0391fe (0xaaf6 bytes) 000530 1788814499.456180 mapread 0x0386a9 thru 0x03da5c (0x53b4 bytes) 000532 1788814499.480823 read 0x0363b8 thru 0x03ab72 (0x47bb bytes) 000534 1788814499.486353 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xec2beded (stale) Mirror 10: 0xec2beded (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xec2beded Mirror 11: 0xec2beded lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000535 1788814500.598789 punch from 0x0041a2 to 0x0135b6 (0xf415 bytes) 000536 1788814500.674856 mapread 0x003943 thru 0x0134cc (0xfb8a bytes) 000538 1788814500.702694 mapread 0x0052b8 thru 0x013efa (0xec43 bytes) 000540 1788814500.704615 punch from 0x00dca9 to 0x019259 (0xb5b1 bytes) 000542 1788814500.709310 mapread 0x01b000 thru 0x025ae3 (0xaae4 bytes) 000544 1788814500.732076 write 0x0285dc thru 0x02aadd (0x2502 bytes) 000545 1788814500.737696 mapwrite 0x00aad1 thru 0x00b720 (0xc50 bytes) 000546 1788814500.776050 trunc from 0x040000 to 0x014810 (0x2b7ef bytes) 000547 1788814500.809888 mapread 0x00609a thru 0x00bd0e (0x5c75 bytes) 000548 1788814500.815818 MIRROR_RESYNC 4 mirrors 000551 1788814501.555773 MIRROR_RESYNC 4 mirrors 000553 1788814501.839065 mapread 0x00c426 thru 0x00efb0 (0x2b8b bytes) 000555 1788814501.856689 write 0x01a553 thru 0x025f05 (0xb9b3 bytes) 000556 1788814501.924862 mapread 0x00e2b0 thru 0x0186ad (0xa3fe bytes) 000557 1788814501.944497 write 0x02e500 thru 0x030124 (0x1c25 bytes) 000558 1788814501.946194 mapwrite 0x003972 thru 0x011f6a (0xe5f9 bytes) 000559 1788814502.045471 mapwrite 0x036eb6 thru 0x03a4a5 (0x35f0 bytes) 000561 1788814502.209793 mapwrite 0x02d204 thru 0x0360e7 (0x8ee4 bytes) 000562 1788814502.299724 punch from 0x019652 to 0x0197c1 (0x170 bytes) 000563 1788814502.304027 trunc from 0x03a4a6 to 0x00eb34 (0x2b971 bytes) 000566 1788814502.342636 mapread 0x00380a thru 0x00accd (0x74c4 bytes) 000568 1788814502.344386 punch from 0x00d325 to 0x00eb34 (0x1810 bytes) 000569 1788814502.349524 read 0x001feb thru 0x00eb34 (0xcb4a bytes) 000570 1788814502.359003 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xeb35): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xeb35): Mirror 9: 0xfdfde3bc (stale) Mirror 10: 0xfdfde3bc (stale) Mirror 11: 0xfdfde3bc (stale) CRC-32 checksum value for chunk [0, 0xeb35): Mirror 1: 0x5dc94167 Mirror 12: 0x5dc94167 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xeb35: skipped 000571 1788814502.958622 mapread 0x006f22 thru 0x00eb34 (0x7c13 bytes) 000575 1788814502.990846 trunc from 0x00eb35 to 0x02b560 (0x1ca2c bytes) 000576 1788814503.086905 write 0x020b75 thru 0x0289a6 (0x7e32 bytes) 000577 1788814503.104257 read 0x018341 thru 0x0212e0 (0x8fa0 bytes) 000578 1788814503.114840 write 0x00bfbb thru 0x01a9c5 (0xea0b bytes) 000579 1788814503.119629 mapwrite 0x0384fe thru 0x03d6bc (0x51bf bytes) 000580 1788814503.201046 read 0x02abcd thru 0x02d0ac (0x24e0 bytes) 000581 1788814503.215009 read 0x021e4f thru 0x02e463 (0xc615 bytes) 000582 1788814503.215925 mapread 0x015e3f thru 0x0198c8 (0x3a8a bytes) 000583 1788814503.217320 punch from 0x02f2bf to 0x02f719 (0x45b bytes) 000585 1788814503.231601 mapwrite 0x00db65 thru 0x0143dd (0x6879 bytes) 000586 1788814503.300854 mapwrite 0x02ac6f thru 0x039313 (0xe6a5 bytes) 000587 1788814503.337488 read 0x0025d2 thru 0x00db83 (0xb5b2 bytes) 000588 1788814503.338045 mapwrite 0x01ee41 thru 0x02db4b (0xed0b bytes) 000592 1788814503.366935 punch from 0x024858 to 0x0335e3 (0xed8c bytes) 000593 1788814503.372346 MIRROR_RESYNC 5 mirrors 000595 1788814504.506570 trunc from 0x03d6bd to 0x029a44 (0x13c78 bytes) 000596 1788814504.553738 read 0x00041c thru 0x0044cf (0x40b4 bytes) 000597 1788814504.566536 trunc from 0x029a45 to 0x0168a1 (0x131a3 bytes) 000599 1788814504.596299 MIRROR_RESYNC 5 mirrors 000601 1788814505.637219 trunc from 0x0168a2 to 0x00d6e3 (0x91be bytes) 000604 1788814505.707927 read 0x002f69 thru 0x009e57 (0x6eef bytes) 000606 1788814505.721121 mapwrite 0x021923 thru 0x02f4d9 (0xdbb7 bytes) 000607 1788814505.829407 write 0x010054 thru 0x019647 (0x95f4 bytes) 000608 1788814505.839049 mapwrite 0x025ff8 thru 0x035fe7 (0xfff0 bytes) 000609 1788814505.911718 mapread 0x002d5c thru 0x012a94 (0xfd39 bytes) 000611 1788814505.928145 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35fe8): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35fe8): Mirror 9: 0x8f384934 (stale) Mirror 10: 0x8f384934 (stale) Mirror 11: 0x8f384934 (stale) Mirror 12: 0x8f384934 (stale) CRC-32 checksum value for chunk [0, 0x35fe8): Mirror 1: 0x44c923c4 Mirror 13: 0x44c923c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35fe8: skipped 000612 1788814506.639146 mapwrite 0x00e5bc thru 0x016d05 (0x874a bytes) 000613 1788814506.808799 read 0x000474 thru 0x00c2a0 (0xbe2d bytes) 000614 1788814506.816476 trunc from 0x035fe8 to 0x039aeb (0x3b04 bytes) 000618 1788814506.834280 write 0x02a1f1 thru 0x02a749 (0x559 bytes) 000621 1788814506.841577 mapread 0x030661 thru 0x039aeb (0x948b bytes) 000622 1788814506.852585 trunc from 0x039aec to 0x02c232 (0xd8b9 bytes) 000624 1788814506.867450 mapwrite 0x0152ac thru 0x01f845 (0xa59a bytes) 000625 1788814506.968255 mapwrite 0x039262 thru 0x039331 (0xd0 bytes) 000626 1788814507.070292 punch from 0x01b1fd to 0x0247bf (0x95c3 bytes) 000629 1788814507.080010 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39332): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39332): Mirror 9: 0xd1de7c8f (stale) Mirror 10: 0xd1de7c8f (stale) Mirror 11: 0xd1de7c8f (stale) Mirror 12: 0xd1de7c8f (stale) Mirror 13: 0xe5e9e7f0 (stale) CRC-32 checksum value for chunk [0, 0x39332): Mirror 1: 0xa7b36c72 Mirror 14: 0xa7b36c72 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39332: skipped 000631 1788814508.012167 read 0x00e9a3 thru 0x01c72a (0xdd88 bytes) 000632 1788814508.032633 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x39332): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39332): Mirror 9: 0xd1de7c8f (stale) Mirror 10: 0xd1de7c8f (stale) Mirror 11: 0xd1de7c8f (stale) Mirror 12: 0xd1de7c8f (stale) Mirror 13: 0xe5e9e7f0 (stale) CRC-32 checksum value for chunk [0, 0x39332): Mirror 1: 0xa7b36c72 Mirror 14: 0xa7b36c72 Mirror 15: 0xa7b36c72 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39332: skipped 000633 1788814508.820864 mapwrite 0x01ba6e thru 0x0261e5 (0xa778 bytes) 000635 1788814509.175330 trunc from 0x039332 to 0x03c4a6 (0x3175 bytes) 000638 1788814509.218859 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3c4a7): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4a7): Mirror 9: 0x732c07a6 (stale) Mirror 10: 0x732c07a6 (stale) Mirror 11: 0x732c07a6 (stale) Mirror 12: 0x732c07a6 (stale) Mirror 13: 0x2a691314 (stale) Mirror 14: 0x6aa8869c (stale) Mirror 15: 0x6aa8869c (stale) CRC-32 checksum value for chunk [0, 0x3c4a7): Mirror 1: 0x34b11cf4 Mirror 16: 0x34b11cf4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4a7: skipped 000639 1788814510.236855 mapread 0x0341fc thru 0x03c4a6 (0x82ab bytes) 000640 1788814510.262757 read 0x0063f1 thru 0x013f7e (0xdb8e bytes) 000641 1788814510.285252 MIRROR_SPLIT mirror 8 to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c4a7): Mirror 9: 0x732c07a6 (stale) Mirror 10: 0x732c07a6 (stale) Mirror 11: 0x732c07a6 (stale) Mirror 12: 0x732c07a6 (stale) Mirror 13: 0x2a691314 (stale) Mirror 14: 0x6aa8869c (stale) Mirror 15: 0x6aa8869c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4a7): Mirror 9: 0x732c07a6 (stale) Mirror 10: 0x732c07a6 (stale) Mirror 11: 0x732c07a6 (stale) Mirror 12: 0x732c07a6 (stale) Mirror 13: 0x2a691314 (stale) Mirror 14: 0x6aa8869c (stale) Mirror 15: 0x6aa8869c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4a7: skipped 000642 1788814510.625901 write 0x01cd5d thru 0x01f613 (0x28b7 bytes) 000644 1788814510.645793 punch from 0x0268c3 to 0x026dd0 (0x50e bytes) 000645 1788814510.662520 write 0x00dc7c thru 0x012111 (0x4496 bytes) 000647 1788814510.671241 mapwrite 0x0167b1 thru 0x018abb (0x230b bytes) 000648 1788814510.750574 read 0x035706 thru 0x03c4a6 (0x6da1 bytes) 000649 1788814510.758635 read 0x01b70d thru 0x02629b (0xab8f bytes) 000650 1788814510.767954 punch from 0x009bc9 to 0x00e6a0 (0x4ad8 bytes) 000652 1788814510.776875 read 0x010847 thru 0x01e919 (0xe0d3 bytes) 000653 1788814510.778227 mapread 0x01a925 thru 0x01e0eb (0x37c7 bytes) 000654 1788814510.782265 read 0x01f2e1 thru 0x0280e5 (0x8e05 bytes) 000655 1788814510.785737 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3c4a7): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4a7): Mirror 9: 0x732c07a6 (stale) Mirror 10: 0x732c07a6 (stale) Mirror 11: 0x732c07a6 (stale) Mirror 12: 0x732c07a6 (stale) Mirror 13: 0x2a691314 (stale) Mirror 14: 0x6aa8869c (stale) Mirror 15: 0x6aa8869c (stale) CRC-32 checksum value for chunk [0, 0x3c4a7): Mirror 1: 0x51690d9 Mirror 16: 0x51690d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4a7: skipped 000656 1788814511.948454 mapread 0x02560d thru 0x03506b (0xfa5f bytes) 000660 1788814512.021030 punch from 0x01104e to 0x011611 (0x5c4 bytes) 000661 1788814512.100435 trunc from 0x03c4a7 to 0x015066 (0x27440 bytes) 000662 1788814512.120329 read 0x0024e0 thru 0x006c52 (0x4773 bytes) 000664 1788814512.129619 mapread 0x007306 thru 0x009d54 (0x2a4f bytes) 000665 1788814512.140310 punch from 0x00d11d to 0x012415 (0x52f9 bytes) 000667 1788814512.147763 MIRROR_SPLIT mirror 1 to 8 mirrors CRC-32 checksum value for chunk [0, 0x15067): Mirror 10: 0xddba862 (stale) Mirror 11: 0xddba862 (stale) Mirror 12: 0xddba862 (stale) Mirror 13: 0x2c36c553 (stale) Mirror 14: 0xeb93eb84 (stale) Mirror 15: 0xeb93eb84 (stale) Mirror 16: 0xc49ebbe7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15067): Mirror 10: 0xddba862 (stale) Mirror 11: 0xddba862 (stale) Mirror 12: 0xddba862 (stale) Mirror 13: 0x2c36c553 (stale) Mirror 14: 0xeb93eb84 (stale) Mirror 15: 0xeb93eb84 (stale) Mirror 16: 0xc49ebbe7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15067: skipped 000668 1788814512.656418 read 0x003c5d thru 0x005575 (0x1919 bytes) 000669 1788814512.663143 read 0x010ccb thru 0x015066 (0x439c bytes) 000670 1788814512.678957 mapwrite 0x00de1e thru 0x018732 (0xa915 bytes) 000671 1788814512.781707 mapwrite 0x01a3d5 thru 0x01ec40 (0x486c bytes) 000673 1788814512.874688 read 0x01d957 thru 0x01ec40 (0x12ea bytes) 000674 1788814512.880727 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1ec41): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ec41): Mirror 10: 0x926f1114 (stale) Mirror 11: 0x926f1114 (stale) Mirror 12: 0x926f1114 (stale) Mirror 13: 0x706768b4 (stale) Mirror 14: 0x4a86b210 (stale) Mirror 15: 0x4a86b210 (stale) Mirror 16: 0x309005b9 (stale) CRC-32 checksum value for chunk [0, 0x1ec41): Mirror 1: 0x78609432 Mirror 17: 0x78609432 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ec41: skipped 000675 1788814513.786947 MIRROR_RESYNC 9 mirrors 000679 1788814514.637809 mapread 0x0155fd thru 0x01d3c9 (0x7dcd bytes) 000680 1788814514.649364 punch from 0x0195b2 to 0x01cf67 (0x39b6 bytes) 000683 1788814514.711914 mapread 0x0058c7 thru 0x010d2d (0xb467 bytes) 000684 1788814514.722893 trunc from 0x01ec41 to 0x02bed7 (0xd297 bytes) 000685 1788814514.745760 mapread 0x00ec68 thru 0x01b285 (0xc61e bytes) 000686 1788814514.760766 mapwrite 0x02baf7 thru 0x034282 (0x878c bytes) 000687 1788814514.849812 write 0x01d79a thru 0x025c8e (0x84f5 bytes) 000689 1788814514.856896 read 0x02a5bd thru 0x02efb9 (0x49fd bytes) 000690 1788814514.858354 trunc from 0x034283 to 0x034d26 (0xaa4 bytes) 000691 1788814514.883071 read 0x02c6a9 thru 0x034d26 (0x867e bytes) 000692 1788814514.884697 mapread 0x030610 thru 0x030aea (0x4db bytes) 000694 1788814514.885896 trunc from 0x034d27 to 0x01b9ee (0x19338 bytes) 000696 1788814514.942410 mapwrite 0x02be36 thru 0x03b211 (0xf3dc bytes) 000697 1788814515.037270 write 0x00c3e3 thru 0x01adc2 (0xe9e0 bytes) 000699 1788814515.039121 punch from 0x023116 to 0x02f128 (0xc013 bytes) 000701 1788814515.055945 mapread 0x024e41 thru 0x02d7ab (0x896b bytes) 000702 1788814515.094379 mapread 0x00e1d6 thru 0x0186c3 (0xa4ee bytes) 000705 1788814515.096510 read 0x006180 thru 0x00bcf3 (0x5b74 bytes) 000707 1788814515.098321 write 0x018853 thru 0x026a95 (0xe243 bytes) 000708 1788814515.099873 write 0x035f83 thru 0x0375f4 (0x1672 bytes) 000710 1788814515.102096 punch from 0x031eaa to 0x036993 (0x4aea bytes) 000711 1788814515.116804 punch from 0x02264f to 0x023f16 (0x18c8 bytes) 000712 1788814515.124675 read 0x02f9bc thru 0x0319ff (0x2044 bytes) 000713 1788814515.132715 punch from 0x00c9b2 to 0x01b04d (0xe69c bytes) 000715 1788814515.137587 mapread 0x00ebde thru 0x01c908 (0xdd2b bytes) 000716 1788814515.197511 mapwrite 0x003def thru 0x0069ee (0x2c00 bytes) 000717 1788814515.239772 write 0x00f615 thru 0x01a144 (0xab30 bytes) 000719 1788814515.241434 mapread 0x01abc5 thru 0x01fe75 (0x52b1 bytes) 000720 1788814515.245977 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3b212): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b212): Mirror 10: 0x5bad0069 (stale) Mirror 11: 0x5bad0069 (stale) Mirror 12: 0x5bad0069 (stale) Mirror 13: 0x5bad0069 (stale) Mirror 14: 0x5bad0069 (stale) Mirror 15: 0x5bad0069 (stale) Mirror 16: 0x5bad0069 (stale) Mirror 17: 0x5bad0069 (stale) CRC-32 checksum value for chunk [0, 0x3b212): Mirror 1: 0xfe98e73e Mirror 18: 0xfe98e73e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b212: skipped 000721 1788814516.007238 mapwrite 0x00f791 thru 0x016ff1 (0x7861 bytes) 000722 1788814516.151442 read 0x01e596 thru 0x021d77 (0x37e2 bytes) 000723 1788814516.157084 trunc from 0x03b212 to 0x02f26b (0xbfa6 bytes) 000724 1788814516.207990 trunc from 0x02f26c to 0x00595f (0x2990c bytes) 000725 1788814516.224105 write 0x02e5e5 thru 0x0331da (0x4bf6 bytes) 000727 1788814516.226940 punch from 0x003d2e to 0x008ba1 (0x4e74 bytes) 000732 1788814516.249301 write 0x01c435 thru 0x026c00 (0xa7cc bytes) 000734 1788814516.266935 punch from 0x03052c to 0x0331da (0x2caf bytes) 000735 1788814516.292678 punch from 0x02a261 to 0x0325df (0x837f bytes) 000736 1788814516.300509 mapread 0x00bbe1 thru 0x01181a (0x5c3a bytes) 000737 1788814516.317593 trunc from 0x0331db to 0x037730 (0x4556 bytes) 000738 1788814516.332686 write 0x030fc1 thru 0x03ffff (0xf03f bytes) 000739 1788814516.339997 punch from 0x02469c to 0x03191b (0xd280 bytes) 000740 1788814516.356568 MIRROR_RESYNC 10 mirrors 000741 1788814518.712624 mapwrite 0x01c62c thru 0x02ad21 (0xe6f6 bytes) 000742 1788814518.838589 trunc from 0x040000 to 0x007ef1 (0x3810e bytes) 000743 1788814518.856532 MIRROR_RESYNC 10 mirrors 000744 1788814520.608818 MIRROR_EXTEND to 11 mirrors 000745 1788814521.235865 MIRROR_SPLIT mirror 8 to 10 mirrors 000746 1788814521.533254 MIRROR_RESYNC 10 mirrors 000751 1788814521.966877 punch from 0x005d4d to 0x007691 (0x1945 bytes) 000752 1788814522.108800 mapwrite 0x00f331 thru 0x016638 (0x7308 bytes) 000753 1788814522.160228 punch from 0x00bbed to 0x016638 (0xaa4c bytes) 000754 1788814522.164746 mapread 0x002077 thru 0x002358 (0x2e2 bytes) 000755 1788814522.177209 trunc from 0x016639 to 0x0307bf (0x1a187 bytes) 000757 1788814522.190692 mapwrite 0x004739 thru 0x00799b (0x3263 bytes) 000758 1788814522.221412 write 0x0015d6 thru 0x010ac1 (0xf4ec bytes) 000759 1788814522.222910 read 0x01c5b0 thru 0x01de20 (0x1871 bytes) 000761 1788814522.231555 punch from 0x006537 to 0x007f7a (0x1a44 bytes) 000762 1788814522.246747 trunc from 0x0307c0 to 0x00729a (0x29525 bytes) 000763 1788814522.257430 punch from 0x001a54 to 0x00729a (0x5847 bytes) 000764 1788814522.264767 punch from 0x0021eb to 0x0061bb (0x3fd1 bytes) 000765 1788814522.270345 read 0x000a76 thru 0x00729a (0x6825 bytes) 000766 1788814522.279951 write 0x017b2f thru 0x024d41 (0xd213 bytes) 000767 1788814522.283346 punch from 0x01a059 to 0x024893 (0xa83b bytes) 000768 1788814522.305606 punch from 0x01e11b to 0x0224d7 (0x43bd bytes) 000769 1788814522.315991 mapread 0x0026df thru 0x003e4a (0x176c bytes) 000771 1788814522.318760 mapwrite 0x00050c thru 0x007219 (0x6d0e bytes) 000772 1788814522.360771 mapread 0x0061f5 thru 0x007a1c (0x1828 bytes) 000773 1788814522.361353 mapread 0x0154be thru 0x022ab3 (0xd5f6 bytes) 000775 1788814522.371908 MIRROR_RESYNC 10 mirrors 000776 1788814524.357105 write 0x018d91 thru 0x02333c (0xa5ac bytes) 000777 1788814524.425224 punch from 0x0016f9 to 0x00ab7b (0x9483 bytes) 000778 1788814524.435444 mapread 0x000663 thru 0x00ad35 (0xa6d3 bytes) 000779 1788814524.455353 punch from 0x005d65 to 0x00aa0d (0x4ca9 bytes) 000782 1788814524.459610 punch from 0x00c6c0 to 0x011222 (0x4b63 bytes) 000783 1788814524.462868 trunc from 0x024d42 to 0x007d01 (0x1d040 bytes) 000784 1788814524.490172 MIRROR_RESYNC 10 mirrors 000785 1788814525.598368 punch from 0x005125 to 0x007d01 (0x2bdd bytes) 000786 1788814525.656033 write 0x01be61 thru 0x027826 (0xb9c6 bytes) 000789 1788814525.666372 read 0x0006cf thru 0x002042 (0x1974 bytes) 000792 1788814525.673403 write 0x01b994 thru 0x025f62 (0xa5cf bytes) 000793 1788814525.675318 read 0x01bbd7 thru 0x027374 (0xb79e bytes) 000794 1788814525.676242 punch from 0x010f89 to 0x019cc5 (0x8d3d bytes) 000796 1788814525.688450 mapread 0x01382a thru 0x017574 (0x3d4b bytes) 000797 1788814525.696905 read 0x018b01 thru 0x01f199 (0x6699 bytes) 000798 1788814525.701319 MIRROR_RESYNC 10 mirrors 000799 1788814527.308362 trunc from 0x027827 to 0x002c4c (0x24bda bytes) 000800 1788814527.379768 trunc from 0x002c4d to 0x03bf2e (0x392e2 bytes) 000801 1788814527.405797 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3bf2f): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf2f): Mirror 10: 0xa7d0d114 (stale) Mirror 11: 0xa7d0d114 (stale) Mirror 12: 0xa7d0d114 (stale) Mirror 13: 0xa7d0d114 (stale) Mirror 14: 0xa7d0d114 (stale) Mirror 15: 0xa7d0d114 (stale) Mirror 16: 0xa7d0d114 (stale) Mirror 18: 0xa7d0d114 (stale) Mirror 19: 0xa7d0d114 (stale) CRC-32 checksum value for chunk [0, 0x3bf2f): Mirror 1: 0x3478b7d6 Mirror 20: 0x3478b7d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf2f: skipped 000804 1788814528.392286 mapread 0x02c47f thru 0x03bf2e (0xfab0 bytes) 000806 1788814528.435765 write 0x015964 thru 0x01a36b (0x4a08 bytes) 000807 1788814528.528359 trunc from 0x03bf2f to 0x031b5b (0xa3d3 bytes) 000809 1788814528.552298 write 0x008a18 thru 0x00a6e5 (0x1cce bytes) 000810 1788814528.561439 mapwrite 0x03b868 thru 0x03ffff (0x4798 bytes) 000811 1788814528.659163 MIRROR_RESYNC 11 mirrors 000812 1788814530.676161 punch from 0x021f94 to 0x02923f (0x72ac bytes) 000815 1788814530.732464 write 0x02e138 thru 0x03c3e0 (0xe2a9 bytes) 000817 1788814530.744891 MIRROR_RESYNC 11 mirrors 000818 1788814532.705592 mapread 0x01d231 thru 0x0292c0 (0xc090 bytes) 000819 1788814532.740153 MIRROR_SPLIT mirror 8 to 10 mirrors 000820 1788814533.092922 write 0x013b09 thru 0x01859f (0x4a97 bytes) 000821 1788814533.177810 MIRROR_RESYNC 10 mirrors 000822 1788814534.943857 mapwrite 0x0241f2 thru 0x02e644 (0xa453 bytes) 000823 1788814535.104458 trunc from 0x040000 to 0x0326c5 (0xd93a bytes) 000825 1788814535.127266 write 0x03356f thru 0x039214 (0x5ca6 bytes) 000826 1788814535.129350 read 0x005cbb thru 0x0150b8 (0xf3fe bytes) 000828 1788814535.139755 punch from 0x02e8e2 to 0x02ea6a (0x189 bytes) 000830 1788814535.152608 trunc from 0x039215 to 0x03c6d7 (0x34c3 bytes) 000832 1788814535.168818 mapread 0x022913 thru 0x02fd96 (0xd484 bytes) 000833 1788814535.174202 mapwrite 0x03f663 thru 0x03ffff (0x99d bytes) 000834 1788814535.232263 mapread 0x001202 thru 0x0040e8 (0x2ee7 bytes) 000836 1788814535.239977 punch from 0x019ecd to 0x024daa (0xaede bytes) 000837 1788814535.245112 read 0x00202b thru 0x00cf29 (0xaeff bytes) 000838 1788814535.246115 trunc from 0x040000 to 0x019eb4 (0x2614b bytes) 000841 1788814535.272170 mapwrite 0x0004e4 thru 0x009d41 (0x985e bytes) 000842 1788814535.328000 read 0x017921 thru 0x019eb4 (0x2594 bytes) 000844 1788814535.329716 write 0x03e7b8 thru 0x03e7e3 (0x2c bytes) 000848 1788814535.333283 mapread 0x012449 thru 0x0203e2 (0xdf9a bytes) 000849 1788814535.340090 punch from 0x03645f to 0x03e7e3 (0x8385 bytes) 000850 1788814535.348024 trunc from 0x03e7e4 to 0x012250 (0x2c593 bytes) 000851 1788814535.366757 trunc from 0x012251 to 0x00229f (0xffb1 bytes) 000852 1788814535.386713 punch from 0x0000b5 to 0x00229f (0x21eb bytes) 000853 1788814535.392398 trunc from 0x0022a0 to 0x038604 (0x36365 bytes) truncating to largest ever: 0x3ecfd 000855 1788814535.408192 trunc from 0x038605 to 0x03ecfc (0x66f8 bytes) 000856 1788814535.426861 write 0x039b0c thru 0x03fb5f (0x6054 bytes) 000859 1788814535.433684 trunc from 0x03fb60 to 0x014271 (0x2b8ee bytes) 000860 1788814535.446745 mapwrite 0x02f2c4 thru 0x03b821 (0xc55e bytes) 000861 1788814535.565605 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b822): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b822): Mirror 10: 0xaebd11c0 (stale) Mirror 11: 0xaebd11c0 (stale) Mirror 12: 0xaebd11c0 (stale) Mirror 13: 0xaebd11c0 (stale) Mirror 14: 0xaebd11c0 (stale) Mirror 15: 0xaebd11c0 (stale) Mirror 16: 0xaebd11c0 (stale) Mirror 19: 0xaebd11c0 (stale) Mirror 20: 0xaebd11c0 (stale) CRC-32 checksum value for chunk [0, 0x3b822): Mirror 1: 0x6bdf1fd6 Mirror 21: 0x6bdf1fd6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b822: skipped 000862 1788814536.457262 trunc from 0x03b822 to 0x02fc9a (0xbb87 bytes) 000863 1788814536.605361 trunc from 0x02fc9b to 0x029d56 (0x5f44 bytes) 000865 1788814536.634888 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x29d57): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29d57): Mirror 10: 0xf1bda8ac (stale) Mirror 11: 0xf1bda8ac (stale) Mirror 12: 0xf1bda8ac (stale) Mirror 13: 0xf1bda8ac (stale) Mirror 14: 0xf1bda8ac (stale) Mirror 15: 0xf1bda8ac (stale) Mirror 16: 0xf1bda8ac (stale) Mirror 19: 0xf1bda8ac (stale) Mirror 20: 0xf1bda8ac (stale) Mirror 21: 0x717fdd9f (stale) CRC-32 checksum value for chunk [0, 0x29d57): Mirror 1: 0x717fdd9f Mirror 22: 0x717fdd9f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29d57: skipped 000866 1788814537.721586 mapread 0x0247df thru 0x029d56 (0x5578 bytes) 000869 1788814537.787185 punch from 0x02813b to 0x029d56 (0x1c1c bytes) 000870 1788814537.852776 mapwrite 0x01c151 thru 0x01c56d (0x41d bytes) 000871 1788814537.917230 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x29d57): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29d57): Mirror 10: 0xf1bda8ac (stale) Mirror 11: 0xf1bda8ac (stale) Mirror 12: 0xf1bda8ac (stale) Mirror 13: 0xf1bda8ac (stale) Mirror 14: 0xf1bda8ac (stale) Mirror 15: 0xf1bda8ac (stale) Mirror 16: 0xf1bda8ac (stale) Mirror 19: 0xf1bda8ac (stale) Mirror 20: 0xf1bda8ac (stale) Mirror 21: 0x717fdd9f (stale) Mirror 22: 0x717fdd9f (stale) CRC-32 checksum value for chunk [0, 0x29d57): Mirror 1: 0x50f01791 Mirror 23: 0x50f01791 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29d57: skipped 000872 1788814539.058234 punch from 0x00aa97 to 0x012115 (0x767f bytes) 000873 1788814539.150605 mapwrite 0x00573d thru 0x01053f (0xae03 bytes) 000874 1788814539.221850 punch from 0x019c3c to 0x01cc49 (0x300e bytes) 000876 1788814539.227134 punch from 0x028b92 to 0x029d56 (0x11c5 bytes) 000878 1788814539.232289 write 0x0349f1 thru 0x03ffff (0xb60f bytes) 000879 1788814539.233956 write 0x01e8ee thru 0x02a71f (0xbe32 bytes) 000880 1788814539.248605 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xb39c7748 (stale) Mirror 11: 0xb39c7748 (stale) Mirror 12: 0xb39c7748 (stale) Mirror 13: 0xb39c7748 (stale) Mirror 14: 0xb39c7748 (stale) Mirror 15: 0xb39c7748 (stale) Mirror 16: 0xb39c7748 (stale) Mirror 19: 0xb39c7748 (stale) Mirror 20: 0xb39c7748 (stale) Mirror 21: 0x846b6ea6 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0x63f7d043 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1fa7f498 Mirror 24: 0x1fa7f498 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000881 1788814540.042915 mapread 0x0033f8 thru 0x004876 (0x147f bytes) 000882 1788814540.062273 punch from 0x0215b6 to 0x02c89f (0xb2ea bytes) 000883 1788814540.174419 read 0x023b43 thru 0x02a698 (0x6b56 bytes) 000884 1788814540.182204 mapread 0x015281 thru 0x01f455 (0xa1d5 bytes) 000888 1788814540.192628 trunc from 0x040000 to 0x005688 (0x3a977 bytes) 000890 1788814540.221569 mapwrite 0x007004 thru 0x00df01 (0x6efe bytes) 000892 1788814540.328209 punch from 0x007688 to 0x007882 (0x1fb bytes) 000893 1788814540.333617 trunc from 0x00df02 to 0x02532c (0x1742b bytes) 000894 1788814540.352120 mapwrite 0x00d651 thru 0x00e146 (0xaf6 bytes) 000895 1788814540.405506 MIRROR_SPLIT mirror 7 to 13 mirrors CRC-32 checksum value for chunk [0, 0x2532d): Mirror 10: 0x33124662 (stale) Mirror 11: 0x33124662 (stale) Mirror 12: 0x33124662 (stale) Mirror 13: 0x33124662 (stale) Mirror 14: 0x33124662 (stale) Mirror 15: 0x33124662 (stale) Mirror 19: 0x33124662 (stale) Mirror 20: 0x33124662 (stale) Mirror 21: 0x17fac6eb (stale) Mirror 22: 0x17fac6eb (stale) Mirror 23: 0x100b7f4d (stale) Mirror 24: 0x64e8a8a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2532d): Mirror 10: 0x33124662 (stale) Mirror 11: 0x33124662 (stale) Mirror 12: 0x33124662 (stale) Mirror 13: 0x33124662 (stale) Mirror 14: 0x33124662 (stale) Mirror 15: 0x33124662 (stale) Mirror 19: 0x33124662 (stale) Mirror 20: 0x33124662 (stale) Mirror 21: 0x17fac6eb (stale) Mirror 22: 0x17fac6eb (stale) Mirror 23: 0x100b7f4d (stale) Mirror 24: 0x64e8a8a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2532d: skipped 000896 1788814540.914536 write 0x018c1c thru 0x023ece (0xb2b3 bytes) 000898 1788814540.922865 punch from 0x019afd to 0x01f457 (0x595b bytes) 000899 1788814540.936152 write 0x006f54 thru 0x016bb9 (0xfc66 bytes) 000901 1788814540.945890 read 0x00f469 thru 0x01e5b8 (0xf150 bytes) 000903 1788814540.960297 trunc from 0x02532d to 0x023ea3 (0x1489 bytes) 000904 1788814540.980870 MIRROR_RESYNC 13 mirrors 000906 1788814542.682256 MIRROR_RESYNC 13 mirrors 000908 1788814543.303062 read 0x02078f thru 0x023ea3 (0x3715 bytes) 000910 1788814543.311969 mapwrite 0x011604 thru 0x01ab89 (0x9586 bytes) 000911 1788814543.458973 write 0x01998d thru 0x01f5ac (0x5c20 bytes) 000912 1788814543.464104 trunc from 0x023ea4 to 0x02b0e1 (0x723e bytes) 000913 1788814543.477623 write 0x01f4da thru 0x029e49 (0xa970 bytes) 000915 1788814543.482391 mapwrite 0x00cac8 thru 0x012ce0 (0x6219 bytes) 000917 1788814543.534403 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2b0e2): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0e2): Mirror 10: 0xac8400b4 (stale) Mirror 11: 0xac8400b4 (stale) Mirror 12: 0xac8400b4 (stale) Mirror 13: 0xac8400b4 (stale) Mirror 14: 0xac8400b4 (stale) Mirror 15: 0xac8400b4 (stale) Mirror 19: 0xac8400b4 (stale) Mirror 20: 0xac8400b4 (stale) Mirror 21: 0xac8400b4 (stale) Mirror 22: 0xac8400b4 (stale) Mirror 23: 0xac8400b4 (stale) Mirror 24: 0xac8400b4 (stale) CRC-32 checksum value for chunk [0, 0x2b0e2): Mirror 1: 0xbad04b79 Mirror 25: 0xbad04b79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0e2: skipped 000919 1788814544.289891 write 0x031b14 thru 0x03e886 (0xcd73 bytes) 000920 1788814544.370824 punch from 0x00ec5c to 0x010ee6 (0x228b bytes) 000922 1788814544.383431 punch from 0x03d734 to 0x03d9be (0x28b bytes) 000923 1788814544.388426 write 0x038b15 thru 0x03a334 (0x1820 bytes) 000924 1788814544.389767 write 0x015503 thru 0x022cc1 (0xd7bf bytes) 000925 1788814544.399812 read 0x0314a8 thru 0x038139 (0x6c92 bytes) 000928 1788814544.402161 write 0x00574f thru 0x011bca (0xc47c bytes) 000930 1788814544.411857 mapread 0x011a21 thru 0x01cd35 (0xb315 bytes) 000931 1788814544.424097 mapread 0x03d289 thru 0x03e7d4 (0x154c bytes) 000932 1788814544.430848 mapread 0x027c7b thru 0x03110f (0x9495 bytes) 000933 1788814544.441746 punch from 0x005c5c to 0x00f08c (0x9431 bytes) 000934 1788814544.457810 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3e887): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e887): Mirror 10: 0xe6486986 (stale) Mirror 11: 0xe6486986 (stale) Mirror 12: 0xe6486986 (stale) Mirror 13: 0xe6486986 (stale) Mirror 14: 0xe6486986 (stale) Mirror 15: 0xe6486986 (stale) Mirror 19: 0xe6486986 (stale) Mirror 20: 0xe6486986 (stale) Mirror 21: 0xe6486986 (stale) Mirror 22: 0xe6486986 (stale) Mirror 23: 0xe6486986 (stale) Mirror 24: 0xe6486986 (stale) Mirror 25: 0xc31899a3 (stale) CRC-32 checksum value for chunk [0, 0x3e887): Mirror 1: 0x68badb51 Mirror 26: 0x68badb51 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e887: skipped 000935 1788814545.219413 trunc from 0x03e887 to 0x03bd5f (0x2b27 bytes) 000937 1788814545.389304 mapwrite 0x019492 thru 0x026d35 (0xd8a4 bytes) 000938 1788814545.471834 mapread 0x02f167 thru 0x03afb2 (0xbe4c bytes) 000939 1788814545.483789 punch from 0x00b697 to 0x00c3e6 (0xd50 bytes) 000940 1788814545.488534 write 0x000681 thru 0x002621 (0x1fa1 bytes) 000941 1788814545.497189 mapread 0x0022db thru 0x003322 (0x1048 bytes) 000944 1788814545.505527 mapwrite 0x00071e thru 0x005f51 (0x5834 bytes) 000947 1788814545.556944 mapwrite 0x036e5e thru 0x03ffff (0x91a2 bytes) 000948 1788814545.620153 read 0x016a35 thru 0x021783 (0xad4f bytes) 000949 1788814545.620829 trunc from 0x040000 to 0x001353 (0x3ecac bytes) 000951 1788814545.635461 punch from 0x0005fb to 0x001353 (0xd59 bytes) 000952 1788814545.640781 read 0x000f65 thru 0x001353 (0x3ef bytes) 000953 1788814545.645898 read 0x000292 thru 0x001353 (0x10c2 bytes) 000954 1788814545.646599 mapwrite 0x02dfe0 thru 0x03b717 (0xd738 bytes) 000956 1788814545.735067 read 0x02ba02 thru 0x033af4 (0x80f3 bytes) 000958 1788814545.735852 punch from 0x035bf3 to 0x03b717 (0x5b25 bytes) 000959 1788814545.740802 read 0x02ff6a thru 0x03b717 (0xb7ae bytes) 000961 1788814545.749685 write 0x02e480 thru 0x033ce1 (0x5862 bytes) 000962 1788814545.750694 trunc from 0x03b718 to 0x016b26 (0x24bf1 bytes) 000963 1788814545.767040 trunc from 0x016b27 to 0x00bea6 (0xac80 bytes) 000964 1788814545.787226 mapread 0x00326c thru 0x00bea6 (0x8c3b bytes) 000965 1788814545.788161 write 0x0062bb thru 0x011924 (0xb66a bytes) 000967 1788814545.789819 write 0x01e389 thru 0x0275b2 (0x922a bytes) 000968 1788814545.791561 write 0x0259f8 thru 0x030624 (0xac2d bytes) 000970 1788814545.794086 read 0x01932c thru 0x019be8 (0x8bd bytes) 000971 1788814545.799859 mapread 0x005fcb thru 0x01557e (0xf5b4 bytes) 000972 1788814545.801413 read 0x027cc2 thru 0x028712 (0xa51 bytes) 000973 1788814545.805392 MIRROR_SPLIT mirror 4 to 14 mirrors CRC-32 checksum value for chunk [0, 0x30625): Mirror 10: 0xb46dfb6e (stale) Mirror 11: 0xb46dfb6e (stale) Mirror 12: 0xb46dfb6e (stale) Mirror 14: 0xb46dfb6e (stale) Mirror 15: 0xb46dfb6e (stale) Mirror 19: 0xb46dfb6e (stale) Mirror 20: 0xb46dfb6e (stale) Mirror 21: 0xb46dfb6e (stale) Mirror 22: 0xb46dfb6e (stale) Mirror 23: 0xb46dfb6e (stale) Mirror 24: 0xb46dfb6e (stale) Mirror 25: 0x2d919d76 (stale) Mirror 26: 0x973db7ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30625): Mirror 10: 0xb46dfb6e (stale) Mirror 11: 0xb46dfb6e (stale) Mirror 12: 0xb46dfb6e (stale) Mirror 14: 0xb46dfb6e (stale) Mirror 15: 0xb46dfb6e (stale) Mirror 19: 0xb46dfb6e (stale) Mirror 20: 0xb46dfb6e (stale) Mirror 21: 0xb46dfb6e (stale) Mirror 22: 0xb46dfb6e (stale) Mirror 23: 0xb46dfb6e (stale) Mirror 24: 0xb46dfb6e (stale) Mirror 25: 0x2d919d76 (stale) Mirror 26: 0x973db7ea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30625: skipped 000974 1788814546.338812 mapwrite 0x023420 thru 0x032acf (0xf6b0 bytes) 000975 1788814546.431991 trunc from 0x032ad0 to 0x02549d (0xd632 bytes) 000976 1788814546.452117 read 0x01baea thru 0x02549d (0x99b4 bytes) 000977 1788814546.463001 MIRROR_SPLIT mirror 9 to 13 mirrors CRC-32 checksum value for chunk [0, 0x2549e): Mirror 10: 0x2295e6e7 (stale) Mirror 11: 0x2295e6e7 (stale) Mirror 12: 0x2295e6e7 (stale) Mirror 14: 0x2295e6e7 (stale) Mirror 15: 0x2295e6e7 (stale) Mirror 19: 0x2295e6e7 (stale) Mirror 20: 0x2295e6e7 (stale) Mirror 21: 0x2295e6e7 (stale) Mirror 23: 0x2295e6e7 (stale) Mirror 24: 0x2295e6e7 (stale) Mirror 25: 0x4f195e07 (stale) Mirror 26: 0xd16354a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2549e): Mirror 10: 0x2295e6e7 (stale) Mirror 11: 0x2295e6e7 (stale) Mirror 12: 0x2295e6e7 (stale) Mirror 14: 0x2295e6e7 (stale) Mirror 15: 0x2295e6e7 (stale) Mirror 19: 0x2295e6e7 (stale) Mirror 20: 0x2295e6e7 (stale) Mirror 21: 0x2295e6e7 (stale) Mirror 23: 0x2295e6e7 (stale) Mirror 24: 0x2295e6e7 (stale) Mirror 25: 0x4f195e07 (stale) Mirror 26: 0xd16354a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2549e: skipped 000978 1788814546.948152 punch from 0x0017b1 to 0x0019c3 (0x213 bytes) 000979 1788814546.952920 mapwrite 0x00601f thru 0x00e332 (0x8314 bytes) 000980 1788814547.021089 punch from 0x01dc45 to 0x01fc58 (0x2014 bytes) 000985 1788814547.028017 mapwrite 0x01ddbf thru 0x0217df (0x3a21 bytes) 000986 1788814547.077967 trunc from 0x02549e to 0x030f21 (0xba84 bytes) 000989 1788814547.096787 punch from 0x0290f6 to 0x02d964 (0x486f bytes) 000990 1788814547.104524 MIRROR_SPLIT mirror 8 to 12 mirrors CRC-32 checksum value for chunk [0, 0x30f22): Mirror 10: 0x8b3449f2 (stale) Mirror 11: 0x8b3449f2 (stale) Mirror 12: 0x8b3449f2 (stale) Mirror 14: 0x8b3449f2 (stale) Mirror 15: 0x8b3449f2 (stale) Mirror 19: 0x8b3449f2 (stale) Mirror 20: 0x8b3449f2 (stale) Mirror 23: 0x8b3449f2 (stale) Mirror 24: 0x8b3449f2 (stale) Mirror 25: 0x3c0a82b9 (stale) Mirror 26: 0xed48a9d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30f22): Mirror 10: 0x8b3449f2 (stale) Mirror 11: 0x8b3449f2 (stale) Mirror 12: 0x8b3449f2 (stale) Mirror 14: 0x8b3449f2 (stale) Mirror 15: 0x8b3449f2 (stale) Mirror 19: 0x8b3449f2 (stale) Mirror 20: 0x8b3449f2 (stale) Mirror 23: 0x8b3449f2 (stale) Mirror 24: 0x8b3449f2 (stale) Mirror 25: 0x3c0a82b9 (stale) Mirror 26: 0xed48a9d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30f22: skipped 000991 1788814547.546796 punch from 0x001157 to 0x005f9b (0x4e45 bytes) 000994 1788814547.555860 MIRROR_RESYNC 12 mirrors 000995 1788814549.838783 MIRROR_RESYNC 12 mirrors 000996 1788814550.402197 write 0x0103c9 thru 0x018101 (0x7d39 bytes) 000997 1788814550.463431 write 0x038985 thru 0x03fae5 (0x7161 bytes) 000998 1788814550.465713 read 0x00dd4d thru 0x00f726 (0x19da bytes) 001000 1788814550.470202 write 0x01ebf6 thru 0x0253fb (0x6806 bytes) All operations completed A-OK!