== sanity-flr test 70a: flr mode fsx test ================ 19:53:26 (1788306806) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 6808 skipping zero size read fallocating to largest ever: 0x388c7 000002 1788306808.829021 fallocate 0x0300dd thru 0x0388c6 (0x87ea bytes) skipping zero size read 000004 1788306808.862979 write 0x037c76 thru 0x039cb7 (0x2042 bytes) 000005 1788306808.909177 MIRROR_EXTEND to 2 mirrors 000006 1788306810.434526 trunc from 0x039cb8 to 0x032d2d (0x6f8a bytes) 000007 1788306810.519817 mapread 0x0051e9 thru 0x01018c (0xafa4 bytes) 000008 1788306810.579499 mapread 0x031c38 thru 0x032d2d (0x10f6 bytes) 000009 1788306810.605687 trunc from 0x032d2e to 0x035189 (0x245c bytes) 000010 1788306810.671637 trunc from 0x02e784 to 0x035189 (0x6a06 bytes) 000011 1788306810.681313 write 0x0369c8 thru 0x03b029 (0x4662 bytes) 000012 1788306810.693839 write 0x01c692 thru 0x01cd18 (0x687 bytes) 000013 1788306810.713919 punch from 0x032142 to 0x03b029 (0x8ee8 bytes) 000014 1788306810.759306 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b02a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b02a): Mirror 2: 0x2acc4e72 (stale) CRC-32 checksum value for chunk [0, 0x3b02a): Mirror 1: 0x7dd55ee6 Mirror 3: 0x7dd55ee6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b02a: skipped 000016 1788306811.927782 punch from 0x02fa46 to 0x0335d9 (0x3b94 bytes) 000017 1788306812.026832 trunc from 0x03b02a to 0x02f550 (0xbad9 bytes) 000018 1788306812.113634 read 0x007a4a thru 0x00a137 (0x26ee bytes) 000019 1788306812.143795 trunc from 0x01bf6e to 0x01eb5b (0x2bee bytes) 000020 1788306812.159403 trunc from 0x02f551 to 0x00d446 (0x2210a bytes) 000021 1788306812.212916 mapread 0x008b0e thru 0x00bfd4 (0x34c7 bytes) 000022 1788306812.241330 mapread 0x008fa6 thru 0x00d446 (0x44a1 bytes) 000023 1788306812.277861 read 0x008f36 thru 0x00ca0b (0x3ad6 bytes) 000024 1788306812.279270 read 0x00cb01 thru 0x00d446 (0x946 bytes) 000025 1788306812.284884 mapread 0x00964f thru 0x00d446 (0x3df8 bytes) 000026 1788306812.295607 MIRROR_RESYNC 3 mirrors 000027 1788306813.364907 mapwrite 0x00ff72 thru 0x01fa80 (0xfb0f bytes) 000028 1788306813.641494 punch from 0x00aff9 to 0x01af76 (0xff7e bytes) 000029 1788306813.662506 read 0x00495d thru 0x0103eb (0xba8f bytes) 000030 1788306813.675533 fallocate 0x02d686 thru 0x02eb25 (0x14a0 bytes) 000031 1788306813.692235 read 0x009b4f thru 0x01039a (0x684c bytes) 000034 1788306813.693771 write 0x009f59 thru 0x00a1ee (0x296 bytes) 000035 1788306813.696406 write 0x01c17b thru 0x028558 (0xc3de bytes) 000036 1788306813.699324 mapread 0x01d874 thru 0x024a8d (0x721a bytes) fallocating to largest ever: 0x3f7be 000037 1788306813.711893 fallocate 0x038d2a thru 0x03f7bd (0x6a94 bytes) 000038 1788306813.718317 write 0x025022 thru 0x0302bb (0xb29a bytes) 000039 1788306813.731628 punch from 0x02a327 to 0x02b77e (0x1458 bytes) 000040 1788306813.754628 punch from 0x00d651 to 0x013168 (0x5b18 bytes) 000041 1788306813.782456 fallocate 0x00e23f thru 0x01df00 (0xfcc2 bytes) 000042 1788306813.809830 mapread 0x02d141 thru 0x0302bb (0x317b bytes) 000043 1788306813.810742 read 0x02bcad thru 0x0302bb (0x460f bytes) 000044 1788306813.847447 punch from 0x028f47 to 0x02d6da (0x4794 bytes) 000045 1788306813.856830 punch from 0x003899 to 0x00abce (0x7336 bytes) 000046 1788306813.864932 mapwrite 0x032471 thru 0x033054 (0xbe4 bytes) 000048 1788306813.951080 write 0x023cb2 thru 0x0315bb (0xd90a bytes) 000049 1788306813.952161 punch from 0x01151d to 0x01ea67 (0xd54b bytes) 000050 1788306813.981532 MIRROR_RESYNC 3 mirrors 000051 1788306815.113592 mapwrite 0x02d647 thru 0x03acdb (0xd695 bytes) 000052 1788306815.212241 trunc from 0x02d054 to 0x03acdb (0xdc88 bytes) 000053 1788306815.218601 trunc from 0x03acdc to 0x01d66e (0x1d66d bytes) 000054 1788306815.243673 mapwrite 0x03a718 thru 0x03ffff (0x58e8 bytes) 000055 1788306815.346713 mapwrite 0x008e2c thru 0x017730 (0xe905 bytes) 000056 1788306815.429455 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7e6e900a (stale) Mirror 3: 0x7e6e900a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xff8bc7df Mirror 4: 0xff8bc7df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000057 1788306816.489117 punch from 0x011b7f to 0x016da4 (0x5226 bytes) 000058 1788306816.560657 trunc from 0x03eb3e to 0x03ffff (0x14c2 bytes) 000059 1788306816.570832 fallocate 0x006fc8 thru 0x010610 (0x9649 bytes) 000060 1788306816.576128 fallocate 0x01446f thru 0x021c6e (0xd800 bytes) 000061 1788306816.592036 mapread 0x032936 thru 0x039f4c (0x7617 bytes) 000062 1788306816.643141 fallocate 0x012438 thru 0x021c91 (0xf85a bytes) 000063 1788306816.656980 write 0x03105d thru 0x034c19 (0x3bbd bytes) 000065 1788306816.664958 write 0x011a0d thru 0x0144e9 (0x2add bytes) 000067 1788306816.677712 read 0x008d5e thru 0x00e693 (0x5936 bytes) 000069 1788306816.733647 fallocate 0x0009be thru 0x00b7d8 (0xae1b bytes) 000070 1788306816.753968 trunc from 0x040000 to 0x012869 (0x2d796 bytes) 000071 1788306816.840586 mapread 0x00a3e0 thru 0x012869 (0x848a bytes) 000072 1788306816.856035 trunc from 0x0007d4 to 0x002153 (0x1980 bytes) 000073 1788306816.862496 write 0x00ec8a thru 0x0148b6 (0x5c2d bytes) 000074 1788306816.870225 fallocate 0x038c6e thru 0x038f52 (0x2e5 bytes) 000075 1788306816.888153 mapwrite 0x02c36a thru 0x03857b (0xc212 bytes) fallocating to largest ever: 0x40000 000076 1788306816.971121 fallocate 0x03a496 thru 0x03ffff (0x5b6a bytes) 000077 1788306816.998547 trunc from 0x02509c to 0x030a5a (0xb9bf bytes) 000078 1788306817.005846 read 0x0134c9 thru 0x016516 (0x304e bytes) 000079 1788306817.032874 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7e6e900a (stale) Mirror 4: 0xff8bc7df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7e6e900a (stale) Mirror 4: 0xff8bc7df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000080 1788306817.529832 read 0x00ffed thru 0x01b486 (0xb49a bytes) 000081 1788306817.549973 write 0x02411e thru 0x027eff (0x3de2 bytes) 000082 1788306817.565373 trunc from 0x040000 to 0x029a5f (0x165a0 bytes) 000083 1788306817.596961 write 0x02a858 thru 0x032df3 (0x859c bytes) 000085 1788306817.598829 trunc from 0x014c81 to 0x01f146 (0xa4c6 bytes) 000086 1788306817.606120 read 0x016b5b thru 0x017bbe (0x1064 bytes) 000087 1788306817.622033 punch from 0x016b6b to 0x0267e1 (0xfc77 bytes) 000088 1788306817.668200 trunc from 0x01bf93 to 0x01efb5 (0x3023 bytes) 000089 1788306817.685832 fallocate 0x03608f thru 0x037210 (0x1182 bytes) 000091 1788306817.697468 read 0x00fe72 thru 0x0186b1 (0x8840 bytes) 000092 1788306817.710339 read 0x0168e2 thru 0x01d986 (0x70a5 bytes) 000093 1788306817.716963 MIRROR_RESYNC 3 mirrors 000094 1788306818.629348 fallocate 0x01b866 thru 0x0286f7 (0xce92 bytes) 000095 1788306818.663738 MIRROR_RESYNC 3 mirrors 000096 1788306819.212573 write 0x03334a thru 0x03d3eb (0xa0a2 bytes) 000098 1788306819.246302 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d3ec): Mirror 4: 0x671a46e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3ec): Mirror 4: 0x671a46e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3ec: skipped 000101 1788306819.589658 trunc from 0x01d448 to 0x023ad6 (0x668f bytes) 000102 1788306819.594028 mapwrite 0x03a7d4 thru 0x03ffff (0x582c bytes) 000103 1788306819.717731 mapread 0x00c65d thru 0x016f92 (0xa936 bytes) 000104 1788306819.759815 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcc90695e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa28cde13 Mirror 5: 0xa28cde13 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000105 1788306820.763820 punch from 0x0073bf to 0x00ce54 (0x5a96 bytes) 000107 1788306820.799341 fallocate 0x022aa2 thru 0x026e59 (0x43b8 bytes) 000108 1788306820.805003 trunc from 0x03a43f to 0x03ffff (0x5bc1 bytes) 000109 1788306820.809808 punch from 0x022438 to 0x027289 (0x4e52 bytes) 000110 1788306820.814368 write 0x01c2a0 thru 0x023cc6 (0x7a27 bytes) 000111 1788306820.832179 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa28cde13 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa28cde13 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000112 1788306821.244961 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) 000113 1788306821.460813 read 0x027275 thru 0x02b7e2 (0x456e bytes) 000114 1788306821.474726 write 0x0150c4 thru 0x01d015 (0x7f52 bytes) 000115 1788306821.494950 trunc from 0x040000 to 0x01930a (0x26cf5 bytes) 000117 1788306821.516448 trunc from 0x01930b to 0x03b0c1 (0x21db7 bytes) 000118 1788306821.535716 mapread 0x02e341 thru 0x03553d (0x71fd bytes) 000119 1788306821.557464 read 0x02bc79 thru 0x038cfe (0xd086 bytes) 000120 1788306821.558729 punch from 0x019c7c to 0x01f845 (0x5bca bytes) 000121 1788306821.598036 mapwrite 0x03dcaa thru 0x03ffff (0x2356 bytes) 000122 1788306821.687261 read 0x00ad02 thru 0x017ccd (0xcfcc bytes) 000123 1788306821.718238 fallocate 0x030663 thru 0x037e6a (0x7808 bytes) 000124 1788306821.731253 mapread 0x01a082 thru 0x01e26e (0x41ed bytes) 000125 1788306821.742352 fallocate 0x0266bb thru 0x02dacf (0x7415 bytes) 000126 1788306821.755218 read 0x0257c7 thru 0x030e11 (0xb64b bytes) 000127 1788306821.755954 trunc from 0x040000 to 0x00b571 (0x34a8e bytes) 000128 1788306821.790685 mapread 0x0082b6 thru 0x0093a6 (0x10f1 bytes) 000129 1788306821.795560 mapread 0x003440 thru 0x0094a2 (0x6063 bytes) 000130 1788306821.798759 write 0x0038c0 thru 0x00ba01 (0x8142 bytes) 000131 1788306821.805206 trunc from 0x00ba02 to 0x001276 (0xa78b bytes) 000132 1788306821.845697 read 0x000577 thru 0x001276 (0xd00 bytes) 000133 1788306821.846409 trunc from 0x000361 to 0x001276 (0xf16 bytes) 000134 1788306821.856769 MIRROR_EXTEND to 2 mirrors 000135 1788306822.718177 read 0x0006d4 thru 0x001276 (0xba3 bytes) 000136 1788306822.735839 write 0x02301b thru 0x02a2de (0x72c4 bytes) 000137 1788306822.791935 read 0x014dec thru 0x016b42 (0x1d57 bytes) 000138 1788306822.803745 mapwrite 0x03699f thru 0x03b9a3 (0x5005 bytes) 000139 1788306822.870275 write 0x02cd95 thru 0x0318a0 (0x4b0c bytes) 000140 1788306822.883730 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) 000142 1788306823.176614 mapwrite 0x025365 thru 0x02e574 (0x9210 bytes) 000143 1788306823.316867 write 0x01e766 thru 0x01f072 (0x90d bytes) 000144 1788306823.352245 read 0x02251c thru 0x02a53d (0x8022 bytes) 000145 1788306823.353296 trunc from 0x03b9a4 to 0x02e7e6 (0xd1bd bytes) 000147 1788306823.392426 mapwrite 0x01d67c thru 0x027251 (0x9bd6 bytes) 000148 1788306823.437390 MIRROR_EXTEND to 2 mirrors 000149 1788306824.241890 write 0x0352eb thru 0x03e02f (0x8d45 bytes) 000150 1788306824.353896 punch from 0x014ceb to 0x020cae (0xbfc4 bytes) 000151 1788306824.364389 write 0x02b161 thru 0x033e45 (0x8ce5 bytes) 000152 1788306824.380137 trunc from 0x019224 to 0x01b089 (0x1e66 bytes) 000153 1788306824.398473 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e030): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e030): Mirror 2: 0xf0dc3e0a (stale) CRC-32 checksum value for chunk [0, 0x3e030): Mirror 1: 0xd96a372f Mirror 3: 0xd96a372f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e030: skipped 000154 1788306825.404232 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e030): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e030): Mirror 2: 0xf0dc3e0a (stale) CRC-32 checksum value for chunk [0, 0x3e030): Mirror 1: 0xd96a372f Mirror 3: 0xd96a372f Mirror 4: 0xd96a372f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e030: skipped 000155 1788306826.455722 trunc from 0x03e030 to 0x002a41 (0x3b5ee bytes) 000158 1788306826.573530 write 0x01cff5 thru 0x021d27 (0x4d33 bytes) 000159 1788306826.580637 punch from 0x01da7f to 0x021d27 (0x42a9 bytes) 000160 1788306826.605392 trunc from 0x00eadb to 0x0136b1 (0x4bd7 bytes) 000161 1788306826.617193 MIRROR_RESYNC 4 mirrors 000162 1788306827.731968 read 0x02101c thru 0x021d27 (0xd0c bytes) 000163 1788306827.744616 write 0x03c375 thru 0x03d576 (0x1202 bytes) 000165 1788306827.814111 fallocate 0x02b862 thru 0x03093a (0x50d9 bytes) 000166 1788306827.823854 write 0x01bf4c thru 0x01dd2a (0x1ddf bytes) 000167 1788306827.853862 MIRROR_RESYNC 4 mirrors 000168 1788306829.297800 read 0x036ffe thru 0x03a167 (0x316a bytes) 000169 1788306829.312923 fallocate 0x02d88e thru 0x031b33 (0x42a6 bytes) 000170 1788306829.367139 read 0x006036 thru 0x006878 (0x843 bytes) 000171 1788306829.395281 write 0x0388a5 thru 0x03eace (0x622a bytes) 000172 1788306829.404276 MIRROR_RESYNC 4 mirrors 000174 1788306830.564514 read 0x0315ba thru 0x031b5d (0x5a4 bytes) 000175 1788306830.570790 trunc from 0x03eacf to 0x00b3fd (0x336d1 bytes) 000176 1788306830.609010 trunc from 0x0077d5 to 0x00b3fd (0x3c29 bytes) 000177 1788306830.613276 write 0x0047d8 thru 0x0129f5 (0xe21e bytes) 000178 1788306830.625168 trunc from 0x0129f6 to 0x02f377 (0x1c982 bytes) 000179 1788306830.651504 fallocate 0x0351a4 thru 0x03a562 (0x53bf bytes) 000180 1788306830.655553 trunc from 0x01cf95 to 0x026885 (0x98f1 bytes) 000181 1788306830.663963 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2f378): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f378): Mirror 2: 0xf2831415 (stale) Mirror 3: 0xf2831415 (stale) Mirror 4: 0xf2831415 (stale) CRC-32 checksum value for chunk [0, 0x2f378): Mirror 1: 0x84d7c80f Mirror 5: 0x84d7c80f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f378: skipped 000183 1788306831.676322 mapread 0x006396 thru 0x01617d (0xfde8 bytes) 000184 1788306831.738448 fallocate 0x031499 thru 0x03230e (0xe76 bytes) 000187 1788306831.814151 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3230f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3230f): Mirror 2: 0x516856e1 (stale) Mirror 3: 0x516856e1 (stale) Mirror 4: 0x516856e1 (stale) Mirror 5: 0x1d1575e0 (stale) CRC-32 checksum value for chunk [0, 0x3230f): Mirror 1: 0x1d1575e0 Mirror 6: 0x1d1575e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3230f: skipped 000188 1788306832.952026 trunc from 0x007e30 to 0x014ad7 (0xcca8 bytes) 000189 1788306833.003367 read 0x02ed2a thru 0x03230e (0x35e5 bytes) 000190 1788306833.030746 fallocate 0x023c2e thru 0x025229 (0x15fc bytes) 000191 1788306833.047360 trunc from 0x002d45 to 0x007663 (0x491f bytes) 000192 1788306833.064880 read 0x00f9e3 thru 0x01d523 (0xdb41 bytes) 000193 1788306833.104975 punch from 0x015162 to 0x020bc0 (0xba5f bytes) 000194 1788306833.111135 trunc from 0x00ed6b to 0x01d469 (0xe6ff bytes) 000195 1788306833.116977 mapwrite 0x020521 thru 0x023627 (0x3107 bytes) 000196 1788306833.144800 fallocate 0x003eb7 thru 0x01011b (0xc265 bytes) 000197 1788306833.152589 mapwrite 0x011b04 thru 0x01a472 (0x896f bytes) 000198 1788306833.295948 mapread 0x0081ab thru 0x011582 (0x93d8 bytes) 000199 1788306833.327885 write 0x01c266 thru 0x0218cf (0x566a bytes) 000201 1788306833.346009 punch from 0x013b7d to 0x0153f6 (0x187a bytes) 000202 1788306833.361946 write 0x03a02b thru 0x03ffff (0x5fd5 bytes) 000203 1788306833.378515 MIRROR_RESYNC 6 mirrors 000204 1788306835.559671 write 0x01d7a4 thru 0x02bb83 (0xe3e0 bytes) 000205 1788306835.603228 fallocate 0x02fcb7 thru 0x03f002 (0xf34c bytes) 000206 1788306835.617377 write 0x03467c thru 0x03ffff (0xb984 bytes) 000207 1788306835.631159 punch from 0x01022c to 0x010beb (0x9c0 bytes) 000208 1788306835.644574 read 0x023f99 thru 0x0285c9 (0x4631 bytes) 000209 1788306835.655478 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x24c6fff5 (stale) Mirror 3: 0x24c6fff5 (stale) Mirror 5: 0x24c6fff5 (stale) Mirror 6: 0x24c6fff5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x24c6fff5 (stale) Mirror 3: 0x24c6fff5 (stale) Mirror 5: 0x24c6fff5 (stale) Mirror 6: 0x24c6fff5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000210 1788306836.053232 read 0x01edeb thru 0x025561 (0x6777 bytes) 000211 1788306836.066474 write 0x004507 thru 0x007c01 (0x36fb bytes) 000212 1788306836.080963 trunc from 0x0331ad to 0x034ae5 (0x1939 bytes) 000213 1788306836.086472 mapread 0x036570 thru 0x03ffff (0x9a90 bytes) 000214 1788306836.105222 trunc from 0x0099ac to 0x01439e (0xa9f3 bytes) 000215 1788306836.110024 mapread 0x0339c5 thru 0x0347ad (0xde9 bytes) 000216 1788306836.111983 punch from 0x01fc82 to 0x029588 (0x9907 bytes) 000218 1788306836.122254 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x24c6fff5 (stale) Mirror 5: 0x24c6fff5 (stale) Mirror 6: 0x24c6fff5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x24c6fff5 (stale) Mirror 5: 0x24c6fff5 (stale) Mirror 6: 0x24c6fff5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000220 1788306836.610721 trunc from 0x040000 to 0x03decd (0x2132 bytes) 000221 1788306836.635848 fallocate 0x01458c thru 0x023626 (0xf09b bytes) 000222 1788306836.641887 write 0x02dd21 thru 0x03693b (0x8c1b bytes) 000223 1788306836.655492 mapwrite 0x034234 thru 0x03762b (0x33f8 bytes) 000224 1788306836.688384 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3dece): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dece): Mirror 3: 0x52367c26 (stale) Mirror 5: 0x52367c26 (stale) Mirror 6: 0x52367c26 (stale) CRC-32 checksum value for chunk [0, 0x3dece): Mirror 1: 0xac76c0ad Mirror 7: 0xac76c0ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dece: skipped 000225 1788306837.579850 fallocate 0x015575 thru 0x018e84 (0x3910 bytes) 000226 1788306837.625845 read 0x01092a thru 0x0199b5 (0x908c bytes) 000227 1788306837.636506 write 0x00f4c2 thru 0x01ccf9 (0xd838 bytes) 000228 1788306837.651190 write 0x03e01b thru 0x03ffff (0x1fe5 bytes) 000229 1788306837.660837 MIRROR_RESYNC 5 mirrors 000230 1788306839.408763 write 0x02e070 thru 0x03b0c2 (0xd053 bytes) 000231 1788306839.458470 write 0x039b3f thru 0x03ffff (0x64c1 bytes) 000232 1788306839.459614 write 0x006e4c thru 0x015e03 (0xefb8 bytes) 000233 1788306839.477733 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc70d9508 (stale) Mirror 5: 0xc70d9508 (stale) Mirror 6: 0xc70d9508 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc70d9508 (stale) Mirror 5: 0xc70d9508 (stale) Mirror 6: 0xc70d9508 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000234 1788306839.885369 trunc from 0x0251a2 to 0x030860 (0xb6bf bytes) 000235 1788306839.892229 fallocate 0x01ede9 thru 0x02ad76 (0xbf8e bytes) 000236 1788306839.901886 trunc from 0x039495 to 0x03ffff (0x6b6b bytes) 000237 1788306839.909416 punch from 0x0267d3 to 0x0286ea (0x1f18 bytes) 000239 1788306839.915353 mapwrite 0x02987d thru 0x02f801 (0x5f85 bytes) 000240 1788306839.974002 trunc from 0x040000 to 0x039ae2 (0x651d bytes) 000241 1788306840.002324 trunc from 0x039ae3 to 0x02c502 (0xd5e0 bytes) 000242 1788306840.023177 fallocate 0x02915f thru 0x0384e0 (0xf382 bytes) 000244 1788306840.038853 trunc from 0x00f597 to 0x01c505 (0xcf6f bytes) 000245 1788306840.045361 mapwrite 0x0372ff thru 0x03ffff (0x8d01 bytes) 000246 1788306840.110263 write 0x0374f0 thru 0x03db27 (0x6638 bytes) 000247 1788306840.113788 mapread 0x0344b8 thru 0x03c129 (0x7c72 bytes) 000248 1788306840.115019 read 0x02160d thru 0x02f22a (0xdc1e bytes) 000249 1788306840.128268 punch from 0x01344f to 0x01f8ea (0xc49c bytes) 000250 1788306840.137963 mapread 0x027d0c thru 0x02c200 (0x44f5 bytes) 000251 1788306840.139363 trunc from 0x035712 to 0x03ffff (0xa8ee bytes) 000252 1788306840.156968 trunc from 0x0203b0 to 0x0250ad (0x4cfe bytes) 000253 1788306840.163019 mapwrite 0x019cc9 thru 0x022653 (0x898b bytes) 000254 1788306840.221249 read 0x023b71 thru 0x02501c (0x14ac bytes) 000255 1788306840.222234 punch from 0x01127c to 0x01a45c (0x91e1 bytes) 000256 1788306840.229656 fallocate 0x003a30 thru 0x0066cb (0x2c9c bytes) 000257 1788306840.241496 mapwrite 0x012a37 thru 0x0197ed (0x6db7 bytes) 000258 1788306840.274346 trunc from 0x040000 to 0x035e62 (0xa19d bytes) 000259 1788306840.295943 fallocate 0x029c14 thru 0x02d44a (0x3837 bytes) 000260 1788306840.301902 trunc from 0x035e63 to 0x01b2b3 (0x1abaf bytes) 000261 1788306840.320786 write 0x003382 thru 0x00f982 (0xc601 bytes) 000262 1788306840.329002 read 0x015bf1 thru 0x01b2b3 (0x56c3 bytes) 000263 1788306840.335159 MIRROR_RESYNC 4 mirrors 000264 1788306841.523752 mapwrite 0x01ce7a thru 0x01e3f9 (0x1580 bytes) 000265 1788306841.614828 fallocate 0x02a6f7 thru 0x0355aa (0xaeb4 bytes) 000266 1788306841.622997 trunc from 0x01e3fa to 0x0344a1 (0x160a8 bytes) 000268 1788306841.657161 fallocate 0x02d2cd thru 0x02ef7f (0x1cb3 bytes) 000269 1788306841.663377 punch from 0x026033 to 0x02c4f5 (0x64c3 bytes) 000270 1788306841.667897 mapread 0x0283ac thru 0x0305da (0x822f bytes) 000271 1788306841.681308 write 0x002520 thru 0x00e4ff (0xbfe0 bytes) 000272 1788306841.693179 mapwrite 0x01cb63 thru 0x028de4 (0xc282 bytes) 000274 1788306841.725256 mapread 0x02455d thru 0x029292 (0x4d36 bytes) 000275 1788306841.726362 trunc from 0x028be7 to 0x02c160 (0x357a bytes) 000276 1788306841.733138 mapwrite 0x00ff6d thru 0x016f43 (0x6fd7 bytes) 000277 1788306841.762817 mapread 0x004d33 thru 0x00a280 (0x554e bytes) 000278 1788306841.763902 trunc from 0x003e26 to 0x007cc3 (0x3e9e bytes) 000279 1788306841.773091 fallocate 0x0016ea thru 0x00c46a (0xad81 bytes) 000280 1788306841.778554 read 0x01b48d thru 0x022a9a (0x760e bytes) 000281 1788306841.779154 trunc from 0x0344a2 to 0x00def0 (0x265b1 bytes) 000282 1788306841.806265 mapread 0x00db7d thru 0x00def0 (0x374 bytes) 000283 1788306841.809036 fallocate 0x02dad5 thru 0x039977 (0xbea3 bytes) 000284 1788306841.815617 mapread 0x009112 thru 0x00cc69 (0x3b58 bytes) 000285 1788306841.817259 write 0x02ae77 thru 0x03726e (0xc3f8 bytes) 000286 1788306841.820751 mapread 0x019e27 thru 0x027737 (0xd911 bytes) 000287 1788306841.840290 punch from 0x01867f to 0x01d680 (0x5002 bytes) 000288 1788306841.848012 trunc from 0x03726f to 0x02c842 (0xaa2c bytes) 000289 1788306841.877170 MIRROR_RESYNC 4 mirrors 000290 1788306842.787895 mapread 0x027d41 thru 0x029c2a (0x1eea bytes) 000291 1788306842.812985 punch from 0x02aa66 to 0x02c842 (0x1ddd bytes) 000292 1788306842.852897 trunc from 0x02c843 to 0x0000c5 (0x2c77d bytes) 000293 1788306842.886589 punch from 0x000047 to 0x0000c5 (0x7f bytes) 000294 1788306842.892387 fallocate 0x0339d7 thru 0x033f5d (0x587 bytes) 000295 1788306842.898712 mapread 0x00002a thru 0x0000c5 (0x9c bytes) 000296 1788306842.905294 trunc from 0x0000c6 to 0x01e7fb (0x1e736 bytes) 000297 1788306842.925528 trunc from 0x01e7fc to 0x019a4c (0x4daf bytes) 000298 1788306842.950291 MIRROR_RESYNC 4 mirrors 000299 1788306843.611785 MIRROR_RESYNC 4 mirrors 000300 1788306843.951645 write 0x01002f thru 0x018a66 (0x8a38 bytes) 000301 1788306843.985905 read 0x007db3 thru 0x010451 (0x869f bytes) 000302 1788306843.994404 write 0x0179f5 thru 0x0256b7 (0xdcc3 bytes) 000303 1788306844.000465 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x256b8): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x256b8): Mirror 3: 0xe95791ff (stale) Mirror 5: 0xe95791ff (stale) Mirror 6: 0xe95791ff (stale) CRC-32 checksum value for chunk [0, 0x256b8): Mirror 1: 0x21bd59de Mirror 7: 0x21bd59de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x256b8: skipped 000304 1788306844.954427 read 0x01b820 thru 0x020f35 (0x5716 bytes) 000305 1788306844.976009 fallocate 0x03a3dc thru 0x03d9d1 (0x35f6 bytes) 000306 1788306845.017034 read 0x01781c thru 0x01ca97 (0x527c bytes) 000307 1788306845.027820 read 0x01c8ef thru 0x0256b7 (0x8dc9 bytes) 000308 1788306845.028627 trunc from 0x022987 to 0x0256b7 (0x2d31 bytes) 000309 1788306845.038336 mapread 0x00d764 thru 0x019a99 (0xc336 bytes) 000310 1788306845.040855 fallocate 0x00371c thru 0x0073e0 (0x3cc5 bytes) 000312 1788306845.047387 trunc from 0x019ce2 to 0x01b62e (0x194d bytes) 000313 1788306845.057273 punch from 0x00dfc6 to 0x016a27 (0x8a62 bytes) 000314 1788306845.066887 write 0x03788e thru 0x03dfc9 (0x673c bytes) 000315 1788306845.082297 read 0x02c52c thru 0x02c660 (0x135 bytes) 000316 1788306845.093995 trunc from 0x03dfca to 0x00cb00 (0x314c9 bytes) 000317 1788306845.120665 trunc from 0x00980b to 0x00cb00 (0x32f6 bytes) 000318 1788306845.130166 mapread 0x00bb45 thru 0x00cb00 (0xfbc bytes) 000319 1788306845.175306 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcb01): Mirror 3: 0x5d53b016 (stale) Mirror 6: 0x5d53b016 (stale) Mirror 7: 0x5d53b016 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcb01): Mirror 3: 0x5d53b016 (stale) Mirror 6: 0x5d53b016 (stale) Mirror 7: 0x5d53b016 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcb01: skipped 000320 1788306845.640389 mapwrite 0x03d2bb thru 0x03ffff (0x2d45 bytes) 000321 1788306845.692338 mapwrite 0x011b9b thru 0x0209b1 (0xee17 bytes) 000323 1788306845.750247 MIRROR_RESYNC 4 mirrors 000325 1788306846.713975 write 0x0105fd thru 0x019d9d (0x97a1 bytes) 000326 1788306846.760176 fallocate 0x0157b4 thru 0x01eec2 (0x970f bytes) 000327 1788306846.766453 write 0x001781 thru 0x00b17a (0x99fa bytes) 000328 1788306846.790823 MIRROR_RESYNC 4 mirrors 000329 1788306847.869961 MIRROR_RESYNC 4 mirrors 000331 1788306848.383573 mapwrite 0x00b109 thru 0x00dcf9 (0x2bf1 bytes) 000332 1788306848.529956 mapread 0x0363da thru 0x03dd83 (0x79aa bytes) 000333 1788306848.545037 punch from 0x0075d0 to 0x00f083 (0x7ab4 bytes) 000334 1788306848.555358 fallocate 0x0348af thru 0x03ffff (0xb751 bytes) 000336 1788306848.563329 mapread 0x016541 thru 0x01f41b (0x8edb bytes) 000337 1788306848.584769 fallocate 0x02e59a thru 0x0396fd (0xb164 bytes) 000338 1788306848.603031 write 0x009ce8 thru 0x010e01 (0x711a bytes) 000339 1788306848.625208 punch from 0x021879 to 0x030b3d (0xf2c5 bytes) 000340 1788306848.634929 trunc from 0x040000 to 0x023319 (0x1cce6 bytes) 000341 1788306848.670687 mapwrite 0x0288fc thru 0x02eba7 (0x62ac bytes) 000342 1788306848.730819 read 0x01aedb thru 0x02aa62 (0xfb88 bytes) 000343 1788306848.731837 trunc from 0x01a691 to 0x01efb3 (0x4923 bytes) 000344 1788306848.738003 fallocate 0x021d10 thru 0x023bb5 (0x1ea6 bytes) 000345 1788306848.742777 fallocate 0x024efa thru 0x02a5f7 (0x56fe bytes) 000346 1788306848.747785 read 0x01203d thru 0x01b228 (0x91ec bytes) 000347 1788306848.757068 trunc from 0x02eba8 to 0x02496a (0xa23d bytes) 000348 1788306848.772646 mapwrite 0x033389 thru 0x03b4bc (0x8134 bytes) 000349 1788306848.823010 trunc from 0x03b4bd to 0x00fa16 (0x2baa6 bytes) 000351 1788306848.846977 mapwrite 0x02be95 thru 0x02d962 (0x1ace bytes) 000352 1788306848.921002 fallocate 0x036870 thru 0x03a730 (0x3ec1 bytes) 000354 1788306848.927948 fallocate 0x00cb72 thru 0x019a2f (0xcebe bytes) 000355 1788306848.934240 mapwrite 0x037a03 thru 0x03ffff (0x85fd bytes) 000357 1788306849.033788 mapwrite 0x006e59 thru 0x00db05 (0x6cad bytes) 000358 1788306849.079010 read 0x038fff thru 0x03b13a (0x213c bytes) 000359 1788306849.083023 mapread 0x01e928 thru 0x0282e4 (0x99bd bytes) 000360 1788306849.141315 mapwrite 0x03560d thru 0x03ca72 (0x7466 bytes) 000361 1788306849.171266 read 0x03ec18 thru 0x03ffff (0x13e8 bytes) 000362 1788306849.185151 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x6be993d7 (stale) Mirror 7: 0x6be993d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x6be993d7 (stale) Mirror 7: 0x6be993d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000363 1788306849.544652 punch from 0x0040f0 to 0x008136 (0x4047 bytes) 000365 1788306849.561988 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x6be993d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x6be993d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000366 1788306849.894303 mapwrite 0x0054fc thru 0x008f73 (0x3a78 bytes) 000367 1788306849.945016 trunc from 0x02c3d4 to 0x0315ac (0x51d9 bytes) 000368 1788306849.951409 fallocate 0x03c9f0 thru 0x03ffff (0x3610 bytes) 000369 1788306849.957005 write 0x003038 thru 0x01135e (0xe327 bytes) 000370 1788306849.971652 trunc from 0x040000 to 0x026bd7 (0x19428 bytes) 000371 1788306849.994618 punch from 0x001384 to 0x001bd6 (0x853 bytes) 000372 1788306850.007911 read 0x004eda thru 0x00cfc3 (0x80ea bytes) 000373 1788306850.009166 mapwrite 0x00ae3f thru 0x00c335 (0x14f7 bytes) 000374 1788306850.032757 mapwrite 0x026497 thru 0x0270a9 (0xc13 bytes) 000375 1788306850.078946 fallocate 0x03f43f thru 0x03ffff (0xbc1 bytes) 000378 1788306850.102788 MIRROR_RESYNC 2 mirrors 000379 1788306850.764413 MIRROR_RESYNC 2 mirrors 000380 1788306851.114940 mapwrite 0x0315e5 thru 0x03361e (0x203a bytes) 000381 1788306851.219460 read 0x00ac7b thru 0x00f4fc (0x4882 bytes) 000382 1788306851.227777 read 0x00b62f thru 0x010923 (0x52f5 bytes) 000383 1788306851.238833 punch from 0x03162e to 0x03361e (0x1ff1 bytes) 000384 1788306851.244851 trunc from 0x03361f to 0x01f94e (0x13cd0 bytes) 000385 1788306851.272396 read 0x00ca05 thru 0x014080 (0x767c bytes) 000386 1788306851.274648 trunc from 0x002a0a to 0x00a569 (0x7b60 bytes) 000387 1788306851.283846 mapwrite 0x0355b1 thru 0x03ffff (0xaa4f bytes) 000388 1788306851.376156 punch from 0x00a65e to 0x010f6a (0x690d bytes) 000389 1788306851.383652 mapread 0x020aa8 thru 0x02a9fb (0x9f54 bytes) 000390 1788306851.385745 read 0x004084 thru 0x0090e5 (0x5062 bytes) 000392 1788306851.387356 punch from 0x01be38 to 0x02b2d1 (0xf49a bytes) 000393 1788306851.394019 write 0x006bca thru 0x00f018 (0x844f bytes) 000394 1788306851.405292 mapwrite 0x00a2e2 thru 0x0122aa (0x7fc9 bytes) 000395 1788306851.535528 mapwrite 0x013f2e thru 0x018c10 (0x4ce3 bytes) 000396 1788306851.605699 punch from 0x03536e to 0x03ffff (0xac92 bytes) 000397 1788306851.621185 trunc from 0x03418d to 0x03aa5d (0x68d1 bytes) 000399 1788306851.655327 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5ef4d18f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x21a89a05 Mirror 8: 0x21a89a05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000400 1788306852.979628 trunc from 0x038ea8 to 0x03ffff (0x7158 bytes) 000401 1788306853.058206 read 0x03d953 thru 0x03ffff (0x26ad bytes) 000402 1788306853.075902 trunc from 0x00b5d8 to 0x00bfd7 (0xa00 bytes) 000404 1788306853.096131 write 0x03f70b thru 0x03ffff (0x8f5 bytes) 000405 1788306853.106647 fallocate 0x03dca2 thru 0x03ffff (0x235e bytes) 000406 1788306853.136414 write 0x00ed1e thru 0x01dd35 (0xf018 bytes) 000407 1788306853.170029 punch from 0x03085a to 0x035232 (0x49d9 bytes) 000408 1788306853.181141 punch from 0x00fc43 to 0x01909f (0x945d bytes) 000409 1788306853.217167 read 0x00fd86 thru 0x0115fa (0x1875 bytes) 000410 1788306853.232702 mapwrite 0x013475 thru 0x022976 (0xf502 bytes) 000411 1788306853.265384 mapread 0x0180cc thru 0x01aba4 (0x2ad9 bytes) 000412 1788306853.266959 fallocate 0x015a9a thru 0x0201f0 (0xa757 bytes) 000413 1788306853.276925 trunc from 0x0023ed to 0x009912 (0x7526 bytes) 000414 1788306853.283986 write 0x02ff6c thru 0x038f7e (0x9013 bytes) 000416 1788306853.287495 write 0x004604 thru 0x010da4 (0xc7a1 bytes) 000417 1788306853.296475 trunc from 0x040000 to 0x018954 (0x276ab bytes) 000418 1788306853.344563 fallocate 0x034708 thru 0x037734 (0x302d bytes) 000419 1788306853.353450 trunc from 0x037735 to 0x039c12 (0x24de bytes) 000420 1788306853.380189 read 0x02de83 thru 0x031917 (0x3a95 bytes) 000421 1788306853.431270 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39c13): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c13): Mirror 7: 0xc6ab40fe (stale) Mirror 8: 0x47a4a360 (stale) CRC-32 checksum value for chunk [0, 0x39c13): Mirror 1: 0x650300f3 Mirror 9: 0x650300f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c13: skipped 000422 1788306854.900711 write 0x02de4d thru 0x035898 (0x7a4c bytes) 000423 1788306854.973797 MIRROR_RESYNC 4 mirrors 000424 1788306856.912912 punch from 0x0028cc to 0x00e0b0 (0xb7e5 bytes) 000425 1788306856.981217 mapwrite 0x01ecd3 thru 0x0215c9 (0x28f7 bytes) 000426 1788306857.035335 trunc from 0x0053d4 to 0x00bd7b (0x69a8 bytes) 000427 1788306857.042808 punch from 0x036afe to 0x036d38 (0x23b bytes) 000428 1788306857.048949 trunc from 0x020240 to 0x024752 (0x4513 bytes) 000429 1788306857.056765 write 0x02a869 thru 0x035ca1 (0xb439 bytes) 000430 1788306857.069631 fallocate 0x00ed84 thru 0x019185 (0xa402 bytes) 000431 1788306857.075278 trunc from 0x00b97a to 0x012faa (0x7631 bytes) 000432 1788306857.085795 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39c13): Mirror 8: 0x2741a51a (stale) Mirror 9: 0x2741a51a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c13): Mirror 8: 0x2741a51a (stale) Mirror 9: 0x2741a51a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c13: skipped 000433 1788306857.587823 write 0x01a3f7 thru 0x02656c (0xc176 bytes) 000434 1788306857.621019 mapread 0x014859 thru 0x017ed9 (0x3681 bytes) 000435 1788306857.679670 write 0x0327a4 thru 0x03ffff (0xd85c bytes) 000436 1788306857.696270 read 0x02ea1b thru 0x03474b (0x5d31 bytes) 000437 1788306857.705774 mapread 0x0167b9 thru 0x019811 (0x3059 bytes) 000438 1788306857.706839 mapwrite 0x004647 thru 0x0063e6 (0x1da0 bytes) 000439 1788306857.753450 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf6c41df2 (stale) Mirror 9: 0xf6c41df2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x626e14b0 Mirror 10: 0x626e14b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000440 1788306859.360653 fallocate 0x02360e thru 0x023c3f (0x632 bytes) 000441 1788306859.440790 punch from 0x026ce2 to 0x035671 (0xe990 bytes) 000442 1788306859.452599 fallocate 0x0366b7 thru 0x038050 (0x199a bytes) 000443 1788306859.458532 read 0x03af6d thru 0x03ffff (0x5093 bytes) 000444 1788306859.486229 fallocate 0x02ebef thru 0x033c5a (0x506c bytes) 000445 1788306859.501168 mapread 0x02a2d2 thru 0x035c88 (0xb9b7 bytes) 000446 1788306859.542164 write 0x01ee87 thru 0x028b87 (0x9d01 bytes) 000447 1788306859.555348 punch from 0x0277ff to 0x027e51 (0x653 bytes) 000449 1788306859.569616 punch from 0x0186db to 0x019112 (0xa38 bytes) 000450 1788306859.577700 write 0x02ecef thru 0x03ae8e (0xc1a0 bytes) 000451 1788306859.581415 punch from 0x009603 to 0x00b872 (0x2270 bytes) 000453 1788306859.590490 punch from 0x00ef5f to 0x018e83 (0x9f25 bytes) 000454 1788306859.605035 trunc from 0x040000 to 0x025c97 (0x1a368 bytes) 000455 1788306859.628357 read 0x0140c8 thru 0x01e47c (0xa3b5 bytes) 000456 1788306859.640029 write 0x0281a8 thru 0x036a0d (0xe866 bytes) 000457 1788306859.643661 fallocate 0x01ef10 thru 0x021428 (0x2519 bytes) 000458 1788306859.648950 write 0x0079ba thru 0x00b2d3 (0x391a bytes) 000459 1788306859.651751 punch from 0x02acd3 to 0x03160f (0x693d bytes) 000460 1788306859.669483 mapwrite 0x013912 thru 0x0155db (0x1cca bytes) 000461 1788306859.689141 trunc from 0x007567 to 0x00e598 (0x7032 bytes) 000462 1788306859.696852 write 0x03b02a thru 0x03ffff (0x4fd6 bytes) 000463 1788306859.702543 trunc from 0x040000 to 0x03f26a (0xd95 bytes) 000464 1788306859.720013 mapread 0x038622 thru 0x03f26a (0x6c49 bytes) 000465 1788306859.732692 trunc from 0x03f26b to 0x0177e5 (0x27a85 bytes) 000466 1788306859.767821 MIRROR_RESYNC 4 mirrors 000467 1788306861.216400 fallocate 0x00a5ef thru 0x017ece (0xd8e0 bytes) 000468 1788306861.244015 fallocate 0x0043cf thru 0x005f95 (0x1bc7 bytes) 000469 1788306861.250484 mapwrite 0x024849 thru 0x02c9be (0x8176 bytes) 000470 1788306861.316982 mapread 0x02616c thru 0x02689d (0x732 bytes) 000471 1788306861.318396 punch from 0x01731f to 0x017d88 (0xa6a bytes) 000472 1788306861.324370 trunc from 0x011c13 to 0x01d1d5 (0xb5c3 bytes) 000473 1788306861.329464 trunc from 0x00af4f to 0x00d85f (0x2911 bytes) 000474 1788306861.334475 mapread 0x00dc67 thru 0x01b7b0 (0xdb4a bytes) 000475 1788306861.358864 fallocate 0x0322c1 thru 0x03ffff (0xdd3f bytes) 000476 1788306861.364747 mapread 0x011288 thru 0x01ce91 (0xbc0a bytes) 000477 1788306861.371495 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2c9bf): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c9bf): Mirror 8: 0x2f20864d (stale) Mirror 9: 0x2f20864d (stale) Mirror 10: 0x2f20864d (stale) CRC-32 checksum value for chunk [0, 0x2c9bf): Mirror 1: 0x9cd80a2f Mirror 11: 0x9cd80a2f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c9bf: skipped 000478 1788306862.211844 write 0x007798 thru 0x014415 (0xcc7e bytes) 000479 1788306862.271612 fallocate 0x0002fb thru 0x00319b (0x2ea1 bytes) 000481 1788306862.278236 mapwrite 0x0072b3 thru 0x00c168 (0x4eb6 bytes) 000482 1788306862.298712 trunc from 0x02c9bf to 0x01b08d (0x11931 bytes) 000483 1788306862.340355 punch from 0x0168e7 to 0x01b08d (0x47a7 bytes) 000484 1788306862.345908 trunc from 0x0001bf to 0x00eebf (0xed01 bytes) 000485 1788306862.352222 read 0x008ddf thru 0x0166c5 (0xd8e7 bytes) 000486 1788306862.362392 fallocate 0x017310 thru 0x01ea85 (0x7776 bytes) 000487 1788306862.367465 mapread 0x0009f1 thru 0x005e66 (0x5476 bytes) 000488 1788306862.391932 mapread 0x00932e thru 0x009b0e (0x7e1 bytes) 000489 1788306862.393000 punch from 0x00d310 to 0x017640 (0xa331 bytes) 000490 1788306862.400423 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ea86): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea86): Mirror 8: 0x8e0862c3 (stale) Mirror 9: 0x8e0862c3 (stale) Mirror 10: 0x8e0862c3 (stale) Mirror 11: 0x580b13b8 (stale) CRC-32 checksum value for chunk [0, 0x1ea86): Mirror 1: 0x44221dd5 Mirror 12: 0x44221dd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea86: skipped 000491 1788306863.501088 trunc from 0x01ea86 to 0x02bba8 (0xd123 bytes) 000492 1788306863.611723 mapread 0x004145 thru 0x0085d7 (0x4493 bytes) 000493 1788306863.640975 fallocate 0x00f910 thru 0x01ce16 (0xd507 bytes) 000494 1788306863.653975 punch from 0x018ebc to 0x0239c5 (0xab0a bytes) 000496 1788306863.665030 read 0x01bf19 thru 0x024c6d (0x8d55 bytes) 000497 1788306863.685403 trunc from 0x02361e to 0x029279 (0x5c5c bytes) 000499 1788306863.701494 trunc from 0x004b39 to 0x00cdfa (0x82c2 bytes) 000500 1788306863.725014 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2bba9): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bba9): Mirror 8: 0x4ab4be2b (stale) Mirror 9: 0x4ab4be2b (stale) Mirror 10: 0x4ab4be2b (stale) Mirror 11: 0x24fed6b4 (stale) Mirror 12: 0x72108777 (stale) CRC-32 checksum value for chunk [0, 0x2bba9): Mirror 1: 0x72108777 Mirror 13: 0x72108777 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bba9: skipped 000501 1788306864.944360 punch from 0x01466c to 0x014a10 (0x3a5 bytes) 000503 1788306865.059673 mapread 0x004dc4 thru 0x007e21 (0x305e bytes) 000505 1788306865.115005 mapread 0x02398c thru 0x02bba8 (0x821d bytes) 000506 1788306865.147260 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bba9): Mirror 8: 0x4ab4be2b (stale) Mirror 9: 0x4ab4be2b (stale) Mirror 10: 0x4ab4be2b (stale) Mirror 11: 0x24fed6b4 (stale) Mirror 13: 0x72108777 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bba9): Mirror 8: 0x4ab4be2b (stale) Mirror 9: 0x4ab4be2b (stale) Mirror 10: 0x4ab4be2b (stale) Mirror 11: 0x24fed6b4 (stale) Mirror 13: 0x72108777 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bba9: skipped 000507 1788306865.830019 trunc from 0x02bba9 to 0x014a1a (0x1718e bytes) 000508 1788306865.860594 trunc from 0x014a1b to 0x025383 (0x10969 bytes) 000509 1788306865.887729 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x25384): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25384): Mirror 8: 0x3a18a1b9 (stale) Mirror 9: 0x3a18a1b9 (stale) Mirror 10: 0x3a18a1b9 (stale) Mirror 11: 0x81a950d (stale) Mirror 13: 0xa57c401b (stale) CRC-32 checksum value for chunk [0, 0x25384): Mirror 1: 0xa57c401b Mirror 14: 0xa57c401b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25384: skipped 000510 1788306866.969359 read 0x01b2e8 thru 0x01f4bd (0x41d6 bytes) 000512 1788306867.012359 mapwrite 0x004513 thru 0x00d73f (0x922d bytes) 000513 1788306867.146830 fallocate 0x03cf1f thru 0x03ee84 (0x1f66 bytes) 000514 1788306867.154631 mapread 0x010d12 thru 0x0121da (0x14c9 bytes) 000516 1788306867.168923 mapwrite 0x00e519 thru 0x010c09 (0x26f1 bytes) 000517 1788306867.189275 trunc from 0x03ee85 to 0x00be32 (0x33052 bytes) 000518 1788306867.224881 trunc from 0x001b97 to 0x006082 (0x44ec bytes) 000519 1788306867.231922 trunc from 0x0003d0 to 0x00be32 (0xba63 bytes) 000520 1788306867.237123 fallocate 0x0217f7 thru 0x0292a3 (0x7aad bytes) 000522 1788306867.254348 MIRROR_RESYNC 7 mirrors 000524 1788306868.601837 fallocate 0x01bd1e thru 0x02a7b2 (0xea95 bytes) 000525 1788306868.654532 write 0x01bb3a thru 0x0271b8 (0xb67f bytes) 000526 1788306868.659002 read 0x012724 thru 0x0179fa (0x52d7 bytes) 000528 1788306868.670351 trunc from 0x005670 to 0x01540d (0xfd9e bytes) 000529 1788306868.680495 fallocate 0x00d1a5 thru 0x0165a2 (0x93fe bytes) 000530 1788306868.701211 MIRROR_RESYNC 7 mirrors 000531 1788306869.881464 mapwrite 0x02f60b thru 0x039414 (0x9e0a bytes) 000532 1788306869.983390 fallocate 0x01b299 thru 0x01d184 (0x1eec bytes) 000533 1788306869.989618 trunc from 0x039415 to 0x015b0b (0x23909 bytes) 000534 1788306870.019484 trunc from 0x015b0c to 0x017d36 (0x222b bytes) 000535 1788306870.039354 trunc from 0x004e1f to 0x0099bb (0x4b9d bytes) 000537 1788306870.054513 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17d37): Mirror 8: 0x675ed562 (stale) Mirror 9: 0x675ed562 (stale) Mirror 10: 0x675ed562 (stale) Mirror 11: 0x675ed562 (stale) Mirror 13: 0x675ed562 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17d37): Mirror 8: 0x675ed562 (stale) Mirror 9: 0x675ed562 (stale) Mirror 10: 0x675ed562 (stale) Mirror 11: 0x675ed562 (stale) Mirror 13: 0x675ed562 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17d37: skipped 000538 1788306870.632188 read 0x00cbfb thru 0x013efe (0x7304 bytes) 000539 1788306870.643712 write 0x0341e7 thru 0x03e30e (0xa128 bytes) 000540 1788306870.652631 read 0x036d26 thru 0x03789b (0xb76 bytes) 000541 1788306870.654468 fallocate 0x004406 thru 0x008420 (0x401b bytes) 000542 1788306870.660870 read 0x03d919 thru 0x03e30e (0x9f6 bytes) 000543 1788306870.661946 write 0x00d2b7 thru 0x013417 (0x6161 bytes) 000545 1788306870.665275 read 0x024d3a thru 0x028509 (0x37d0 bytes) 000546 1788306870.685465 trunc from 0x03e30f to 0x03fbbd (0x18af bytes) 000547 1788306870.700914 fallocate 0x02cf36 thru 0x039f3e (0xd009 bytes) 000548 1788306870.713930 MIRROR_RESYNC 6 mirrors 000549 1788306872.214487 punch from 0x0014e1 to 0x005b09 (0x4629 bytes) 000550 1788306872.249515 read 0x0007b9 thru 0x00bf4b (0xb793 bytes) 000551 1788306872.261699 read 0x033966 thru 0x03e633 (0xacce bytes) 000552 1788306872.270872 punch from 0x021fa2 to 0x02a5a8 (0x8607 bytes) 000554 1788306872.276702 read 0x022de5 thru 0x025dec (0x3008 bytes) 000555 1788306872.287490 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fbbe): Mirror 9: 0x81ac4394 (stale) Mirror 10: 0x81ac4394 (stale) Mirror 11: 0x81ac4394 (stale) Mirror 13: 0x81ac4394 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbbe): Mirror 9: 0x81ac4394 (stale) Mirror 10: 0x81ac4394 (stale) Mirror 11: 0x81ac4394 (stale) Mirror 13: 0x81ac4394 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbbe: skipped 000556 1788306872.812324 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fbbe): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbbe): Mirror 9: 0x81ac4394 (stale) Mirror 10: 0x81ac4394 (stale) Mirror 11: 0x81ac4394 (stale) Mirror 13: 0x81ac4394 (stale) CRC-32 checksum value for chunk [0, 0x3fbbe): Mirror 1: 0x81ac4394 Mirror 14: 0x81ac4394 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbbe: skipped 000557 1788306874.150765 trunc from 0x0057cc to 0x00e28e (0x8ac3 bytes) 000558 1788306874.203925 fallocate 0x009607 thru 0x0112a9 (0x7ca3 bytes) 000559 1788306874.211433 mapwrite 0x03e71b thru 0x03efa4 (0x88a bytes) 000560 1788306874.235306 trunc from 0x014067 to 0x021174 (0xd10e bytes) 000561 1788306874.241353 punch from 0x029395 to 0x02c943 (0x35af bytes) 000563 1788306874.247559 write 0x038477 thru 0x03ffff (0x7b89 bytes) 000564 1788306874.273209 read 0x00372d thru 0x009d91 (0x6665 bytes) 000565 1788306874.285710 punch from 0x006185 to 0x0155d5 (0xf451 bytes) 000567 1788306874.291624 write 0x00ed0b thru 0x019220 (0xa516 bytes) 000568 1788306874.322466 trunc from 0x0274e4 to 0x03490a (0xd427 bytes) 000569 1788306874.329454 fallocate 0x039be5 thru 0x03f19b (0x55b7 bytes) 000570 1788306874.350677 fallocate 0x02f763 thru 0x03e790 (0xf02e bytes) 000571 1788306874.376845 trunc from 0x014a03 to 0x023c87 (0xf285 bytes) 000572 1788306874.415416 fallocate 0x03ae9e thru 0x03ffff (0x5162 bytes) 000573 1788306874.421298 write 0x000a93 thru 0x00ea8a (0xdff8 bytes) 000574 1788306874.435920 fallocate 0x018ed0 thru 0x01af2c (0x205d bytes) 000575 1788306874.445920 read 0x00dfe4 thru 0x017d15 (0x9d32 bytes) 000576 1788306874.461168 read 0x00c993 thru 0x00eca7 (0x2315 bytes) 000577 1788306874.461822 trunc from 0x040000 to 0x03bdca (0x4235 bytes) 000578 1788306874.489241 fallocate 0x021834 thru 0x023b86 (0x2353 bytes) 000579 1788306874.498746 punch from 0x033ec6 to 0x036861 (0x299c bytes) 000580 1788306874.511822 trunc from 0x0159ac to 0x024931 (0xef86 bytes) 000581 1788306874.527344 trunc from 0x03bdcb to 0x0118b8 (0x2a512 bytes) 000582 1788306874.574309 punch from 0x00594b to 0x00cb16 (0x71cc bytes) 000583 1788306874.607784 fallocate 0x000ead thru 0x003c02 (0x2d56 bytes) 000584 1788306874.622840 read 0x00f97f thru 0x0118b8 (0x1f3a bytes) 000585 1788306874.635900 trunc from 0x0118b9 to 0x0271a4 (0x158ec bytes) 000586 1788306874.694354 mapwrite 0x02f738 thru 0x032f32 (0x37fb bytes) 000587 1788306874.772834 trunc from 0x00c6fd to 0x01b580 (0xee84 bytes) 000588 1788306874.780625 read 0x006842 thru 0x00959a (0x2d59 bytes) 000589 1788306874.782212 punch from 0x01cdff to 0x0218e4 (0x4ae6 bytes) 000590 1788306874.788306 punch from 0x029b31 to 0x02c051 (0x2521 bytes) 000591 1788306874.794299 mapwrite 0x02f43a thru 0x0379b8 (0x857f bytes) 000592 1788306874.904848 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x379b9): Mirror 9: 0x329d7173 (stale) Mirror 10: 0x329d7173 (stale) Mirror 13: 0x329d7173 (stale) Mirror 14: 0x329d7173 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x379b9): Mirror 9: 0x329d7173 (stale) Mirror 10: 0x329d7173 (stale) Mirror 13: 0x329d7173 (stale) Mirror 14: 0x329d7173 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x379b9: skipped 000593 1788306875.469330 trunc from 0x01a5cc to 0x02752f (0xcf64 bytes) 000594 1788306875.475631 write 0x0340a1 thru 0x03a6c5 (0x6625 bytes) 000595 1788306875.489802 write 0x008a75 thru 0x008b99 (0x125 bytes) 000596 1788306875.496608 punch from 0x036e89 to 0x03a6c5 (0x383d bytes) 000597 1788306875.511629 punch from 0x030fd1 to 0x031406 (0x436 bytes) 000598 1788306875.517362 punch from 0x02ae83 to 0x02ebf1 (0x3d6f bytes) 000599 1788306875.522763 trunc from 0x00433a to 0x00d1a8 (0x8e6f bytes) 000600 1788306875.529875 read 0x0158dd thru 0x0246fc (0xee20 bytes) 000602 1788306875.545886 mapwrite 0x00de20 thru 0x013b93 (0x5d74 bytes) 000603 1788306875.591660 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a6c6): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a6c6): Mirror 9: 0x48c77573 (stale) Mirror 10: 0x48c77573 (stale) Mirror 13: 0x48c77573 (stale) Mirror 14: 0x48c77573 (stale) CRC-32 checksum value for chunk [0, 0x3a6c6): Mirror 1: 0x5f2e2d23 Mirror 15: 0x5f2e2d23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a6c6: skipped 000604 1788306876.716574 punch from 0x013608 to 0x02098e (0xd387 bytes) 000605 1788306876.791010 trunc from 0x0390dc to 0x03a6c5 (0x15ea bytes) 000606 1788306876.796872 mapwrite 0x00a30e thru 0x010803 (0x64f6 bytes) 000608 1788306876.878520 trunc from 0x03a6c6 to 0x025e55 (0x14870 bytes) 000609 1788306876.946533 fallocate 0x009230 thru 0x00fbdb (0x69ac bytes) 000610 1788306876.958005 write 0x002427 thru 0x00c8d8 (0xa4b2 bytes) 000611 1788306876.975580 mapwrite 0x02f057 thru 0x03eee3 (0xfe8d bytes) 000612 1788306877.110148 mapwrite 0x02666e thru 0x030651 (0x9fe4 bytes) 000613 1788306877.191797 fallocate 0x00a271 thru 0x016b7f (0xc90f bytes) 000614 1788306877.204480 fallocate 0x01a176 thru 0x028317 (0xe1a2 bytes) 000615 1788306877.224770 mapwrite 0x000818 thru 0x00d0b3 (0xc89c bytes) 000616 1788306877.298567 MIRROR_RESYNC 6 mirrors 000618 1788306878.722301 fallocate 0x00ea30 thru 0x0157b8 (0x6d89 bytes) 000619 1788306878.768453 trunc from 0x03eee4 to 0x00e363 (0x30b80 bytes) 000620 1788306878.786724 write 0x014332 thru 0x01cd66 (0x8a35 bytes) 000621 1788306878.788412 mapwrite 0x0148e9 thru 0x0237b8 (0xeed0 bytes) 000622 1788306878.904142 write 0x02fd8b thru 0x03b5a2 (0xb818 bytes) 000623 1788306878.905997 read 0x023df0 thru 0x028f79 (0x518a bytes) 000624 1788306878.920859 MIRROR_RESYNC 6 mirrors 000625 1788306880.691636 fallocate 0x001297 thru 0x00d531 (0xc29b bytes) 000626 1788306880.737797 trunc from 0x00c73e to 0x0134fb (0x6dbe bytes) 000627 1788306880.745376 trunc from 0x03b5a3 to 0x0374d8 (0x40ca bytes) 000628 1788306880.782336 write 0x0164b0 thru 0x024f80 (0xead1 bytes) 000629 1788306880.799709 write 0x02aed1 thru 0x03795b (0xca8b bytes) 000630 1788306880.816767 mapwrite 0x00224d thru 0x007b89 (0x593d bytes) 000632 1788306880.883228 trunc from 0x013a08 to 0x020b13 (0xd10c bytes) 000633 1788306880.896419 punch from 0x020a5d to 0x028031 (0x75d5 bytes) 000634 1788306880.901797 punch from 0x018545 to 0x0236f2 (0xb1ae bytes) 000635 1788306880.907273 fallocate 0x014b14 thru 0x01d109 (0x85f6 bytes) 000636 1788306880.912737 punch from 0x01a8d7 to 0x023565 (0x8c8f bytes) 000638 1788306880.919235 write 0x01f574 thru 0x029d69 (0xa7f6 bytes) 000639 1788306880.943826 read 0x00fbb8 thru 0x01501b (0x5464 bytes) 000640 1788306880.961347 read 0x003448 thru 0x008bfc (0x57b5 bytes) 000641 1788306880.977320 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3795c): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3795c): Mirror 9: 0xd191e4c2 (stale) Mirror 10: 0xd191e4c2 (stale) Mirror 13: 0xd191e4c2 (stale) Mirror 14: 0xd191e4c2 (stale) Mirror 15: 0xd191e4c2 (stale) CRC-32 checksum value for chunk [0, 0x3795c): Mirror 1: 0x5f83c6e Mirror 16: 0x5f83c6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3795c: skipped 000642 1788306882.173227 mapread 0x01e25f thru 0x029e52 (0xbbf4 bytes) 000644 1788306882.231680 mapwrite 0x0112bc thru 0x0123e0 (0x1125 bytes) 000645 1788306882.356931 fallocate 0x007c01 thru 0x01415b (0xc55b bytes) 000646 1788306882.364445 mapread 0x034328 thru 0x0357c6 (0x149f bytes) 000647 1788306882.379123 trunc from 0x03795c to 0x03e4c5 (0x6b6a bytes) 000648 1788306882.420154 read 0x016400 thru 0x02105a (0xac5b bytes) 000649 1788306882.433411 punch from 0x033d67 to 0x03567e (0x1918 bytes) 000650 1788306882.440416 mapwrite 0x01c93d thru 0x02af38 (0xe5fc bytes) 000651 1788306882.473017 punch from 0x025bff to 0x026a20 (0xe22 bytes) 000652 1788306882.480227 trunc from 0x03e3bd to 0x03e4c5 (0x109 bytes) 000653 1788306882.484869 write 0x018f51 thru 0x028d98 (0xfe48 bytes) 000654 1788306882.487235 mapwrite 0x029a82 thru 0x03378d (0x9d0c bytes) 000655 1788306882.521164 mapread 0x03ae32 thru 0x03e4c5 (0x3694 bytes) 000656 1788306882.533225 read 0x00fd3c thru 0x01920c (0x94d1 bytes) 000657 1788306882.534243 trunc from 0x00cf03 to 0x019908 (0xca06 bytes) 000658 1788306882.540396 write 0x031263 thru 0x03286a (0x1608 bytes) 000659 1788306882.543227 write 0x01f70b thru 0x02a872 (0xb168 bytes) 000660 1788306882.545714 trunc from 0x02abc0 to 0x02b2f9 (0x73a bytes) 000661 1788306882.564992 trunc from 0x03e4c6 to 0x03f2ab (0xde6 bytes) 000663 1788306882.589922 mapread 0x02b8ae thru 0x033e95 (0x85e8 bytes) 000664 1788306882.608240 mapread 0x0365f1 thru 0x03f2ab (0x8cbb bytes) 000665 1788306882.609500 trunc from 0x00cfc5 to 0x01cba4 (0xfbe0 bytes) 000666 1788306882.618354 trunc from 0x03f2ac to 0x01f22c (0x2007f bytes) 000667 1788306882.644715 mapwrite 0x023853 thru 0x02beb6 (0x8664 bytes) 000668 1788306882.751287 write 0x01c798 thru 0x02bdb6 (0xf61f bytes) 000669 1788306882.762121 write 0x003bb6 thru 0x0134fc (0xf947 bytes) 000670 1788306882.769307 mapwrite 0x00c490 thru 0x0153b9 (0x8f2a bytes) 000671 1788306882.807452 trunc from 0x00b09e to 0x013e73 (0x8dd6 bytes) 000672 1788306882.815239 mapwrite 0x0278fc thru 0x02eb5d (0x7262 bytes) 000673 1788306882.871259 read 0x024a07 thru 0x029493 (0x4a8d bytes) 000674 1788306882.872384 punch from 0x02b98e to 0x02da01 (0x2074 bytes) 000675 1788306882.881478 trunc from 0x004825 to 0x00a64d (0x5e29 bytes) 000676 1788306882.892966 trunc from 0x02eb5e to 0x01f6ec (0xf471 bytes) 000677 1788306882.917313 read 0x01dbcc thru 0x01f6ec (0x1b21 bytes) 000679 1788306882.919907 punch from 0x00b8f5 to 0x018fd5 (0xd6e1 bytes) 000683 1788306882.931023 read 0x01108f thru 0x01aae5 (0x9a57 bytes) 000684 1788306882.947442 fallocate 0x02d43a thru 0x038a07 (0xb5ce bytes) 000685 1788306882.954359 punch from 0x00d154 to 0x016c62 (0x9b0f bytes) 000686 1788306882.959922 trunc from 0x0052e2 to 0x00caa5 (0x77c4 bytes) 000687 1788306882.973609 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1f6ed): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f6ed): Mirror 9: 0xab64180a (stale) Mirror 10: 0xab64180a (stale) Mirror 13: 0xab64180a (stale) Mirror 14: 0xab64180a (stale) Mirror 15: 0xab64180a (stale) Mirror 16: 0x676b331e (stale) CRC-32 checksum value for chunk [0, 0x1f6ed): Mirror 1: 0xa674d806 Mirror 17: 0xa674d806 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f6ed: skipped 000688 1788306884.805847 mapwrite 0x011e38 thru 0x013bd8 (0x1da1 bytes) 000689 1788306885.000932 mapread 0x01c323 thru 0x01d468 (0x1146 bytes) 000691 1788306885.023026 mapwrite 0x01b078 thru 0x027fdd (0xcf66 bytes) 000693 1788306885.148473 trunc from 0x00d87b to 0x00d9bc (0x142 bytes) 000694 1788306885.154619 trunc from 0x027fde to 0x02ed4e (0x6d71 bytes) 000695 1788306885.209310 MIRROR_RESYNC 8 mirrors 000696 1788306887.704598 trunc from 0x02ed4f to 0x013ad5 (0x1b279 bytes) 000697 1788306887.751342 read 0x0044e9 thru 0x00e848 (0xa360 bytes) 000699 1788306887.764438 read 0x002496 thru 0x008221 (0x5d8c bytes) 000701 1788306887.785442 mapwrite 0x0388e1 thru 0x03c7dd (0x3efd bytes) 000702 1788306887.847809 punch from 0x03aad9 to 0x03c7dd (0x1d05 bytes) 000704 1788306887.854940 trunc from 0x0225ba to 0x02dd4a (0xb791 bytes) 000705 1788306887.860352 trunc from 0x007d55 to 0x0154ac (0xd758 bytes) 000707 1788306887.868023 fallocate 0x0326f9 thru 0x035a23 (0x332b bytes) 000708 1788306887.872854 punch from 0x02f0bd to 0x03b7fa (0xc73e bytes) 000709 1788306887.878491 trunc from 0x00e870 to 0x016c9e (0x842f bytes) 000710 1788306887.884125 read 0x008684 thru 0x00db43 (0x54c0 bytes) 000711 1788306887.907537 mapread 0x036b0c thru 0x037747 (0xc3c bytes) 000712 1788306887.909243 trunc from 0x012e7e to 0x022e06 (0xff89 bytes) 000713 1788306887.917303 punch from 0x0046c3 to 0x0047dc (0x11a bytes) 000714 1788306887.927204 mapwrite 0x02babc thru 0x035b9f (0xa0e4 bytes) 000715 1788306887.952341 mapwrite 0x0054a5 thru 0x00e2a2 (0x8dfe bytes) 000716 1788306887.979498 fallocate 0x003137 thru 0x00c90e (0x97d8 bytes) 000717 1788306887.986307 trunc from 0x03c7de to 0x00c4f2 (0x302eb bytes) 000718 1788306888.008006 write 0x005ac9 thru 0x011aa0 (0xbfd8 bytes) 000720 1788306888.010297 write 0x009ab8 thru 0x00a0d7 (0x620 bytes) 000722 1788306888.019587 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x11aa1): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11aa1): Mirror 9: 0xe047f55 (stale) Mirror 10: 0xe047f55 (stale) Mirror 13: 0xe047f55 (stale) Mirror 14: 0xe047f55 (stale) Mirror 15: 0xe047f55 (stale) Mirror 16: 0xe047f55 (stale) Mirror 17: 0xe047f55 (stale) CRC-32 checksum value for chunk [0, 0x11aa1): Mirror 1: 0x23046b78 Mirror 18: 0x23046b78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11aa1: skipped 000723 1788306889.132208 punch from 0x000de0 to 0x00388b (0x2aac bytes) 000724 1788306889.190388 trunc from 0x011aa1 to 0x034297 (0x227f7 bytes) 000725 1788306889.216581 trunc from 0x00ebd6 to 0x01b0b8 (0xc4e3 bytes) 000726 1788306889.221762 read 0x015028 thru 0x024859 (0xf832 bytes) 000727 1788306889.231192 mapread 0x027e9c thru 0x034297 (0xc3fc bytes) 000729 1788306889.266638 mapwrite 0x018643 thru 0x0280ec (0xfaaa bytes) 000730 1788306889.294606 fallocate 0x02f363 thru 0x03a32b (0xafc9 bytes) 000731 1788306889.300310 punch from 0x038dfd to 0x039333 (0x537 bytes) 000732 1788306889.306391 punch from 0x01b1f1 to 0x0234e9 (0x82f9 bytes) 000733 1788306889.312104 trunc from 0x0266f5 to 0x02e7a2 (0x80ae bytes) 000735 1788306889.318935 trunc from 0x00b53a to 0x0140c9 (0x8b90 bytes) 000736 1788306889.324461 mapread 0x009d01 thru 0x011e2f (0x812f bytes) 000737 1788306889.337420 fallocate 0x0195be thru 0x01ca49 (0x348c bytes) 000738 1788306889.349792 trunc from 0x03a32c to 0x0004aa (0x39e81 bytes) 000739 1788306889.375718 mapread 0x0001ab thru 0x0004aa (0x300 bytes) 000740 1788306889.389900 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x4ab): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4ab): Mirror 9: 0xd204276 (stale) Mirror 10: 0xd204276 (stale) Mirror 13: 0xd204276 (stale) Mirror 14: 0xd204276 (stale) Mirror 15: 0xd204276 (stale) Mirror 16: 0xd204276 (stale) Mirror 17: 0xd204276 (stale) Mirror 18: 0xd204276 (stale) CRC-32 checksum value for chunk [0, 0x4ab): Mirror 1: 0xd204276 Mirror 19: 0xd204276 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4ab: skipped 000741 1788306890.202783 MIRROR_RESYNC 10 mirrors 000742 1788306891.231158 mapwrite 0x0167da thru 0x025347 (0xeb6e bytes) 000743 1788306891.390870 punch from 0x009ecb to 0x010d94 (0x6eca bytes) 000744 1788306891.396133 mapwrite 0x00fe69 thru 0x019a18 (0x9bb0 bytes) 000745 1788306891.431139 read 0x02008f thru 0x025347 (0x52b9 bytes) 000747 1788306891.438448 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25348): Mirror 10: 0x4ef148e3 (stale) Mirror 13: 0x4ef148e3 (stale) Mirror 14: 0x4ef148e3 (stale) Mirror 15: 0x4ef148e3 (stale) Mirror 16: 0x4ef148e3 (stale) Mirror 17: 0x4ef148e3 (stale) Mirror 18: 0x4ef148e3 (stale) Mirror 19: 0x4ef148e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25348): Mirror 10: 0x4ef148e3 (stale) Mirror 13: 0x4ef148e3 (stale) Mirror 14: 0x4ef148e3 (stale) Mirror 15: 0x4ef148e3 (stale) Mirror 16: 0x4ef148e3 (stale) Mirror 17: 0x4ef148e3 (stale) Mirror 18: 0x4ef148e3 (stale) Mirror 19: 0x4ef148e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25348: skipped 000748 1788306892.038899 punch from 0x022cb5 to 0x025347 (0x2693 bytes) 000749 1788306892.051445 fallocate 0x012552 thru 0x018011 (0x5ac0 bytes) 000750 1788306892.059991 read 0x01a0b3 thru 0x021bc2 (0x7b10 bytes) 000751 1788306892.069586 read 0x00d5a1 thru 0x01cfa3 (0xfa03 bytes) 000753 1788306892.081435 mapwrite 0x018e4a thru 0x01c0da (0x3291 bytes) 000756 1788306892.106212 fallocate 0x01e64c thru 0x020715 (0x20ca bytes) 000757 1788306892.112855 write 0x003c62 thru 0x0078ee (0x3c8d bytes) 000758 1788306892.120739 trunc from 0x01c611 to 0x022be9 (0x65d9 bytes) 000760 1788306892.129700 fallocate 0x005d4e thru 0x01107a (0xb32d bytes) 000763 1788306892.138242 read 0x0098c5 thru 0x0123ee (0x8b2a bytes) 000764 1788306892.139613 read 0x015bf5 thru 0x022fe0 (0xd3ec bytes) 000765 1788306892.150525 trunc from 0x025348 to 0x02a7a3 (0x545c bytes) 000766 1788306892.168241 trunc from 0x02a7a4 to 0x031322 (0x6b7f bytes) 000767 1788306892.184317 write 0x03deea thru 0x03ffff (0x2116 bytes) 000768 1788306892.185622 trunc from 0x001605 to 0x009c05 (0x8601 bytes) 000769 1788306892.198253 fallocate 0x014437 thru 0x01938c (0x4f56 bytes) 000770 1788306892.208117 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000771 1788306892.728273 mapread 0x029fa4 thru 0x03741f (0xd47c bytes) 000772 1788306892.762423 mapwrite 0x03b13e thru 0x03d2ec (0x21af bytes) 000773 1788306892.791905 write 0x01e79f thru 0x0254aa (0x6d0c bytes) 000774 1788306892.802526 mapwrite 0x02d21f thru 0x036bd5 (0x99b7 bytes) 000775 1788306892.837252 MIRROR_RESYNC 8 mirrors 000776 1788306895.022545 MIRROR_EXTEND to 9 mirrors 000778 1788306895.816541 mapread 0x039c8f thru 0x03dfda (0x434c bytes) 000779 1788306895.828677 read 0x00b274 thru 0x0112f6 (0x6083 bytes) 000780 1788306895.833860 trunc from 0x012eec to 0x01ee82 (0xbf97 bytes) 000782 1788306895.858375 mapwrite 0x02afbf thru 0x03740e (0xc450 bytes) 000784 1788306895.887258 punch from 0x0088a7 to 0x013ddc (0xb536 bytes) 000785 1788306895.893443 punch from 0x033227 to 0x03ffff (0xcdd9 bytes) 000786 1788306895.899611 punch from 0x00d4d8 to 0x012263 (0x4d8c bytes) 000787 1788306895.905015 punch from 0x037010 to 0x03d4d3 (0x64c4 bytes) 000788 1788306895.912025 write 0x038798 thru 0x03ffff (0x7868 bytes) 000789 1788306895.923350 punch from 0x03bf7f to 0x03cb59 (0xbdb bytes) 000790 1788306895.942925 read 0x03e01c thru 0x03ffff (0x1fe4 bytes) 000791 1788306895.943671 trunc from 0x01ff8a to 0x02a011 (0xa088 bytes) 000792 1788306895.954887 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xbedddb6 (stale) Mirror 13: 0xbedddb6 (stale) Mirror 14: 0xbedddb6 (stale) Mirror 15: 0xbedddb6 (stale) Mirror 16: 0xbedddb6 (stale) Mirror 17: 0xbedddb6 (stale) Mirror 19: 0xbedddb6 (stale) Mirror 20: 0xbedddb6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x84414286 Mirror 21: 0x84414286 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000793 1788306897.033829 read 0x03aa93 thru 0x03c63f (0x1bad bytes) 000794 1788306897.047630 trunc from 0x024159 to 0x02e7a1 (0xa649 bytes) 000795 1788306897.092747 mapread 0x0060f7 thru 0x00796a (0x1874 bytes) 000796 1788306897.104882 fallocate 0x032f56 thru 0x03db70 (0xac1b bytes) 000797 1788306897.109972 fallocate 0x038fac thru 0x03ffff (0x7054 bytes) 000798 1788306897.114369 mapread 0x037740 thru 0x03ffff (0x88c0 bytes) 000799 1788306897.125651 trunc from 0x00ea3d to 0x01d9b3 (0xef77 bytes) 000800 1788306897.130476 trunc from 0x011a31 to 0x01cd1b (0xb2eb bytes) 000801 1788306897.135670 trunc from 0x039f0e to 0x03ffff (0x60f2 bytes) 000802 1788306897.144444 MIRROR_RESYNC 10 mirrors 000803 1788306900.427917 trunc from 0x040000 to 0x02c40f (0x13bf0 bytes) 000804 1788306900.504908 mapread 0x019eb3 thru 0x01d206 (0x3354 bytes) 000805 1788306900.532767 fallocate 0x006bf9 thru 0x00c3d0 (0x57d8 bytes) 000808 1788306900.538574 mapread 0x0247d3 thru 0x02c40f (0x7c3d bytes) 000809 1788306900.551414 trunc from 0x02c410 to 0x027cc7 (0x4748 bytes) 000810 1788306900.617443 read 0x0216b4 thru 0x027cc7 (0x6614 bytes) 000811 1788306900.623864 mapwrite 0x01bafa thru 0x029e6e (0xe375 bytes) 000812 1788306900.702534 fallocate 0x015174 thru 0x01cef3 (0x7d80 bytes) 000813 1788306900.709727 trunc from 0x029e6f to 0x01a575 (0xf8f9 bytes) 000814 1788306900.750649 mapread 0x005470 thru 0x0068b1 (0x1442 bytes) 000815 1788306900.768228 punch from 0x004b53 to 0x005678 (0xb26 bytes) 000816 1788306900.773879 trunc from 0x005ce1 to 0x00ce84 (0x71a4 bytes) 000817 1788306900.781973 write 0x007413 thru 0x011104 (0x9cf2 bytes) 000818 1788306900.804877 punch from 0x01324f to 0x01a575 (0x7327 bytes) 000819 1788306900.813395 mapwrite 0x032b80 thru 0x03e43b (0xb8bc bytes) 000820 1788306900.935390 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e43c): Mirror 10: 0x5ebde223 (stale) Mirror 13: 0x5ebde223 (stale) Mirror 14: 0x5ebde223 (stale) Mirror 15: 0x5ebde223 (stale) Mirror 16: 0x5ebde223 (stale) Mirror 17: 0x5ebde223 (stale) Mirror 19: 0x5ebde223 (stale) Mirror 20: 0x5ebde223 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e43c): Mirror 10: 0x5ebde223 (stale) Mirror 13: 0x5ebde223 (stale) Mirror 14: 0x5ebde223 (stale) Mirror 15: 0x5ebde223 (stale) Mirror 16: 0x5ebde223 (stale) Mirror 17: 0x5ebde223 (stale) Mirror 19: 0x5ebde223 (stale) Mirror 20: 0x5ebde223 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e43c: skipped 000821 1788306901.504099 punch from 0x0172c6 to 0x01cb65 (0x58a0 bytes) 000822 1788306901.510669 mapread 0x007132 thru 0x0117f4 (0xa6c3 bytes) 000823 1788306901.533910 read 0x02a62e thru 0x036ced (0xc6c0 bytes) 000825 1788306901.545000 read 0x022a8e thru 0x030c72 (0xe1e5 bytes) 000826 1788306901.554993 mapread 0x022756 thru 0x023f0f (0x17ba bytes) 000827 1788306901.556581 trunc from 0x03e43c to 0x0360d7 (0x8364 bytes) 000828 1788306901.575555 trunc from 0x0188c3 to 0x0214ca (0x8c08 bytes) 000829 1788306901.581358 mapread 0x022632 thru 0x03227b (0xfc4a bytes) 000830 1788306901.583743 read 0x0218a0 thru 0x0286c0 (0x6e21 bytes) 000831 1788306901.592357 write 0x0321c6 thru 0x03958d (0x73c8 bytes) 000832 1788306901.594000 read 0x009b87 thru 0x00ae1c (0x1296 bytes) 000833 1788306901.595387 trunc from 0x0326f5 to 0x03958d (0x6e99 bytes) 000835 1788306901.609906 fallocate 0x029d68 thru 0x038f01 (0xf19a bytes) 000837 1788306901.617892 trunc from 0x03958e to 0x022a8e (0x16aff bytes) 000838 1788306901.637299 mapread 0x018dea thru 0x022a8e (0x9ca5 bytes) 000839 1788306901.640979 punch from 0x01acb9 to 0x01c0b2 (0x13fa bytes) 000840 1788306901.652100 MIRROR_RESYNC 9 mirrors 000841 1788306903.401515 read 0x00cb49 thru 0x01c137 (0xf5ef bytes) 000842 1788306903.410945 read 0x019a8a thru 0x01cd20 (0x3297 bytes) 000843 1788306903.411409 trunc from 0x022a8f to 0x0130b2 (0xf9dc bytes) 000846 1788306903.458661 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x130b3): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x130b3): Mirror 10: 0xf2663b53 (stale) Mirror 13: 0xf2663b53 (stale) Mirror 14: 0xf2663b53 (stale) Mirror 15: 0xf2663b53 (stale) Mirror 16: 0xf2663b53 (stale) Mirror 17: 0xf2663b53 (stale) Mirror 19: 0xf2663b53 (stale) Mirror 20: 0xf2663b53 (stale) CRC-32 checksum value for chunk [0, 0x130b3): Mirror 1: 0xf2663b53 Mirror 21: 0xf2663b53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x130b3: skipped 000847 1788306904.514903 punch from 0x00b62c to 0x010286 (0x4c5b bytes) 000849 1788306904.575970 fallocate 0x031c2f thru 0x03ef3f (0xd311 bytes) 000850 1788306904.582122 mapread 0x00ba74 thru 0x00c6d6 (0xc63 bytes) 000851 1788306904.593114 read 0x0393e5 thru 0x03b837 (0x2453 bytes) 000852 1788306904.599241 write 0x023fa5 thru 0x02e899 (0xa8f5 bytes) 000853 1788306904.615684 trunc from 0x014190 to 0x019229 (0x509a bytes) 000855 1788306904.622145 write 0x03ac1b thru 0x03ffff (0x53e5 bytes) 000856 1788306904.624868 punch from 0x0133e6 to 0x0212de (0xdef9 bytes) 000857 1788306904.630837 punch from 0x028142 to 0x03133c (0x91fb bytes) 000858 1788306904.664398 read 0x01bd0a thru 0x022ffd (0x72f4 bytes) 000859 1788306904.686178 read 0x0076cd thru 0x013f23 (0xc857 bytes) 000860 1788306904.686904 trunc from 0x010349 to 0x017793 (0x744b bytes) 000861 1788306904.694252 write 0x003bfd thru 0x00b871 (0x7c75 bytes) 000862 1788306904.697124 trunc from 0x040000 to 0x024353 (0x1bcac bytes) 000863 1788306904.757679 fallocate 0x02bb51 thru 0x02c619 (0xac9 bytes) 000864 1788306904.770291 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x24354): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24354): Mirror 10: 0x2eda3b17 (stale) Mirror 13: 0x2eda3b17 (stale) Mirror 14: 0x2eda3b17 (stale) Mirror 15: 0x2eda3b17 (stale) Mirror 16: 0x2eda3b17 (stale) Mirror 17: 0x2eda3b17 (stale) Mirror 19: 0x2eda3b17 (stale) Mirror 20: 0x2eda3b17 (stale) Mirror 21: 0x2eda3b17 (stale) CRC-32 checksum value for chunk [0, 0x24354): Mirror 1: 0xa6a9ea89 Mirror 22: 0xa6a9ea89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24354: skipped 000866 1788306905.822986 fallocate 0x01a26d thru 0x02876f (0xe503 bytes) 000867 1788306905.866879 write 0x02d06c thru 0x033074 (0x6009 bytes) 000868 1788306905.874560 trunc from 0x00bcbb to 0x019c90 (0xdfd6 bytes) 000869 1788306905.881969 punch from 0x0190be to 0x025301 (0xc244 bytes) 000870 1788306905.888742 read 0x01e15d thru 0x024da2 (0x6c46 bytes) 000871 1788306905.897027 mapwrite 0x016f9b thru 0x01c6c8 (0x572e bytes) 000872 1788306905.933249 mapwrite 0x0119b7 thru 0x019019 (0x7663 bytes) 000873 1788306905.960512 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x33075): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33075): Mirror 10: 0x1b6831c6 (stale) Mirror 13: 0x1b6831c6 (stale) Mirror 14: 0x1b6831c6 (stale) Mirror 15: 0x1b6831c6 (stale) Mirror 16: 0x1b6831c6 (stale) Mirror 17: 0x1b6831c6 (stale) Mirror 19: 0x1b6831c6 (stale) Mirror 20: 0x1b6831c6 (stale) Mirror 21: 0x1b6831c6 (stale) Mirror 22: 0xfd391d66 (stale) CRC-32 checksum value for chunk [0, 0x33075): Mirror 1: 0x8cb4f9e2 Mirror 23: 0x8cb4f9e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33075: skipped 000874 1788306907.374789 read 0x020a4a thru 0x025f3d (0x54f4 bytes) 000875 1788306907.395903 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x33075): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33075): Mirror 10: 0x1b6831c6 (stale) Mirror 13: 0x1b6831c6 (stale) Mirror 14: 0x1b6831c6 (stale) Mirror 15: 0x1b6831c6 (stale) Mirror 16: 0x1b6831c6 (stale) Mirror 17: 0x1b6831c6 (stale) Mirror 19: 0x1b6831c6 (stale) Mirror 20: 0x1b6831c6 (stale) Mirror 21: 0x1b6831c6 (stale) Mirror 22: 0xfd391d66 (stale) CRC-32 checksum value for chunk [0, 0x33075): Mirror 1: 0x8cb4f9e2 Mirror 23: 0x8cb4f9e2 Mirror 24: 0x8cb4f9e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33075: skipped 000878 1788306908.547871 trunc from 0x02a706 to 0x033074 (0x896f bytes) 000879 1788306908.594200 mapwrite 0x02b29e thru 0x039c2a (0xe98d bytes) 000881 1788306908.663440 read 0x0076c6 thru 0x0106f9 (0x9034 bytes) 000882 1788306908.671563 trunc from 0x033440 to 0x039c2a (0x67eb bytes) 000883 1788306908.677290 read 0x01cf34 thru 0x024c01 (0x7cce bytes) 000884 1788306908.711501 mapwrite 0x022d32 thru 0x02a9ee (0x7cbd bytes) 000886 1788306908.735624 write 0x02789c thru 0x02a492 (0x2bf7 bytes) 000887 1788306908.736733 punch from 0x027079 to 0x03597b (0xe903 bytes) 000889 1788306908.751370 read 0x02730f thru 0x02f6cb (0x83bd bytes) 000890 1788306908.768408 read 0x00efd9 thru 0x01804d (0x9075 bytes) 000891 1788306908.769790 fallocate 0x035fc7 thru 0x03ffff (0xa039 bytes) 000892 1788306908.777135 trunc from 0x006f36 to 0x00daf6 (0x6bc1 bytes) 000893 1788306908.782187 mapwrite 0x033aaf thru 0x0362bb (0x280d bytes) 000894 1788306908.795453 trunc from 0x01cf26 to 0x0253df (0x84ba bytes) 000895 1788306908.806814 MIRROR_RESYNC 13 mirrors 000896 1788306913.330914 trunc from 0x040000 to 0x01c419 (0x23be6 bytes) 000898 1788306913.404272 trunc from 0x01c41a to 0x02a5aa (0xe191 bytes) 000899 1788306913.428103 mapread 0x00c5c0 thru 0x016c32 (0xa673 bytes) 000900 1788306913.448891 punch from 0x00ef28 to 0x01b5d2 (0xc6ab bytes) 000901 1788306913.454884 trunc from 0x0109dc to 0x01a548 (0x9b6d bytes) 000902 1788306913.459952 punch from 0x01fed8 to 0x02a5aa (0xa6d3 bytes) 000903 1788306913.469204 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a5ab): Mirror 10: 0x8c1ddd73 (stale) Mirror 13: 0x8c1ddd73 (stale) Mirror 14: 0x8c1ddd73 (stale) Mirror 15: 0x8c1ddd73 (stale) Mirror 16: 0x8c1ddd73 (stale) Mirror 17: 0x8c1ddd73 (stale) Mirror 19: 0x8c1ddd73 (stale) Mirror 21: 0x8c1ddd73 (stale) Mirror 22: 0x8c1ddd73 (stale) Mirror 23: 0x8c1ddd73 (stale) Mirror 24: 0x8c1ddd73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a5ab): Mirror 10: 0x8c1ddd73 (stale) Mirror 13: 0x8c1ddd73 (stale) Mirror 14: 0x8c1ddd73 (stale) Mirror 15: 0x8c1ddd73 (stale) Mirror 16: 0x8c1ddd73 (stale) Mirror 17: 0x8c1ddd73 (stale) Mirror 19: 0x8c1ddd73 (stale) Mirror 21: 0x8c1ddd73 (stale) Mirror 22: 0x8c1ddd73 (stale) Mirror 23: 0x8c1ddd73 (stale) Mirror 24: 0x8c1ddd73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a5ab: skipped 000904 1788306914.072132 read 0x01d98a thru 0x01d98d (0x4 bytes) 000905 1788306914.078942 trunc from 0x0272c3 to 0x02a5aa (0x32e8 bytes) 000906 1788306914.083606 mapwrite 0x03f9c0 thru 0x03ffff (0x640 bytes) 000907 1788306914.133197 trunc from 0x018cdb to 0x0256af (0xc9d5 bytes) 000908 1788306914.139841 read 0x01615f thru 0x01cf2d (0x6dcf bytes) 000909 1788306914.149855 fallocate 0x016dc7 thru 0x021692 (0xa8cc bytes) 000910 1788306914.168438 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xada88db4 (stale) Mirror 13: 0xada88db4 (stale) Mirror 15: 0xada88db4 (stale) Mirror 16: 0xada88db4 (stale) Mirror 17: 0xada88db4 (stale) Mirror 19: 0xada88db4 (stale) Mirror 21: 0xada88db4 (stale) Mirror 22: 0xada88db4 (stale) Mirror 23: 0xada88db4 (stale) Mirror 24: 0xada88db4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xada88db4 (stale) Mirror 13: 0xada88db4 (stale) Mirror 15: 0xada88db4 (stale) Mirror 16: 0xada88db4 (stale) Mirror 17: 0xada88db4 (stale) Mirror 19: 0xada88db4 (stale) Mirror 21: 0xada88db4 (stale) Mirror 22: 0xada88db4 (stale) Mirror 23: 0xada88db4 (stale) Mirror 24: 0xada88db4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000911 1788306914.826658 read 0x0322a1 thru 0x03dad0 (0xb830 bytes) 000912 1788306914.845963 mapread 0x01dd65 thru 0x020e0d (0x30a9 bytes) 000913 1788306914.875458 mapread 0x01395b thru 0x020c48 (0xd2ee bytes) 000914 1788306914.889231 mapread 0x00d9bb thru 0x013d19 (0x635f bytes) 000915 1788306914.890182 write 0x01e6c2 thru 0x027d6a (0x96a9 bytes) 000916 1788306914.896923 punch from 0x03f9cf to 0x03ffff (0x631 bytes) 000917 1788306914.902743 punch from 0x039922 to 0x03a6d9 (0xdb8 bytes) 000919 1788306914.909709 trunc from 0x030c5a to 0x031433 (0x7da bytes) 000921 1788306914.916605 mapwrite 0x03b65b thru 0x03cc9f (0x1645 bytes) 000922 1788306914.935766 read 0x039493 thru 0x03ffff (0x6b6d bytes) 000923 1788306914.950712 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xada88db4 (stale) Mirror 15: 0xada88db4 (stale) Mirror 16: 0xada88db4 (stale) Mirror 17: 0xada88db4 (stale) Mirror 19: 0xada88db4 (stale) Mirror 21: 0xada88db4 (stale) Mirror 22: 0xada88db4 (stale) Mirror 23: 0xada88db4 (stale) Mirror 24: 0xada88db4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xada88db4 (stale) Mirror 15: 0xada88db4 (stale) Mirror 16: 0xada88db4 (stale) Mirror 17: 0xada88db4 (stale) Mirror 19: 0xada88db4 (stale) Mirror 21: 0xada88db4 (stale) Mirror 22: 0xada88db4 (stale) Mirror 23: 0xada88db4 (stale) Mirror 24: 0xada88db4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000924 1788306915.918980 trunc from 0x03f2bf to 0x03ffff (0xd41 bytes) 000925 1788306915.935065 punch from 0x0273f8 to 0x02ff8f (0x8b98 bytes) 000926 1788306915.945180 fallocate 0x02b476 thru 0x035cc5 (0xa850 bytes) 000927 1788306915.950372 fallocate 0x01be0c thru 0x01d370 (0x1565 bytes) 000928 1788306915.969399 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xada88db4 (stale) Mirror 15: 0xada88db4 (stale) Mirror 16: 0xada88db4 (stale) Mirror 17: 0xada88db4 (stale) Mirror 19: 0xada88db4 (stale) Mirror 22: 0xada88db4 (stale) Mirror 23: 0xada88db4 (stale) Mirror 24: 0xada88db4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xada88db4 (stale) Mirror 15: 0xada88db4 (stale) Mirror 16: 0xada88db4 (stale) Mirror 17: 0xada88db4 (stale) Mirror 19: 0xada88db4 (stale) Mirror 22: 0xada88db4 (stale) Mirror 23: 0xada88db4 (stale) Mirror 24: 0xada88db4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000930 1788306916.670947 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x19b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xada88db4 (stale) Mirror 15: 0xada88db4 (stale) Mirror 16: 0xada88db4 (stale) Mirror 17: 0xada88db4 (stale) Mirror 19: 0xada88db4 (stale) Mirror 23: 0xada88db4 (stale) Mirror 24: 0xada88db4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xada88db4 (stale) Mirror 15: 0xada88db4 (stale) Mirror 16: 0xada88db4 (stale) Mirror 17: 0xada88db4 (stale) Mirror 19: 0xada88db4 (stale) Mirror 23: 0xada88db4 (stale) Mirror 24: 0xada88db4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000931 1788306917.336667 punch from 0x035259 to 0x037dcf (0x2b77 bytes) 000932 1788306917.350706 fallocate 0x0113c1 thru 0x01723a (0x5e7a bytes) 000933 1788306917.361711 read 0x018678 thru 0x01aea5 (0x282e bytes) 000934 1788306917.368928 trunc from 0x019021 to 0x01a497 (0x1477 bytes) 000935 1788306917.375027 mapread 0x029d12 thru 0x02b2e8 (0x15d7 bytes) 000936 1788306917.397977 trunc from 0x040000 to 0x03f9fc (0x603 bytes) 000937 1788306917.428013 fallocate 0x0229a8 thru 0x02d95b (0xafb4 bytes) 000938 1788306917.436109 mapwrite 0x0179bb thru 0x02279a (0xade0 bytes) 000939 1788306917.476870 mapread 0x020707 thru 0x02b1d1 (0xaacb bytes) 000940 1788306917.478668 write 0x01390e thru 0x0234ef (0xfbe2 bytes) 000941 1788306917.484656 punch from 0x02a301 to 0x0339c8 (0x96c8 bytes) 000942 1788306917.492450 trunc from 0x020ca7 to 0x02c8a6 (0xbc00 bytes) 000943 1788306917.515507 punch from 0x02afd1 to 0x037058 (0xc088 bytes) 000944 1788306917.523161 trunc from 0x03f9fd to 0x02686c (0x19190 bytes) 000945 1788306917.549467 fallocate 0x03be7c thru 0x03f015 (0x319a bytes) 000947 1788306917.557585 trunc from 0x01b89e to 0x02686c (0xafcf bytes) 000948 1788306917.563842 mapread 0x00b193 thru 0x00e920 (0x378e bytes) 000949 1788306917.572998 fallocate 0x01e837 thru 0x020d69 (0x2533 bytes) 000950 1788306917.579000 read 0x019ad1 thru 0x022d0d (0x923d bytes) 000951 1788306917.590256 read 0x0120f5 thru 0x01be9e (0x9daa bytes) 000952 1788306917.591154 write 0x019ba6 thru 0x01c185 (0x25e0 bytes) 000953 1788306917.593545 trunc from 0x010878 to 0x01bb56 (0xb2df bytes) 000954 1788306917.609005 trunc from 0x012704 to 0x01dcda (0xb5d7 bytes) 000955 1788306917.619198 MIRROR_RESYNC 8 mirrors 000956 1788306919.773607 mapwrite 0x01ba20 thru 0x028a74 (0xd055 bytes) 000957 1788306919.880917 trunc from 0x028a75 to 0x03c6f4 (0x13c80 bytes) 000958 1788306919.903659 punch from 0x00836f to 0x01009a (0x7d2c bytes) 000959 1788306919.912376 mapwrite 0x00437d thru 0x011545 (0xd1c9 bytes) 000961 1788306919.998947 write 0x01c115 thru 0x0292b0 (0xd19c bytes) 000962 1788306920.041960 read 0x0119f5 thru 0x014a3b (0x3047 bytes) 000963 1788306920.042813 fallocate 0x00827a thru 0x016344 (0xe0cb bytes) 000964 1788306920.048113 write 0x016d06 thru 0x01e774 (0x7a6f bytes) 000965 1788306920.051228 fallocate 0x03c7e0 thru 0x03ffff (0x3820 bytes) 000966 1788306920.056888 write 0x01fb8a thru 0x023749 (0x3bc0 bytes) 000967 1788306920.060088 punch from 0x0347f6 to 0x03bf0d (0x7718 bytes) 000968 1788306920.073547 trunc from 0x040000 to 0x010aac (0x2f553 bytes) 000969 1788306920.093574 punch from 0x00cc7e to 0x010aac (0x3e2f bytes) 000970 1788306920.105489 MIRROR_RESYNC 8 mirrors 000971 1788306921.938940 trunc from 0x00862c to 0x010aac (0x8481 bytes) 000972 1788306922.005379 read 0x0002e9 thru 0x00f92f (0xf647 bytes) 000973 1788306922.021837 trunc from 0x010aad to 0x036eca (0x2641e bytes) 000974 1788306922.046431 punch from 0x00c66b to 0x0119b8 (0x534e bytes) 000975 1788306922.052639 trunc from 0x036ecb to 0x0102da (0x26bf0 bytes) 000976 1788306922.073843 read 0x004ee1 thru 0x0102da (0xb3fa bytes) 000977 1788306922.084967 read 0x0084a8 thru 0x008e17 (0x970 bytes) 000979 1788306922.086727 write 0x03189d thru 0x035f15 (0x4679 bytes) 000980 1788306922.088686 mapwrite 0x02492e thru 0x027b1c (0x31ef bytes) 000981 1788306922.127597 punch from 0x004cac to 0x00c9b2 (0x7d07 bytes) 000982 1788306922.138476 MIRROR_RESYNC 8 mirrors 000984 1788306924.972907 trunc from 0x035f16 to 0x00827c (0x2dc99 bytes) 000986 1788306925.071191 read 0x0016c2 thru 0x002a90 (0x13cf bytes) 000987 1788306925.083370 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x827d): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x827d): Mirror 13: 0xe4a8514c (stale) Mirror 15: 0xe4a8514c (stale) Mirror 16: 0xe4a8514c (stale) Mirror 17: 0xe4a8514c (stale) Mirror 19: 0xe4a8514c (stale) Mirror 23: 0xe4a8514c (stale) Mirror 24: 0xe4a8514c (stale) CRC-32 checksum value for chunk [0, 0x827d): Mirror 1: 0xe4a8514c Mirror 25: 0xe4a8514c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x827d: skipped 000988 1788306926.564550 punch from 0x00483f to 0x0076c3 (0x2e85 bytes) 000989 1788306926.652768 MIRROR_RESYNC 9 mirrors 000990 1788306928.600653 mapread 0x003910 thru 0x005769 (0x1e5a bytes) 000991 1788306928.639333 read 0x0014b9 thru 0x00827c (0x6dc4 bytes) 000992 1788306928.640888 write 0x018d56 thru 0x022bda (0x9e85 bytes) 000993 1788306928.717767 MIRROR_RESYNC 9 mirrors 000994 1788306931.208463 write 0x01ec4d thru 0x020b53 (0x1f07 bytes) 000995 1788306931.290162 trunc from 0x015599 to 0x0227d0 (0xd238 bytes) 000996 1788306931.321125 fallocate 0x01f698 thru 0x0207b1 (0x111a bytes) 000997 1788306931.333361 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x22bdb): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22bdb): Mirror 13: 0x5bf64998 (stale) Mirror 15: 0x5bf64998 (stale) Mirror 16: 0x5bf64998 (stale) Mirror 17: 0x5bf64998 (stale) Mirror 19: 0x5bf64998 (stale) Mirror 23: 0x5bf64998 (stale) Mirror 24: 0x5bf64998 (stale) Mirror 25: 0x5bf64998 (stale) CRC-32 checksum value for chunk [0, 0x22bdb): Mirror 1: 0x49ac4b18 Mirror 26: 0x49ac4b18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22bdb: skipped 000998 1788306932.595435 trunc from 0x0132fc to 0x01a9cc (0x76d1 bytes) 001000 1788306932.654454 mapwrite 0x0065d0 thru 0x00b954 (0x5385 bytes) All operations completed A-OK!