== sanity-flr test 70a: flr mode fsx test ================ 03:24:45 (1789111485) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 1487 skipping zero length zero range fallocating to largest ever: 0x2b077 000004 1789111487.678878 fallocate 0x01d723 thru 0x02b076 (0xd954 bytes) 000005 1789111487.683517 fallocate 0x004a95 thru 0x01264e (0xdbba bytes) 000006 1789111487.688099 mapread 0x004044 thru 0x009fa6 (0x5f63 bytes) 000007 1789111487.708464 mapread 0x00b994 thru 0x00e78f (0x2dfc bytes) 000010 1789111487.713535 read 0x00014a thru 0x0036bd (0x3574 bytes) 000011 1789111487.718587 mapwrite 0x00a9d4 thru 0x00b986 (0xfb3 bytes) 000012 1789111487.745044 punch from 0x00e8f3 to 0x01264e (0x3d5c bytes) 000013 1789111487.767155 trunc from 0x01264f to 0x026b48 (0x144fa bytes) 000014 1789111487.794113 write 0x00e072 thru 0x01adc1 (0xcd50 bytes) 000015 1789111487.828916 mapwrite 0x032d56 thru 0x03adfb (0x80a6 bytes) 000016 1789111487.936925 mapread 0x00b975 thru 0x00f88e (0x3f1a bytes) 000017 1789111487.948061 mapwrite 0x00f731 thru 0x01ac2e (0xb4fe bytes) 000018 1789111488.000188 write 0x016eff thru 0x018690 (0x1792 bytes) 000019 1789111488.004071 mapread 0x0371c7 thru 0x03adfb (0x3c35 bytes) 000020 1789111488.007851 write 0x00bb92 thru 0x01a875 (0xece4 bytes) 000022 1789111488.011313 mapread 0x00a517 thru 0x017596 (0xd080 bytes) zero_range to largest ever: 0x3adfc 000023 1789111488.028608 trunc from 0x03a9fe to 0x03adfb (0x3fe bytes) 000024 1789111488.051309 punch from 0x033658 to 0x0396b4 (0x605d bytes) 000027 1789111488.059056 punch from 0x0021b7 to 0x00261c (0x466 bytes) 000029 1789111488.074287 trunc from 0x03adfc to 0x0237e6 (0x17615 bytes) 000031 1789111488.128896 read 0x01feb0 thru 0x0237e6 (0x3937 bytes) 000032 1789111488.164728 read 0x016056 thru 0x0237e6 (0xd791 bytes) 000033 1789111488.165919 trunc from 0x0237e7 to 0x034733 (0x10f4d bytes) 000034 1789111488.207486 punch from 0x0011fa to 0x00562c (0x4433 bytes) 000035 1789111488.214469 mapread 0x020836 thru 0x028654 (0x7e1f bytes) 000036 1789111488.278743 read 0x01f3a3 thru 0x0298e2 (0xa540 bytes) 000037 1789111488.283214 write 0x02e410 thru 0x03c851 (0xe442 bytes) 000038 1789111488.290675 read 0x01b6b3 thru 0x022e23 (0x7771 bytes) 000040 1789111488.300182 trunc from 0x03c852 to 0x024d39 (0x17b18 bytes) 000041 1789111488.347678 trunc from 0x024d3a to 0x00e18a (0x16baf bytes) fallocating to largest ever: 0x3c248 000044 1789111488.396932 fallocate 0x038712 thru 0x03c247 (0x3b36 bytes) 000045 1789111488.416644 mapread 0x02b255 thru 0x033881 (0x862d bytes) 000046 1789111488.452493 write 0x00983f thru 0x0157fb (0xbfbd bytes) 000047 1789111488.454446 fallocate 0x00877c thru 0x010c6f (0x84f4 bytes) 000048 1789111488.469430 MIRROR_EXTEND to 2 mirrors 000049 1789111489.053302 read 0x02883b thru 0x029445 (0xc0b bytes) 000050 1789111489.063453 MIRROR_EXTEND to 3 mirrors 000051 1789111489.615219 trunc from 0x0161ba to 0x020b33 (0xa97a bytes) 000053 1789111489.648197 trunc from 0x01238e to 0x01c0a4 (0x9d17 bytes) 000054 1789111489.653622 punch from 0x03a99a to 0x03c247 (0x18ae bytes) 000055 1789111489.660588 trunc from 0x00a44f to 0x00e0f9 (0x3cab bytes) 000057 1789111489.664635 punch from 0x00ff04 to 0x010b64 (0xc61 bytes) fallocating to largest ever: 0x3d42a 000058 1789111489.668408 fallocate 0x039e22 thru 0x03d429 (0x3608 bytes) 000059 1789111489.673631 trunc from 0x014702 to 0x022089 (0xd988 bytes) 000060 1789111489.678311 mapwrite 0x0241f5 thru 0x029663 (0x546f bytes) 000061 1789111489.718140 fallocate 0x01820f thru 0x0197d1 (0x15c3 bytes) 000062 1789111489.727671 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c248): Mirror 3: 0x82d9e220 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c248): Mirror 3: 0x82d9e220 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c248: skipped 000063 1789111490.112257 MIRROR_RESYNC 2 mirrors fallocating to largest ever: 0x40000 000064 1789111490.802058 fallocate 0x03d841 thru 0x03ffff (0x27bf bytes) 000065 1789111490.889889 trunc from 0x0385da to 0x03c247 (0x3c6e bytes) 000066 1789111490.904863 mapread 0x03ad83 thru 0x03c247 (0x14c5 bytes) 000067 1789111490.949222 MIRROR_RESYNC 2 mirrors 000068 1789111491.960409 trunc from 0x03c248 to 0x01b317 (0x20f30 bytes) 000070 1789111492.012655 read 0x00e936 thru 0x0120b6 (0x3781 bytes) 000071 1789111492.023569 mapread 0x00619e thru 0x00b596 (0x53f9 bytes) 000073 1789111492.049774 mapwrite 0x01783d thru 0x019413 (0x1bd7 bytes) 000074 1789111492.072394 punch from 0x00aa91 to 0x014984 (0x9ef4 bytes) 000076 1789111492.088921 MIRROR_RESYNC 2 mirrors 000077 1789111492.799482 fallocate 0x01c086 thru 0x024e70 (0x8deb bytes) 000078 1789111492.837470 fallocate 0x00cfee thru 0x0134f0 (0x6503 bytes) 000079 1789111492.843125 write 0x01b068 thru 0x029c15 (0xebae bytes) 000080 1789111492.852491 trunc from 0x029c16 to 0x02728e (0x2987 bytes) 000081 1789111492.898143 mapwrite 0x00e0ca thru 0x00e58b (0x4c2 bytes) 000082 1789111492.920539 fallocate 0x02343a thru 0x023ae6 (0x6ad bytes) 000083 1789111492.925577 punch from 0x0237f3 to 0x02728e (0x3a9c bytes) 000084 1789111492.931447 fallocate 0x01edbe thru 0x029ddb (0xb01e bytes) 000085 1789111492.942320 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) 000086 1789111493.083612 read 0x0104fa thru 0x0111ec (0xcf3 bytes) 000089 1789111493.091916 mapread 0x017e41 thru 0x01c973 (0x4b33 bytes) 000090 1789111493.115856 mapread 0x009ce1 thru 0x00ace7 (0x1007 bytes) 000091 1789111493.126344 punch from 0x00b82c to 0x016aa9 (0xb27e bytes) 000092 1789111493.131354 fallocate 0x03bfcd thru 0x03ffff (0x4033 bytes) 000093 1789111493.136456 punch from 0x02d873 to 0x035f78 (0x8706 bytes) 000094 1789111493.142622 mapread 0x03abd4 thru 0x03ffff (0x542c bytes) 000095 1789111493.153459 mapwrite 0x014bea thru 0x020623 (0xba3a bytes) 000096 1789111493.181587 trunc from 0x03c223 to 0x03ffff (0x3ddd bytes) 000097 1789111493.187430 fallocate 0x03dabc thru 0x03ffff (0x2544 bytes) 000098 1789111493.191987 write 0x00b724 thru 0x01247c (0x6d59 bytes) 000099 1789111493.204007 trunc from 0x040000 to 0x01b9d2 (0x2462d bytes) 000101 1789111493.225320 mapwrite 0x03ae1f thru 0x03ffff (0x51e1 bytes) 000102 1789111493.268792 MIRROR_EXTEND to 2 mirrors 000103 1789111494.029967 punch from 0x031190 to 0x035729 (0x459a bytes) 000104 1789111494.077152 trunc from 0x040000 to 0x00a4e8 (0x35b17 bytes) 000105 1789111494.132544 punch from 0x008889 to 0x00a4e8 (0x1c60 bytes) 000106 1789111494.143901 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xa4e9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa4e9): Mirror 2: 0x26c3a3ab (stale) CRC-32 checksum value for chunk [0, 0xa4e9): Mirror 1: 0x30b18ca8 Mirror 3: 0x30b18ca8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa4e9: skipped 000107 1789111495.216874 write 0x0029fd thru 0x00b370 (0x8974 bytes) 000108 1789111495.279062 fallocate 0x00f28d thru 0x01100f (0x1d83 bytes) 000109 1789111495.290362 read 0x00abe4 thru 0x01100f (0x642c bytes) 000110 1789111495.304282 mapwrite 0x0005ab thru 0x008c9d (0x86f3 bytes) 000111 1789111495.358143 trunc from 0x011010 to 0x026341 (0x15332 bytes) 000112 1789111495.421591 read 0x0001b7 thru 0x00c7b5 (0xc5ff bytes) 000113 1789111495.423474 mapread 0x01c10c thru 0x025783 (0x9678 bytes) 000115 1789111495.452014 punch from 0x01a735 to 0x0248af (0xa17b bytes) 000116 1789111495.477531 mapread 0x00cf4b thru 0x00da75 (0xb2b bytes) 000117 1789111495.479083 trunc from 0x024518 to 0x026341 (0x1e2a bytes) 000118 1789111495.495608 read 0x00d417 thru 0x01518b (0x7d75 bytes) 000119 1789111495.497549 read 0x025ff5 thru 0x026341 (0x34d bytes) 000120 1789111495.522812 MIRROR_RESYNC 3 mirrors 000121 1789111496.497630 trunc from 0x01752d to 0x018d5c (0x1830 bytes) 000122 1789111496.541626 fallocate 0x01a1b6 thru 0x01c35f (0x21aa bytes) 000123 1789111496.553842 write 0x01fc99 thru 0x02bc4b (0xbfb3 bytes) 000124 1789111496.570547 MIRROR_RESYNC 3 mirrors 000125 1789111497.559632 MIRROR_EXTEND to 4 mirrors 000126 1789111498.506963 punch from 0x00dc93 to 0x012713 (0x4a81 bytes) 000127 1789111498.583370 mapwrite 0x02547b thru 0x027fa9 (0x2b2f bytes) 000128 1789111498.679037 read 0x001e76 thru 0x00345a (0x15e5 bytes) 000129 1789111498.690233 read 0x0295c8 thru 0x02bc4b (0x2684 bytes) 000130 1789111498.695109 trunc from 0x02bc4c to 0x026e44 (0x4e07 bytes) 000131 1789111498.729269 read 0x01ef29 thru 0x026e44 (0x7f1c bytes) 000132 1789111498.770579 mapwrite 0x03f4fd thru 0x03ffff (0xb03 bytes) 000133 1789111498.842629 fallocate 0x0197fb thru 0x027f7b (0xe781 bytes) 000134 1789111498.848651 write 0x01ff83 thru 0x026fec (0x706a bytes) 000135 1789111498.850528 punch from 0x02e2b5 to 0x03543d (0x7189 bytes) 000136 1789111498.855917 trunc from 0x040000 to 0x01f99d (0x20662 bytes) 000137 1789111498.871864 punch from 0x010825 to 0x01b462 (0xac3e bytes) 000138 1789111498.877122 punch from 0x01ccc5 to 0x01f99d (0x2cd9 bytes) 000139 1789111498.889549 trunc from 0x008580 to 0x017f1a (0xf99b bytes) 000140 1789111498.899817 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f99e): Mirror 3: 0xad3fc29a (stale) Mirror 4: 0xad3fc29a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f99e): Mirror 3: 0xad3fc29a (stale) Mirror 4: 0xad3fc29a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f99e: skipped 000142 1789111499.232160 trunc from 0x00608c to 0x01349e (0xd413 bytes) 000143 1789111499.242849 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1f99e): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f99e): Mirror 3: 0xad3fc29a (stale) Mirror 4: 0xad3fc29a (stale) CRC-32 checksum value for chunk [0, 0x1f99e): Mirror 1: 0x45603aa8 Mirror 5: 0x45603aa8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f99e: skipped 000144 1789111500.245791 punch from 0x001910 to 0x00592d (0x401e bytes) 000145 1789111500.288530 trunc from 0x004ac2 to 0x0052ef (0x82e bytes) 000146 1789111500.294473 read 0x016c30 thru 0x0175b4 (0x985 bytes) 000147 1789111500.300442 punch from 0x00819d to 0x00887c (0x6e0 bytes) 000148 1789111500.305497 trunc from 0x01f99e to 0x011472 (0xe52b bytes) 000149 1789111500.336707 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x11473): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11473): Mirror 3: 0xca3aba81 (stale) Mirror 4: 0xca3aba81 (stale) Mirror 5: 0x95afbb30 (stale) CRC-32 checksum value for chunk [0, 0x11473): Mirror 1: 0xb27d3a3c Mirror 6: 0xb27d3a3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11473: skipped 000150 1789111501.189773 read 0x0048dd thru 0x00dc2b (0x934f bytes) 000152 1789111501.219169 trunc from 0x008b91 to 0x011472 (0x88e2 bytes) 000153 1789111501.279223 fallocate 0x0195a6 thru 0x021f72 (0x89cd bytes) 000154 1789111501.288985 mapread 0x00aa50 thru 0x010d20 (0x62d1 bytes) 000155 1789111501.337429 mapread 0x009d9b thru 0x012437 (0x869d bytes) 000156 1789111501.339583 punch from 0x00d93a to 0x01ba7d (0xe144 bytes) 000157 1789111501.349825 trunc from 0x021f73 to 0x021e09 (0x169 bytes) 000159 1789111501.447384 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x21e0a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21e0a): Mirror 3: 0x7fc4be95 (stale) Mirror 4: 0x7fc4be95 (stale) Mirror 5: 0xcbedd7fd (stale) Mirror 6: 0x1f5ecc31 (stale) CRC-32 checksum value for chunk [0, 0x21e0a): Mirror 1: 0x1f5ecc31 Mirror 7: 0x1f5ecc31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21e0a: skipped 000160 1789111502.276971 mapwrite 0x00dffb thru 0x018c17 (0xac1d bytes) 000161 1789111502.416961 read 0x01c49d thru 0x01c957 (0x4bb bytes) 000162 1789111502.417809 read 0x017eb8 thru 0x021e09 (0x9f52 bytes) 000163 1789111502.445336 write 0x01cd2b thru 0x027c5e (0xaf34 bytes) 000164 1789111502.452116 punch from 0x00f770 to 0x01d4ce (0xdd5f bytes) 000165 1789111502.475018 punch from 0x0205af to 0x025134 (0x4b86 bytes) 000166 1789111502.496030 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x27c5f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27c5f): Mirror 3: 0x969ae3bc (stale) Mirror 4: 0x969ae3bc (stale) Mirror 5: 0xe12e2555 (stale) Mirror 6: 0x86e89fef (stale) Mirror 7: 0x86e89fef (stale) CRC-32 checksum value for chunk [0, 0x27c5f): Mirror 1: 0xacaff826 Mirror 8: 0xacaff826 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27c5f: skipped 000168 1789111503.449970 write 0x00ed38 thru 0x00ed78 (0x41 bytes) 000169 1789111503.483460 punch from 0x000092 to 0x0011df (0x114e bytes) 000170 1789111503.490055 trunc from 0x027c5f to 0x0166e6 (0x11578 bytes) 000171 1789111503.533887 fallocate 0x03e6ee thru 0x03ffff (0x1912 bytes) 000172 1789111503.539457 fallocate 0x025035 thru 0x032cfc (0xdcc8 bytes) 000173 1789111503.543991 write 0x03bd99 thru 0x03ffff (0x4267 bytes) 000174 1789111503.550034 punch from 0x028a57 to 0x0321f0 (0x979a bytes) 000175 1789111503.554911 read 0x026b22 thru 0x02f5a1 (0x8a80 bytes) 000176 1789111503.570504 punch from 0x024fb1 to 0x02a56f (0x55bf bytes) 000177 1789111503.580639 trunc from 0x040000 to 0x03947b (0x6b84 bytes) 000178 1789111503.609665 trunc from 0x019a7f to 0x01cd83 (0x3305 bytes) 000180 1789111503.616264 trunc from 0x03947c to 0x00713e (0x3233d bytes) 000181 1789111503.634261 mapread 0x004c53 thru 0x006117 (0x14c5 bytes) 000182 1789111503.647704 read 0x000b9b thru 0x0015fb (0xa61 bytes) 000183 1789111503.654164 write 0x0002e1 thru 0x00e304 (0xe024 bytes) 000184 1789111503.655838 mapwrite 0x020110 thru 0x029a21 (0x9912 bytes) 000185 1789111503.742090 mapwrite 0x03239d thru 0x03b82f (0x9493 bytes) 000186 1789111503.829549 MIRROR_RESYNC 7 mirrors 000187 1789111505.570890 fallocate 0x035fc6 thru 0x03b19e (0x51d9 bytes) 000189 1789111505.603545 trunc from 0x001347 to 0x006c1f (0x58d9 bytes) 000190 1789111505.619068 mapread 0x00163c thru 0x00ddcf (0xc794 bytes) 000191 1789111505.674070 read 0x039019 thru 0x03b82f (0x2817 bytes) 000192 1789111505.703255 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b830): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b830): Mirror 3: 0xc32ae2ca (stale) Mirror 4: 0xc32ae2ca (stale) Mirror 5: 0xc32ae2ca (stale) Mirror 6: 0xc32ae2ca (stale) Mirror 7: 0xc32ae2ca (stale) Mirror 8: 0xc32ae2ca (stale) CRC-32 checksum value for chunk [0, 0x3b830): Mirror 1: 0x407655b7 Mirror 9: 0x407655b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b830: skipped 000193 1789111506.825070 punch from 0x0233b6 to 0x02eda0 (0xb9eb bytes) 000194 1789111506.878559 MIRROR_RESYNC 8 mirrors 000195 1789111509.443646 write 0x0374e1 thru 0x038c1a (0x173a bytes) 000197 1789111509.498003 mapread 0x006e7a thru 0x00b103 (0x428a bytes) 000198 1789111509.512910 punch from 0x035d34 to 0x035dc1 (0x8e bytes) 000200 1789111509.518569 trunc from 0x03b830 to 0x004181 (0x376ae bytes) 000201 1789111509.539888 mapwrite 0x03ed85 thru 0x03ffff (0x127b bytes) 000202 1789111509.633243 fallocate 0x021854 thru 0x021dd0 (0x57d bytes) 000203 1789111509.643049 mapwrite 0x01e2a6 thru 0x0212a9 (0x3004 bytes) 000204 1789111509.719198 punch from 0x014551 to 0x020ca2 (0xc752 bytes) 000205 1789111509.723963 trunc from 0x01bb0d to 0x028983 (0xce77 bytes) 000206 1789111509.752779 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x160a0f (stale) Mirror 4: 0x160a0f (stale) Mirror 5: 0x160a0f (stale) Mirror 6: 0x160a0f (stale) Mirror 7: 0x160a0f (stale) Mirror 8: 0x160a0f (stale) Mirror 9: 0x160a0f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8e164a20 Mirror 10: 0x8e164a20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000207 1789111510.823284 read 0x016d86 thru 0x01773b (0x9b6 bytes) 000208 1789111510.853927 mapwrite 0x03c45d thru 0x03ffff (0x3ba3 bytes) 000209 1789111511.000850 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x160a0f (stale) Mirror 4: 0x160a0f (stale) Mirror 5: 0x160a0f (stale) Mirror 6: 0x160a0f (stale) Mirror 7: 0x160a0f (stale) Mirror 8: 0x160a0f (stale) Mirror 9: 0x160a0f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x160a0f (stale) Mirror 4: 0x160a0f (stale) Mirror 5: 0x160a0f (stale) Mirror 6: 0x160a0f (stale) Mirror 7: 0x160a0f (stale) Mirror 8: 0x160a0f (stale) Mirror 9: 0x160a0f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000210 1789111511.548485 trunc from 0x02de08 to 0x03d46b (0xf664 bytes) 000211 1789111511.558674 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x160a0f (stale) Mirror 4: 0x160a0f (stale) Mirror 5: 0x160a0f (stale) Mirror 6: 0x160a0f (stale) Mirror 7: 0x160a0f (stale) Mirror 8: 0x160a0f (stale) Mirror 9: 0x160a0f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf5290c8 Mirror 10: 0xf5290c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000212 1789111512.555738 mapwrite 0x0293b8 thru 0x03555b (0xc1a4 bytes) 000213 1789111512.709792 mapwrite 0x012f5c thru 0x0170c8 (0x416d bytes) 000214 1789111512.742046 trunc from 0x040000 to 0x0231e7 (0x1ce18 bytes) 000215 1789111512.765963 read 0x0123e7 thru 0x013113 (0xd2d bytes) 000216 1789111512.766620 mapwrite 0x015722 thru 0x01a3cc (0x4cab bytes) 000217 1789111512.784263 mapread 0x00e077 thru 0x01809a (0xa024 bytes) 000218 1789111512.785472 trunc from 0x012175 to 0x018637 (0x64c3 bytes) 000219 1789111512.790814 mapread 0x016f05 thru 0x02270a (0xb806 bytes) 000220 1789111512.804944 write 0x01f91f thru 0x02ef96 (0xf678 bytes) 000221 1789111512.806577 mapread 0x00e1e4 thru 0x01c3a3 (0xe1c0 bytes) 000222 1789111512.809379 punch from 0x027254 to 0x02ef96 (0x7d43 bytes) 000223 1789111512.822487 trunc from 0x022ad0 to 0x02b1dd (0x870e bytes) 000224 1789111512.827784 punch from 0x00fa9d to 0x01afa7 (0xb50b bytes) 000225 1789111512.832910 trunc from 0x02ef97 to 0x007601 (0x27995 bytes) 000226 1789111512.850764 trunc from 0x007602 to 0x03b82c (0x3422b bytes) 000228 1789111512.863191 mapwrite 0x01d483 thru 0x02a75a (0xd2d8 bytes) 000229 1789111512.898384 mapwrite 0x022c36 thru 0x02d5bf (0xa98a bytes) 000230 1789111512.917233 write 0x010663 thru 0x016d6e (0x670c bytes) 000231 1789111512.926543 fallocate 0x0385fe thru 0x03ffff (0x7a02 bytes) 000232 1789111512.938000 punch from 0x0047ee to 0x00c9c1 (0x81d4 bytes) 000233 1789111512.951115 MIRROR_RESYNC 9 mirrors 000234 1789111514.962204 fallocate 0x012218 thru 0x015de7 (0x3bd0 bytes) 000235 1789111515.061612 mapread 0x0194a0 thru 0x01f318 (0x5e79 bytes) 000237 1789111515.091583 trunc from 0x00908a to 0x013416 (0xa38d bytes) 000238 1789111515.097518 trunc from 0x03b82d to 0x009b03 (0x31d29 bytes) 000239 1789111515.122928 fallocate 0x0123f3 thru 0x01e0d8 (0xbce6 bytes) 000240 1789111515.138477 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x9b04): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9b04): Mirror 3: 0xa2d897ad (stale) Mirror 4: 0xa2d897ad (stale) Mirror 5: 0xa2d897ad (stale) Mirror 6: 0xa2d897ad (stale) Mirror 7: 0xa2d897ad (stale) Mirror 8: 0xa2d897ad (stale) Mirror 9: 0xa2d897ad (stale) Mirror 10: 0xa2d897ad (stale) CRC-32 checksum value for chunk [0, 0x9b04): Mirror 1: 0xa2d897ad Mirror 11: 0xa2d897ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9b04: skipped 000241 1789111516.124547 trunc from 0x001f5f to 0x009b03 (0x7ba5 bytes) 000242 1789111516.176038 trunc from 0x00146b to 0x009b03 (0x8699 bytes) 000243 1789111516.190620 read 0x0034d4 thru 0x006659 (0x3186 bytes) 000244 1789111516.221965 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x9b04): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9b04): Mirror 3: 0xa2d897ad (stale) Mirror 4: 0xa2d897ad (stale) Mirror 5: 0xa2d897ad (stale) Mirror 6: 0xa2d897ad (stale) Mirror 7: 0xa2d897ad (stale) Mirror 8: 0xa2d897ad (stale) Mirror 9: 0xa2d897ad (stale) Mirror 10: 0xa2d897ad (stale) Mirror 11: 0xa2d897ad (stale) CRC-32 checksum value for chunk [0, 0x9b04): Mirror 1: 0xa2d897ad Mirror 12: 0xa2d897ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9b04: skipped 000245 1789111517.419906 fallocate 0x01a188 thru 0x0207b5 (0x662e bytes) 000246 1789111517.474741 mapwrite 0x03f1cc thru 0x03ff63 (0xd98 bytes) 000247 1789111517.518846 punch from 0x006be5 to 0x00758a (0x9a6 bytes) 000248 1789111517.523280 mapwrite 0x02f5f6 thru 0x036c08 (0x7613 bytes) 000249 1789111517.556467 trunc from 0x03ff64 to 0x02e610 (0x11953 bytes) 000251 1789111517.572332 read 0x009505 thru 0x00a774 (0x1270 bytes) 000252 1789111517.579713 mapwrite 0x01b0c0 thru 0x02846f (0xd3b0 bytes) 000253 1789111517.621863 mapwrite 0x0301ce thru 0x034671 (0x44a4 bytes) 000254 1789111517.675941 mapread 0x017e27 thru 0x0212aa (0x9484 bytes) 000255 1789111517.678332 mapwrite 0x0332b3 thru 0x03ffff (0xcd4d bytes) 000256 1789111517.742135 mapread 0x028966 thru 0x0354a0 (0xcb3b bytes) 000257 1789111517.743504 mapread 0x008768 thru 0x00b6f9 (0x2f92 bytes) 000258 1789111517.758982 mapread 0x01d346 thru 0x0267e2 (0x949d bytes) 000259 1789111517.763206 read 0x018ed3 thru 0x020303 (0x7431 bytes) 000260 1789111517.763961 mapread 0x027839 thru 0x037000 (0xf7c8 bytes) 000261 1789111517.777513 MIRROR_RESYNC 11 mirrors 000262 1789111520.403350 MIRROR_RESYNC 11 mirrors 000263 1789111521.071853 read 0x00992b thru 0x00ac64 (0x133a bytes) 000264 1789111521.078008 punch from 0x031972 to 0x036a3f (0x50ce bytes) 000265 1789111521.112513 mapwrite 0x02b4c0 thru 0x036de1 (0xb922 bytes) 000266 1789111521.164989 mapread 0x00112c thru 0x00d254 (0xc129 bytes) 000267 1789111521.179296 mapread 0x03381b thru 0x036970 (0x3156 bytes) 000268 1789111521.181283 trunc from 0x013674 to 0x016d01 (0x368e bytes) 000270 1789111521.190564 punch from 0x01d89b to 0x0201d9 (0x293f bytes) 000271 1789111521.210236 write 0x021f3b thru 0x023b90 (0x1c56 bytes) 000272 1789111521.243173 trunc from 0x040000 to 0x016502 (0x29afd bytes) 000273 1789111521.271247 mapwrite 0x00e46a thru 0x01e00d (0xfba4 bytes) 000274 1789111521.337365 fallocate 0x03050a thru 0x03ffff (0xfaf6 bytes) 000275 1789111521.349375 read 0x0029b2 thru 0x00815f (0x57ae bytes) 000276 1789111521.356563 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x99306cc (stale) Mirror 4: 0x99306cc (stale) Mirror 5: 0x99306cc (stale) Mirror 6: 0x99306cc (stale) Mirror 7: 0x99306cc (stale) Mirror 8: 0x99306cc (stale) Mirror 9: 0x99306cc (stale) Mirror 10: 0x99306cc (stale) Mirror 11: 0x99306cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x99306cc (stale) Mirror 4: 0x99306cc (stale) Mirror 5: 0x99306cc (stale) Mirror 6: 0x99306cc (stale) Mirror 7: 0x99306cc (stale) Mirror 8: 0x99306cc (stale) Mirror 9: 0x99306cc (stale) Mirror 10: 0x99306cc (stale) Mirror 11: 0x99306cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000277 1789111522.003972 read 0x03593b thru 0x03c7b9 (0x6e7f bytes) 000278 1789111522.018584 punch from 0x00f981 to 0x017479 (0x7af9 bytes) 000279 1789111522.027802 write 0x020de9 thru 0x0245bb (0x37d3 bytes) 000280 1789111522.050680 read 0x012b15 thru 0x01d903 (0xadef bytes) 000281 1789111522.086155 MIRROR_RESYNC 10 mirrors 000282 1789111525.484456 trunc from 0x014754 to 0x018550 (0x3dfd bytes) 000283 1789111525.558960 read 0x037277 thru 0x03ffff (0x8d89 bytes) 000285 1789111525.572223 write 0x03c4f5 thru 0x03ffff (0x3b0b bytes) 000286 1789111525.573940 write 0x0273ab thru 0x03138b (0x9fe1 bytes) 000287 1789111525.585390 write 0x019d06 thru 0x024faf (0xb2aa bytes) 000288 1789111525.601259 trunc from 0x00f112 to 0x01c905 (0xd7f4 bytes) 000289 1789111525.642624 fallocate 0x028f9c thru 0x032bae (0x9c13 bytes) 000290 1789111525.656237 punch from 0x008556 to 0x017f57 (0xfa02 bytes) 000291 1789111525.665453 fallocate 0x031f19 thru 0x037663 (0x574b bytes) 000292 1789111525.679254 write 0x038df2 thru 0x03a413 (0x1622 bytes) 000294 1789111525.684499 punch from 0x03c8be to 0x03ffff (0x3742 bytes) 000295 1789111525.694284 write 0x0021b5 thru 0x00feb6 (0xdd02 bytes) 000296 1789111525.704766 mapread 0x02e618 thru 0x03205d (0x3a46 bytes) 000297 1789111525.737937 trunc from 0x0162c2 to 0x01ad4e (0x4a8d bytes) 000298 1789111525.751840 trunc from 0x040000 to 0x0132a3 (0x2cd5c bytes) 000299 1789111525.790421 punch from 0x002b3b to 0x003ea3 (0x1369 bytes) 000300 1789111525.818351 mapwrite 0x0123fe thru 0x022277 (0xfe7a bytes) 000301 1789111525.886331 trunc from 0x022278 to 0x006283 (0x1bff4 bytes) 000302 1789111525.903914 punch from 0x004a6d to 0x006283 (0x1817 bytes) 000303 1789111525.910467 punch from 0x00136d to 0x006283 (0x4f17 bytes) 000304 1789111525.916252 punch from 0x001012 to 0x006283 (0x5272 bytes) 000305 1789111525.924581 punch from 0x004490 to 0x006283 (0x1df4 bytes) 000306 1789111525.929951 punch from 0x001e54 to 0x006283 (0x4430 bytes) 000307 1789111525.935396 mapread 0x000cc6 thru 0x006283 (0x55be bytes) 000309 1789111525.947084 write 0x00372c thru 0x00d485 (0x9d5a bytes) 000310 1789111525.954469 MIRROR_RESYNC 10 mirrors 000311 1789111527.686478 mapwrite 0x00415e thru 0x010d3f (0xcbe2 bytes) 000312 1789111527.831385 trunc from 0x008a4e to 0x010d3f (0x82f2 bytes) 000313 1789111527.837555 fallocate 0x0328a7 thru 0x03df3e (0xb698 bytes) 000314 1789111527.847230 fallocate 0x0289c2 thru 0x02a43f (0x1a7e bytes) 000315 1789111527.861885 punch from 0x02906c to 0x029aa6 (0xa3b bytes) 000317 1789111527.870309 read 0x03b40b thru 0x03df3e (0x2b34 bytes) 000318 1789111527.884772 read 0x01f7fc thru 0x022ed7 (0x36dc bytes) 000321 1789111527.911278 write 0x039a56 thru 0x03ffff (0x65aa bytes) 000323 1789111527.916773 fallocate 0x037518 thru 0x03bb58 (0x4641 bytes) 000325 1789111527.926867 write 0x0268c7 thru 0x02f238 (0x8972 bytes) 000328 1789111527.930925 punch from 0x02daaf to 0x036d14 (0x9266 bytes) 000329 1789111527.952175 punch from 0x014b7b to 0x01ef5a (0xa3e0 bytes) 000330 1789111527.959229 punch from 0x024691 to 0x02f7fd (0xb16d bytes) 000331 1789111527.968597 read 0x003417 thru 0x0078ce (0x44b8 bytes) 000332 1789111527.972872 MIRROR_RESYNC 10 mirrors 000333 1789111530.876135 mapread 0x01b278 thru 0x02193b (0x66c4 bytes) 000334 1789111530.894543 mapwrite 0x015c04 thru 0x01e110 (0x850d bytes) 000335 1789111531.026378 mapread 0x011c3c thru 0x014055 (0x241a bytes) 000336 1789111531.036056 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8abe27a (stale) Mirror 4: 0x8abe27a (stale) Mirror 5: 0x8abe27a (stale) Mirror 6: 0x8abe27a (stale) Mirror 7: 0x8abe27a (stale) Mirror 8: 0x8abe27a (stale) Mirror 9: 0x8abe27a (stale) Mirror 10: 0x8abe27a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8abe27a (stale) Mirror 4: 0x8abe27a (stale) Mirror 5: 0x8abe27a (stale) Mirror 6: 0x8abe27a (stale) Mirror 7: 0x8abe27a (stale) Mirror 8: 0x8abe27a (stale) Mirror 9: 0x8abe27a (stale) Mirror 10: 0x8abe27a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000337 1789111531.895890 trunc from 0x0386d3 to 0x03ffff (0x792d bytes) 000339 1789111531.904455 mapwrite 0x039a3b thru 0x03ffff (0x65c5 bytes) 000340 1789111531.965676 fallocate 0x038ff4 thru 0x03ffff (0x700c bytes) 000341 1789111531.976349 write 0x021e64 thru 0x02c66c (0xa809 bytes) 000342 1789111532.021318 mapwrite 0x01e279 thru 0x02113c (0x2ec4 bytes) 000343 1789111532.060633 punch from 0x021248 to 0x0248d4 (0x368d bytes) 000344 1789111532.079019 MIRROR_RESYNC 9 mirrors 000345 1789111535.106230 punch from 0x0061c2 to 0x008d46 (0x2b85 bytes) 000346 1789111535.150104 write 0x0043cc thru 0x01394a (0xf57f bytes) 000347 1789111535.168913 mapread 0x02dbf5 thru 0x039d74 (0xc180 bytes) 000349 1789111535.190124 trunc from 0x0224bc to 0x030987 (0xe4cc bytes) 000350 1789111535.196561 write 0x006c90 thru 0x0110a1 (0xa412 bytes) 000352 1789111535.199656 mapread 0x03e982 thru 0x03ffff (0x167e bytes) 000353 1789111535.209418 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1116ef8f (stale) Mirror 5: 0x1116ef8f (stale) Mirror 6: 0x1116ef8f (stale) Mirror 7: 0x1116ef8f (stale) Mirror 8: 0x1116ef8f (stale) Mirror 9: 0x1116ef8f (stale) Mirror 10: 0x1116ef8f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1116ef8f (stale) Mirror 5: 0x1116ef8f (stale) Mirror 6: 0x1116ef8f (stale) Mirror 7: 0x1116ef8f (stale) Mirror 8: 0x1116ef8f (stale) Mirror 9: 0x1116ef8f (stale) Mirror 10: 0x1116ef8f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000354 1789111535.804449 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1116ef8f (stale) Mirror 5: 0x1116ef8f (stale) Mirror 6: 0x1116ef8f (stale) Mirror 7: 0x1116ef8f (stale) Mirror 8: 0x1116ef8f (stale) Mirror 9: 0x1116ef8f (stale) Mirror 10: 0x1116ef8f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2e79b016 Mirror 11: 0x2e79b016 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000356 1789111536.979808 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1116ef8f (stale) Mirror 5: 0x1116ef8f (stale) Mirror 6: 0x1116ef8f (stale) Mirror 7: 0x1116ef8f (stale) Mirror 8: 0x1116ef8f (stale) Mirror 9: 0x1116ef8f (stale) Mirror 10: 0x1116ef8f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1116ef8f (stale) Mirror 5: 0x1116ef8f (stale) Mirror 6: 0x1116ef8f (stale) Mirror 7: 0x1116ef8f (stale) Mirror 8: 0x1116ef8f (stale) Mirror 9: 0x1116ef8f (stale) Mirror 10: 0x1116ef8f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000357 1789111537.609520 trunc from 0x040000 to 0x037c8c (0x8373 bytes) 000359 1789111537.644265 punch from 0x01ef89 to 0x02a682 (0xb6fa bytes) 000360 1789111537.652548 mapwrite 0x02154a thru 0x029189 (0x7c40 bytes) 000361 1789111537.721334 fallocate 0x030d25 thru 0x03ffff (0xf2db bytes) 000362 1789111537.730047 read 0x015ee8 thru 0x017ba2 (0x1cbb bytes) 000363 1789111537.747838 mapread 0x027f8c thru 0x032139 (0xa1ae bytes) 000364 1789111537.759619 mapread 0x005df9 thru 0x00b2c3 (0x54cb bytes) 000365 1789111537.779260 MIRROR_RESYNC 8 mirrors 000366 1789111540.428517 punch from 0x003d31 to 0x00410b (0x3db bytes) 000367 1789111540.504168 mapwrite 0x0050f9 thru 0x0071d4 (0x20dc bytes) 000368 1789111540.543487 punch from 0x018bc0 to 0x01fe6c (0x72ad bytes) 000369 1789111540.551664 read 0x0296f3 thru 0x02e49b (0x4da9 bytes) 000370 1789111540.561681 write 0x005311 thru 0x0128bc (0xd5ac bytes) 000371 1789111540.570429 trunc from 0x000374 to 0x00c7a4 (0xc431 bytes) 000372 1789111540.591771 mapwrite 0x00d1af thru 0x019164 (0xbfb6 bytes) 000373 1789111540.622287 trunc from 0x037c8d to 0x037d22 (0x96 bytes) 000374 1789111540.646084 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37d23): Mirror 4: 0x45d2b7bc (stale) Mirror 5: 0x45d2b7bc (stale) Mirror 6: 0x45d2b7bc (stale) Mirror 8: 0x45d2b7bc (stale) Mirror 9: 0x45d2b7bc (stale) Mirror 10: 0x45d2b7bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d23): Mirror 4: 0x45d2b7bc (stale) Mirror 5: 0x45d2b7bc (stale) Mirror 6: 0x45d2b7bc (stale) Mirror 8: 0x45d2b7bc (stale) Mirror 9: 0x45d2b7bc (stale) Mirror 10: 0x45d2b7bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d23: skipped 000376 1789111541.139406 trunc from 0x01b26d to 0x01da20 (0x27b4 bytes) 000377 1789111541.159472 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x37d23): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d23): Mirror 4: 0x45d2b7bc (stale) Mirror 5: 0x45d2b7bc (stale) Mirror 6: 0x45d2b7bc (stale) Mirror 8: 0x45d2b7bc (stale) Mirror 9: 0x45d2b7bc (stale) Mirror 10: 0x45d2b7bc (stale) CRC-32 checksum value for chunk [0, 0x37d23): Mirror 1: 0x417351b4 Mirror 11: 0x417351b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d23: skipped 000378 1789111542.298073 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37d23): Mirror 5: 0x45d2b7bc (stale) Mirror 6: 0x45d2b7bc (stale) Mirror 8: 0x45d2b7bc (stale) Mirror 9: 0x45d2b7bc (stale) Mirror 10: 0x45d2b7bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d23): Mirror 5: 0x45d2b7bc (stale) Mirror 6: 0x45d2b7bc (stale) Mirror 8: 0x45d2b7bc (stale) Mirror 9: 0x45d2b7bc (stale) Mirror 10: 0x45d2b7bc (stale) CRC-32 checksum value for chunk [0, 0x37d23): Mirror 1: 0x417351b4 Mirror 11: 0x417351b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d23: skipped 000379 1789111543.213146 punch from 0x01cedf to 0x02547d (0x859f bytes) 000380 1789111543.269835 trunc from 0x00f59c to 0x018d96 (0x97fb bytes) 000381 1789111543.281644 read 0x011cef thru 0x0202f2 (0xe604 bytes) 000382 1789111543.305623 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37d23): Mirror 5: 0x45d2b7bc (stale) Mirror 6: 0x45d2b7bc (stale) Mirror 9: 0x45d2b7bc (stale) Mirror 10: 0x45d2b7bc (stale) Mirror 11: 0x417351b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d23): Mirror 5: 0x45d2b7bc (stale) Mirror 6: 0x45d2b7bc (stale) Mirror 9: 0x45d2b7bc (stale) Mirror 10: 0x45d2b7bc (stale) Mirror 11: 0x417351b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d23: skipped 000383 1789111543.907014 write 0x004423 thru 0x009d71 (0x594f bytes) 000384 1789111543.920412 trunc from 0x0373ad to 0x037d22 (0x976 bytes) 000385 1789111543.924576 trunc from 0x037d23 to 0x022daf (0x14f73 bytes) 000389 1789111543.946181 trunc from 0x022db0 to 0x02dfb6 (0xb207 bytes) 000390 1789111543.965996 punch from 0x005e30 to 0x00b196 (0x5367 bytes) 000391 1789111543.991897 punch from 0x01dfc9 to 0x01e2fd (0x335 bytes) 000392 1789111543.996516 mapread 0x02a79d thru 0x02b646 (0xeaa bytes) 000393 1789111544.017447 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dfb7): Mirror 5: 0x929c4621 (stale) Mirror 9: 0x929c4621 (stale) Mirror 10: 0x929c4621 (stale) Mirror 11: 0xad284ad1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dfb7): Mirror 5: 0x929c4621 (stale) Mirror 9: 0x929c4621 (stale) Mirror 10: 0x929c4621 (stale) Mirror 11: 0xad284ad1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dfb7: skipped 000394 1789111544.515980 mapwrite 0x027b3b thru 0x03183c (0x9d02 bytes) 000395 1789111544.605734 mapread 0x02ec85 thru 0x030857 (0x1bd3 bytes) 000396 1789111544.611127 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3183d): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3183d): Mirror 5: 0x7920cd0c (stale) Mirror 9: 0x7920cd0c (stale) Mirror 10: 0x7920cd0c (stale) Mirror 11: 0x4ac1d590 (stale) CRC-32 checksum value for chunk [0, 0x3183d): Mirror 1: 0x3cebec93 Mirror 12: 0x3cebec93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3183d: skipped 000400 1789111545.875182 read 0x0219eb thru 0x023e65 (0x247b bytes) 000401 1789111545.888397 write 0x0211ad thru 0x029456 (0x82aa bytes) 000404 1789111545.980246 read 0x01bef7 thru 0x025bb4 (0x9cbe bytes) 000405 1789111546.007730 fallocate 0x01a7e5 thru 0x0207b9 (0x5fd5 bytes) 000406 1789111546.017991 mapwrite 0x01fdfc thru 0x021ca5 (0x1eaa bytes) 000407 1789111546.040429 trunc from 0x00da86 to 0x00fee8 (0x2463 bytes) 000409 1789111546.047243 trunc from 0x03183d to 0x0039b4 (0x2de88 bytes) 000410 1789111546.074128 mapwrite 0x01e3ef thru 0x02c0f1 (0xdd03 bytes) 000411 1789111546.220100 mapwrite 0x009ea0 thru 0x01641d (0xc57e bytes) 000413 1789111546.328425 read 0x024182 thru 0x02c0f1 (0x7f70 bytes) 000414 1789111546.338274 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c0f2): Mirror 9: 0x4866a987 (stale) Mirror 10: 0x4866a987 (stale) Mirror 11: 0xff110569 (stale) Mirror 12: 0xa2ff0e63 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c0f2): Mirror 9: 0x4866a987 (stale) Mirror 10: 0x4866a987 (stale) Mirror 11: 0xff110569 (stale) Mirror 12: 0xa2ff0e63 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c0f2: skipped 000415 1789111546.722305 mapwrite 0x03494f thru 0x037227 (0x28d9 bytes) 000417 1789111546.778316 mapwrite 0x02d800 thru 0x0387eb (0xafec bytes) 000418 1789111546.837514 write 0x015952 thru 0x015ff4 (0x6a3 bytes) 000419 1789111546.854267 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x387ec): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x387ec): Mirror 9: 0x2cd5f4a (stale) Mirror 10: 0x2cd5f4a (stale) Mirror 11: 0x3abd7f63 (stale) Mirror 12: 0x2b1985f9 (stale) CRC-32 checksum value for chunk [0, 0x387ec): Mirror 1: 0x66730c3a Mirror 13: 0x66730c3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x387ec: skipped 000420 1789111548.026792 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x387ec): Mirror 10: 0x2cd5f4a (stale) Mirror 11: 0x3abd7f63 (stale) Mirror 12: 0x2b1985f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x387ec): Mirror 10: 0x2cd5f4a (stale) Mirror 11: 0x3abd7f63 (stale) Mirror 12: 0x2b1985f9 (stale) CRC-32 checksum value for chunk [0, 0x387ec): Mirror 1: 0x66730c3a Mirror 13: 0x66730c3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x387ec: skipped 000421 1789111548.844517 trunc from 0x0387ec to 0x021922 (0x16ec9 bytes) 000422 1789111548.987176 MIRROR_RESYNC 5 mirrors 000423 1789111550.503437 read 0x018cc2 thru 0x01f76b (0x6aaa bytes) 000424 1789111550.523430 fallocate 0x0370c9 thru 0x03ffff (0x8f37 bytes) 000425 1789111550.553134 mapread 0x00f4bd thru 0x01c1dd (0xcd21 bytes) 000426 1789111550.599544 read 0x005784 thru 0x00b2d7 (0x5b54 bytes) 000427 1789111550.617437 trunc from 0x007df8 to 0x008fb9 (0x11c2 bytes) 000429 1789111550.625523 fallocate 0x0080d5 thru 0x00dde6 (0x5d12 bytes) 000430 1789111550.631449 read 0x03d8f2 thru 0x03ffff (0x270e bytes) 000431 1789111550.632211 fallocate 0x02cadf thru 0x03b263 (0xe785 bytes) 000432 1789111550.641121 trunc from 0x01ab11 to 0x01f1e4 (0x46d4 bytes) 000433 1789111550.650997 trunc from 0x040000 to 0x00e380 (0x31c7f bytes) 000434 1789111550.683806 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xe381): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe381): Mirror 10: 0xa03a1382 (stale) Mirror 11: 0xa03a1382 (stale) Mirror 12: 0xa03a1382 (stale) Mirror 13: 0xa03a1382 (stale) CRC-32 checksum value for chunk [0, 0xe381): Mirror 1: 0xa03a1382 Mirror 14: 0xa03a1382 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe381: skipped 000435 1789111551.660187 fallocate 0x02bfe7 thru 0x039ea6 (0xdec0 bytes) 000436 1789111551.710456 mapwrite 0x009c40 thru 0x018602 (0xe9c3 bytes) 000437 1789111551.842480 mapwrite 0x034ee4 thru 0x037745 (0x2862 bytes) 000438 1789111551.889304 read 0x012cc4 thru 0x01bf3b (0x9278 bytes) 000439 1789111551.892249 write 0x022412 thru 0x02e743 (0xc332 bytes) 000440 1789111551.929963 punch from 0x00ed8e to 0x014f5e (0x61d1 bytes) 000441 1789111551.940181 mapread 0x00b7c9 thru 0x014e90 (0x96c8 bytes) 000442 1789111551.970352 trunc from 0x004c1d to 0x004dfb (0x1df bytes) 000444 1789111551.983809 read 0x0227fe thru 0x02ac3c (0x843f bytes) 000445 1789111551.988195 trunc from 0x039ea7 to 0x03d3ee (0x3548 bytes) 000446 1789111552.022803 punch from 0x00930a to 0x00990d (0x604 bytes) 000447 1789111552.029000 punch from 0x012d21 to 0x0228b0 (0xfb90 bytes) 000448 1789111552.058224 mapwrite 0x02014a thru 0x027d29 (0x7be0 bytes) 000449 1789111552.125274 read 0x000a08 thru 0x005fc9 (0x55c2 bytes) 000450 1789111552.125977 fallocate 0x03a5a9 thru 0x03cef6 (0x294e bytes) 000451 1789111552.141025 trunc from 0x02e70e to 0x033cd9 (0x55cc bytes) 000452 1789111552.162283 trunc from 0x00abbc to 0x01937e (0xe7c3 bytes) 000453 1789111552.180455 MIRROR_RESYNC 6 mirrors 000454 1789111554.127463 fallocate 0x0275f7 thru 0x03261a (0xb024 bytes) 000455 1789111554.191888 fallocate 0x005569 thru 0x012c93 (0xd72b bytes) 000456 1789111554.219469 read 0x00e492 thru 0x019112 (0xac81 bytes) 000457 1789111554.237897 fallocate 0x034bb6 thru 0x036ab1 (0x1efc bytes) 000458 1789111554.242820 write 0x029556 thru 0x02af96 (0x1a41 bytes) 000459 1789111554.273971 mapread 0x0175b2 thru 0x01d132 (0x5b81 bytes) 000460 1789111554.290412 mapwrite 0x03ad27 thru 0x03ffff (0x52d9 bytes) 000461 1789111554.414183 punch from 0x007d61 to 0x00b823 (0x3ac3 bytes) 000462 1789111554.426095 punch from 0x02f4fe to 0x03e9a0 (0xf4a3 bytes) 000463 1789111554.433816 mapwrite 0x017ab1 thru 0x01e9e2 (0x6f32 bytes) 000464 1789111554.482938 trunc from 0x040000 to 0x02b8d4 (0x1472b bytes) 000465 1789111554.523420 trunc from 0x01ff39 to 0x02b8d4 (0xb99c bytes) 000466 1789111554.560576 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b8d5): Mirror 10: 0x641ff802 (stale) Mirror 12: 0x641ff802 (stale) Mirror 13: 0x641ff802 (stale) Mirror 14: 0x641ff802 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b8d5): Mirror 10: 0x641ff802 (stale) Mirror 12: 0x641ff802 (stale) Mirror 13: 0x641ff802 (stale) Mirror 14: 0x641ff802 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b8d5: skipped 000467 1789111554.926755 trunc from 0x02b8d5 to 0x033b17 (0x8243 bytes) 000468 1789111554.949814 trunc from 0x033b18 to 0x0229f4 (0x11123 bytes) 000469 1789111554.973488 MIRROR_RESYNC 5 mirrors 000470 1789111555.907400 punch from 0x0188d8 to 0x022493 (0x9bbc bytes) 000471 1789111555.935742 fallocate 0x021aef thru 0x025fad (0x44bf bytes) 000472 1789111555.943333 fallocate 0x03c932 thru 0x03ffff (0x36ce bytes) 000473 1789111555.951192 trunc from 0x040000 to 0x001bfb (0x3e404 bytes) 000474 1789111555.972947 punch from 0x0008b5 to 0x001bfb (0x1347 bytes) 000475 1789111555.979287 write 0x00921f thru 0x012cdf (0x9ac1 bytes) 000476 1789111555.983939 mapwrite 0x03d7c5 thru 0x03ffff (0x283b bytes) 000477 1789111556.057525 trunc from 0x040000 to 0x033f35 (0xc0ca bytes) 000478 1789111556.083076 punch from 0x00e3fd to 0x01ccfc (0xe900 bytes) 000480 1789111556.088821 fallocate 0x027232 thru 0x02ffed (0x8dbc bytes) 000481 1789111556.092563 punch from 0x02f69b to 0x033f35 (0x489b bytes) 000482 1789111556.096837 read 0x01eab2 thru 0x029d39 (0xb288 bytes) 000483 1789111556.111599 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33f36): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f36): Mirror 10: 0xd061e66b (stale) Mirror 12: 0xd061e66b (stale) Mirror 13: 0xd061e66b (stale) Mirror 14: 0xd061e66b (stale) CRC-32 checksum value for chunk [0, 0x33f36): Mirror 1: 0x745dd7e6 Mirror 15: 0x745dd7e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f36: skipped 000484 1789111557.204391 punch from 0x031780 to 0x033f35 (0x27b6 bytes) 000485 1789111557.301781 write 0x0188fa thru 0x01e5f9 (0x5d00 bytes) 000486 1789111557.349673 trunc from 0x028869 to 0x033f35 (0xb6cd bytes) 000487 1789111557.358266 write 0x030689 thru 0x037c7d (0x75f5 bytes) 000488 1789111557.374302 fallocate 0x0126ca thru 0x01a2f1 (0x7c28 bytes) 000489 1789111557.382247 write 0x02e88b thru 0x03cc00 (0xe376 bytes) 000490 1789111557.386986 mapread 0x0062c0 thru 0x014105 (0xde46 bytes) 000491 1789111557.413412 mapread 0x01036b thru 0x01aeb1 (0xab47 bytes) 000492 1789111557.415412 mapread 0x0219f8 thru 0x029f25 (0x852e bytes) 000493 1789111557.429498 mapwrite 0x00de6f thru 0x017279 (0x940b bytes) 000494 1789111557.476653 trunc from 0x00e9d1 to 0x01dcce (0xf2fe bytes) 000495 1789111557.481767 trunc from 0x001ea3 to 0x00d409 (0xb567 bytes) 000496 1789111557.487820 mapwrite 0x025eff thru 0x02f516 (0x9618 bytes) 000497 1789111557.504944 read 0x0297d5 thru 0x037977 (0xe1a3 bytes) 000498 1789111557.509218 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3cc01): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc01): Mirror 10: 0x13b29118 (stale) Mirror 12: 0x13b29118 (stale) Mirror 13: 0x13b29118 (stale) Mirror 14: 0x13b29118 (stale) Mirror 15: 0xdc4d18de (stale) CRC-32 checksum value for chunk [0, 0x3cc01): Mirror 1: 0x39bdef68 Mirror 16: 0x39bdef68 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc01: skipped 000499 1789111559.031954 punch from 0x01802b to 0x019df8 (0x1dce bytes) 000500 1789111559.084259 punch from 0x02cfbe to 0x034b3c (0x7b7f bytes) 000501 1789111559.095979 write 0x0315e9 thru 0x03d93e (0xc356 bytes) 000502 1789111559.110413 fallocate 0x015b82 thru 0x01ff90 (0xa40f bytes) 000503 1789111559.121019 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d93f): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d93f): Mirror 10: 0xf4e24ab3 (stale) Mirror 12: 0xf4e24ab3 (stale) Mirror 13: 0xf4e24ab3 (stale) Mirror 14: 0xf4e24ab3 (stale) Mirror 15: 0xad6e0e59 (stale) Mirror 16: 0xbed44463 (stale) CRC-32 checksum value for chunk [0, 0x3d93f): Mirror 1: 0xd5f6ceb4 Mirror 17: 0xd5f6ceb4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d93f: skipped 000504 1789111560.386173 trunc from 0x033794 to 0x03c63b (0x8ea8 bytes) 000505 1789111560.447224 mapread 0x039ee5 thru 0x03d93e (0x3a5a bytes) 000506 1789111560.470430 write 0x03d248 thru 0x03ffff (0x2db8 bytes) 000507 1789111560.477411 punch from 0x014720 to 0x022c93 (0xe574 bytes) 000508 1789111560.483762 read 0x01a215 thru 0x020975 (0x6761 bytes) 000509 1789111560.493529 mapwrite 0x003586 thru 0x004e89 (0x1904 bytes) 000510 1789111560.527553 fallocate 0x0111ed thru 0x01e993 (0xd7a7 bytes) 000511 1789111560.536270 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x6e48a94f (stale) Mirror 12: 0x6e48a94f (stale) Mirror 13: 0x6e48a94f (stale) Mirror 14: 0x6e48a94f (stale) Mirror 15: 0x41258a0f (stale) Mirror 16: 0x519686db (stale) Mirror 17: 0xfdad448b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xec31cdce Mirror 18: 0xec31cdce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000512 1789111561.772501 fallocate 0x006180 thru 0x0112d2 (0xb153 bytes) 000513 1789111561.827008 mapread 0x03a41d thru 0x03ffff (0x5be3 bytes) 000515 1789111561.854123 fallocate 0x01c042 thru 0x01ca03 (0x9c2 bytes) 000517 1789111561.860214 fallocate 0x0266f7 thru 0x033c89 (0xd593 bytes) 000518 1789111561.866216 trunc from 0x040000 to 0x00fc31 (0x303ce bytes) 000519 1789111561.905154 punch from 0x005ad1 to 0x00fc31 (0xa161 bytes) 000520 1789111561.912159 read 0x007864 thru 0x00fc31 (0x83ce bytes) 000521 1789111561.924273 punch from 0x0029f7 to 0x00bc5d (0x9267 bytes) 000522 1789111561.931117 fallocate 0x008890 thru 0x018437 (0xfba8 bytes) 000523 1789111561.937614 read 0x00bc0a thru 0x00fc31 (0x4028 bytes) 000524 1789111561.949601 mapwrite 0x01a8fd thru 0x02466c (0x9d70 bytes) 000526 1789111562.029725 MIRROR_RESYNC 9 mirrors 000527 1789111564.078578 MIRROR_EXTEND to 10 mirrors 000528 1789111565.175325 write 0x0282e6 thru 0x0323e4 (0xa0ff bytes) 000529 1789111565.218035 fallocate 0x02be65 thru 0x0358ac (0x9a48 bytes) 000530 1789111565.222226 mapread 0x00ddf9 thru 0x017b58 (0x9d60 bytes) 000531 1789111565.236100 trunc from 0x009040 to 0x013551 (0xa512 bytes) 000532 1789111565.242106 write 0x022475 thru 0x02cc8e (0xa81a bytes) 000533 1789111565.263158 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x358ad): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x358ad): Mirror 10: 0x1d41cf0d (stale) Mirror 12: 0x1d41cf0d (stale) Mirror 13: 0x1d41cf0d (stale) Mirror 14: 0x1d41cf0d (stale) Mirror 15: 0x1d41cf0d (stale) Mirror 16: 0x1d41cf0d (stale) Mirror 17: 0x1d41cf0d (stale) Mirror 18: 0x1d41cf0d (stale) Mirror 19: 0x1d41cf0d (stale) CRC-32 checksum value for chunk [0, 0x358ad): Mirror 1: 0x581f4679 Mirror 20: 0x581f4679 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x358ad: skipped 000534 1789111566.530208 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x358ad): Mirror 10: 0x1d41cf0d (stale) Mirror 12: 0x1d41cf0d (stale) Mirror 13: 0x1d41cf0d (stale) Mirror 14: 0x1d41cf0d (stale) Mirror 15: 0x1d41cf0d (stale) Mirror 16: 0x1d41cf0d (stale) Mirror 17: 0x1d41cf0d (stale) Mirror 18: 0x1d41cf0d (stale) Mirror 19: 0x1d41cf0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x358ad): Mirror 10: 0x1d41cf0d (stale) Mirror 12: 0x1d41cf0d (stale) Mirror 13: 0x1d41cf0d (stale) Mirror 14: 0x1d41cf0d (stale) Mirror 15: 0x1d41cf0d (stale) Mirror 16: 0x1d41cf0d (stale) Mirror 17: 0x1d41cf0d (stale) Mirror 18: 0x1d41cf0d (stale) Mirror 19: 0x1d41cf0d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x358ad: skipped 000535 1789111567.180590 write 0x012067 thru 0x01a86f (0x8809 bytes) 000536 1789111567.211384 fallocate 0x03f207 thru 0x03ffff (0xdf9 bytes) 000537 1789111567.222554 mapwrite 0x02ddfe thru 0x03621a (0x841d bytes) 000538 1789111567.334458 trunc from 0x01fd71 to 0x0203d4 (0x664 bytes) 000539 1789111567.339326 read 0x00167e thru 0x00e52d (0xceb0 bytes) 000540 1789111567.348469 read 0x018167 thru 0x02200a (0x9ea4 bytes) 000541 1789111567.375825 read 0x035b77 thru 0x03621a (0x6a4 bytes) 000542 1789111567.377211 punch from 0x025e75 to 0x02c1aa (0x6336 bytes) 000543 1789111567.390732 trunc from 0x03337b to 0x03621a (0x2ea0 bytes) 000544 1789111567.412557 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3621b): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3621b): Mirror 10: 0xfbf6a392 (stale) Mirror 12: 0xfbf6a392 (stale) Mirror 13: 0xfbf6a392 (stale) Mirror 14: 0xfbf6a392 (stale) Mirror 15: 0xfbf6a392 (stale) Mirror 16: 0xfbf6a392 (stale) Mirror 17: 0xfbf6a392 (stale) Mirror 18: 0xfbf6a392 (stale) Mirror 19: 0xfbf6a392 (stale) CRC-32 checksum value for chunk [0, 0x3621b): Mirror 1: 0xbb9dcf92 Mirror 20: 0xbb9dcf92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3621b: skipped 000545 1789111568.333444 fallocate 0x00a194 thru 0x014df0 (0xac5d bytes) 000546 1789111568.368846 read 0x01cfdc thru 0x024fa9 (0x7fce bytes) 000547 1789111568.378494 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3621b): Mirror 10: 0xfbf6a392 (stale) Mirror 12: 0xfbf6a392 (stale) Mirror 13: 0xfbf6a392 (stale) Mirror 14: 0xfbf6a392 (stale) Mirror 15: 0xfbf6a392 (stale) Mirror 16: 0xfbf6a392 (stale) Mirror 18: 0xfbf6a392 (stale) Mirror 19: 0xfbf6a392 (stale) Mirror 20: 0xbb9dcf92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3621b): Mirror 10: 0xfbf6a392 (stale) Mirror 12: 0xfbf6a392 (stale) Mirror 13: 0xfbf6a392 (stale) Mirror 14: 0xfbf6a392 (stale) Mirror 15: 0xfbf6a392 (stale) Mirror 16: 0xfbf6a392 (stale) Mirror 18: 0xfbf6a392 (stale) Mirror 19: 0xfbf6a392 (stale) Mirror 20: 0xbb9dcf92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3621b: skipped 000548 1789111568.952325 mapwrite 0x02c130 thru 0x02d77b (0x164c bytes) 000549 1789111568.978457 trunc from 0x03621b to 0x00955a (0x2ccc0 bytes) 000550 1789111569.023633 write 0x008d8c thru 0x00b065 (0x22da bytes) 000553 1789111569.036015 trunc from 0x00b066 to 0x03a144 (0x2f0df bytes) 000554 1789111569.057445 punch from 0x016880 to 0x023a17 (0xd198 bytes) 000555 1789111569.063185 fallocate 0x03013a thru 0x03c9f8 (0xc8bf bytes) 000556 1789111569.071037 trunc from 0x00985b to 0x00af2f (0x16d5 bytes) 000557 1789111569.090241 write 0x034419 thru 0x034ddd (0x9c5 bytes) 000558 1789111569.100644 fallocate 0x03f534 thru 0x03ffff (0xacc bytes) 000559 1789111569.108430 mapwrite 0x00b03c thru 0x01644a (0xb40f bytes) 000560 1789111569.156159 fallocate 0x01037e thru 0x013287 (0x2f0a bytes) 000561 1789111569.162405 read 0x01a7a1 thru 0x01f4da (0x4d3a bytes) 000562 1789111569.169490 write 0x00c284 thru 0x016aba (0xa837 bytes) 000563 1789111569.172104 fallocate 0x01461d thru 0x022bf9 (0xe5dd bytes) 000564 1789111569.178922 write 0x02964e thru 0x038ba3 (0xf556 bytes) 000565 1789111569.189412 read 0x01e126 thru 0x01f7b7 (0x1692 bytes) 000567 1789111569.190958 write 0x020e96 thru 0x023edb (0x3046 bytes) 000568 1789111569.197808 trunc from 0x00fd79 to 0x016b07 (0x6d8f bytes) 000569 1789111569.230753 MIRROR_RESYNC 10 mirrors 000570 1789111572.945012 punch from 0x012b9c to 0x01cf31 (0xa396 bytes) 000572 1789111572.980626 write 0x021138 thru 0x028cf8 (0x7bc1 bytes) 000573 1789111572.995033 trunc from 0x040000 to 0x01c316 (0x23ce9 bytes) 000574 1789111573.028657 mapread 0x00314f thru 0x012c73 (0xfb25 bytes) 000575 1789111573.064746 mapwrite 0x025c30 thru 0x033202 (0xd5d3 bytes) 000576 1789111573.120628 mapwrite 0x0216c7 thru 0x029f80 (0x88ba bytes) 000577 1789111573.147575 read 0x0219e1 thru 0x026f42 (0x5562 bytes) 000578 1789111573.148285 trunc from 0x023dc4 to 0x031477 (0xd6b4 bytes) 000579 1789111573.155322 trunc from 0x026475 to 0x02f51d (0x90a9 bytes) 000580 1789111573.160464 trunc from 0x033203 to 0x0376ca (0x44c8 bytes) 000581 1789111573.180406 write 0x021928 thru 0x02639e (0x4a77 bytes) 000582 1789111573.189218 mapwrite 0x011ddc thru 0x0136df (0x1904 bytes) 000583 1789111573.214544 trunc from 0x0376cb to 0x01fb30 (0x17b9a bytes) 000584 1789111573.241604 write 0x0105ca thru 0x0127d1 (0x2208 bytes) 000585 1789111573.242823 fallocate 0x0053ba thru 0x00f66c (0xa2b3 bytes) 000586 1789111573.254269 mapread 0x00d858 thru 0x017471 (0x9c1a bytes) 000587 1789111573.257055 mapwrite 0x00ef22 thru 0x018bac (0x9c8b bytes) 000588 1789111573.295773 read 0x00eb33 thru 0x018482 (0x9950 bytes) 000589 1789111573.296513 fallocate 0x022ac5 thru 0x02ec4e (0xc18a bytes) 000590 1789111573.302894 trunc from 0x01fb31 to 0x021fd1 (0x24a1 bytes) 000591 1789111573.331023 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x21fd2): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21fd2): Mirror 10: 0x4940dd14 (stale) Mirror 12: 0x4940dd14 (stale) Mirror 13: 0x4940dd14 (stale) Mirror 14: 0x4940dd14 (stale) Mirror 15: 0x4940dd14 (stale) Mirror 16: 0x4940dd14 (stale) Mirror 18: 0x4940dd14 (stale) Mirror 19: 0x4940dd14 (stale) Mirror 20: 0x4940dd14 (stale) CRC-32 checksum value for chunk [0, 0x21fd2): Mirror 1: 0x32f12142 Mirror 21: 0x32f12142 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21fd2: skipped 000592 1789111574.499127 mapwrite 0x00abd7 thru 0x018869 (0xdc93 bytes) 000593 1789111574.681210 mapwrite 0x006634 thru 0x00ebe9 (0x85b6 bytes) 000594 1789111574.710415 read 0x00ec96 thru 0x018af1 (0x9e5c bytes) 000595 1789111574.711342 trunc from 0x01dbe7 to 0x021fd1 (0x43eb bytes) 000596 1789111574.716488 trunc from 0x021fd2 to 0x006feb (0x1afe6 bytes) 000597 1789111574.745485 mapwrite 0x028c59 thru 0x03150b (0x88b3 bytes) 000598 1789111574.810977 trunc from 0x03150c to 0x022ea0 (0xe66b bytes) 000599 1789111574.832079 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x22ea1): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22ea1): Mirror 10: 0x8a5cb78 (stale) Mirror 12: 0x8a5cb78 (stale) Mirror 13: 0x8a5cb78 (stale) Mirror 14: 0x8a5cb78 (stale) Mirror 15: 0x8a5cb78 (stale) Mirror 16: 0x8a5cb78 (stale) Mirror 18: 0x8a5cb78 (stale) Mirror 19: 0x8a5cb78 (stale) Mirror 20: 0x8a5cb78 (stale) Mirror 21: 0xef6b6cd5 (stale) CRC-32 checksum value for chunk [0, 0x22ea1): Mirror 1: 0x133ae31 Mirror 22: 0x133ae31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22ea1: skipped 000600 1789111575.968666 mapwrite 0x03d741 thru 0x03ffff (0x28bf bytes) 000601 1789111576.060533 mapwrite 0x013198 thru 0x0193c4 (0x622d bytes) 000602 1789111576.099832 read 0x027619 thru 0x02923d (0x1c25 bytes) 000603 1789111576.108960 mapread 0x022012 thru 0x022b17 (0xb06 bytes) 000604 1789111576.123049 trunc from 0x029d2c to 0x02aa5d (0xd32 bytes) 000605 1789111576.129339 mapread 0x000eaf thru 0x010987 (0xfad9 bytes) 000606 1789111576.146545 punch from 0x01da36 to 0x026f07 (0x94d2 bytes) 000607 1789111576.152656 mapwrite 0x039a98 thru 0x03ffff (0x6568 bytes) 000608 1789111576.171800 fallocate 0x0334a8 thru 0x03c4e8 (0x9041 bytes) 000609 1789111576.178305 read 0x02d6d2 thru 0x032d82 (0x56b1 bytes) 000610 1789111576.190184 read 0x00617c thru 0x00d908 (0x778d bytes) 000611 1789111576.191402 read 0x015d4b thru 0x01d163 (0x7419 bytes) 000612 1789111576.193474 punch from 0x012d78 to 0x01e248 (0xb4d1 bytes) 000613 1789111576.206924 trunc from 0x040000 to 0x02eadc (0x11523 bytes) 000614 1789111576.248472 read 0x02163c thru 0x02517d (0x3b42 bytes) 000615 1789111576.249567 punch from 0x01fc0a to 0x02eadc (0xeed3 bytes) 000616 1789111576.257981 punch from 0x00eb84 to 0x01888e (0x9d0b bytes) 000617 1789111576.265644 write 0x039303 thru 0x03fb25 (0x6823 bytes) 000618 1789111576.271301 fallocate 0x005c3d thru 0x00fba1 (0x9f65 bytes) 000619 1789111576.287514 fallocate 0x028de1 thru 0x02d329 (0x4549 bytes) 000620 1789111576.300337 mapread 0x008e60 thru 0x010565 (0x7706 bytes) 000621 1789111576.338338 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3fb26): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb26): Mirror 10: 0x8b9e48a5 (stale) Mirror 12: 0x8b9e48a5 (stale) Mirror 13: 0x8b9e48a5 (stale) Mirror 14: 0x8b9e48a5 (stale) Mirror 15: 0x8b9e48a5 (stale) Mirror 16: 0x8b9e48a5 (stale) Mirror 18: 0x8b9e48a5 (stale) Mirror 19: 0x8b9e48a5 (stale) Mirror 20: 0x8b9e48a5 (stale) Mirror 21: 0x9de4ea75 (stale) Mirror 22: 0xdb7ee310 (stale) CRC-32 checksum value for chunk [0, 0x3fb26): Mirror 1: 0xe899aeef Mirror 23: 0xe899aeef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb26: skipped 000622 1789111577.620627 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fb26): Mirror 10: 0x8b9e48a5 (stale) Mirror 12: 0x8b9e48a5 (stale) Mirror 13: 0x8b9e48a5 (stale) Mirror 14: 0x8b9e48a5 (stale) Mirror 15: 0x8b9e48a5 (stale) Mirror 18: 0x8b9e48a5 (stale) Mirror 19: 0x8b9e48a5 (stale) Mirror 20: 0x8b9e48a5 (stale) Mirror 21: 0x9de4ea75 (stale) Mirror 22: 0xdb7ee310 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb26): Mirror 10: 0x8b9e48a5 (stale) Mirror 12: 0x8b9e48a5 (stale) Mirror 13: 0x8b9e48a5 (stale) Mirror 14: 0x8b9e48a5 (stale) Mirror 15: 0x8b9e48a5 (stale) Mirror 18: 0x8b9e48a5 (stale) Mirror 19: 0x8b9e48a5 (stale) Mirror 20: 0x8b9e48a5 (stale) Mirror 21: 0x9de4ea75 (stale) Mirror 22: 0xdb7ee310 (stale) CRC-32 checksum value for chunk [0, 0x3fb26): Mirror 1: 0xe899aeef Mirror 23: 0xe899aeef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb26: skipped 000623 1789111578.648436 mapwrite 0x03b2b0 thru 0x03bd4b (0xa9c bytes) 000624 1789111578.815664 trunc from 0x001b4e to 0x00d6a8 (0xbb5b bytes) 000625 1789111578.822567 punch from 0x011fbe to 0x0139ab (0x19ee bytes) 000626 1789111578.828617 punch from 0x0212ad to 0x02edc2 (0xdb16 bytes) 000627 1789111578.835313 fallocate 0x00e02b thru 0x013f10 (0x5ee6 bytes) 000628 1789111578.843514 fallocate 0x01faf5 thru 0x025578 (0x5a84 bytes) 000630 1789111578.857173 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fb26): Mirror 10: 0x8b9e48a5 (stale) Mirror 12: 0x8b9e48a5 (stale) Mirror 13: 0x8b9e48a5 (stale) Mirror 14: 0x8b9e48a5 (stale) Mirror 15: 0x8b9e48a5 (stale) Mirror 19: 0x8b9e48a5 (stale) Mirror 20: 0x8b9e48a5 (stale) Mirror 21: 0x9de4ea75 (stale) Mirror 22: 0xdb7ee310 (stale) Mirror 23: 0xe899aeef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb26): Mirror 10: 0x8b9e48a5 (stale) Mirror 12: 0x8b9e48a5 (stale) Mirror 13: 0x8b9e48a5 (stale) Mirror 14: 0x8b9e48a5 (stale) Mirror 15: 0x8b9e48a5 (stale) Mirror 19: 0x8b9e48a5 (stale) Mirror 20: 0x8b9e48a5 (stale) Mirror 21: 0x9de4ea75 (stale) Mirror 22: 0xdb7ee310 (stale) Mirror 23: 0xe899aeef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb26: skipped 000631 1789111579.665295 write 0x0169ae thru 0x017a2f (0x1082 bytes) 000632 1789111579.689107 write 0x02a973 thru 0x035421 (0xaaaf bytes) 000633 1789111579.706274 mapread 0x0280b8 thru 0x032c59 (0xaba2 bytes) 000634 1789111579.707536 write 0x036fae thru 0x038314 (0x1367 bytes) 000636 1789111579.726492 MIRROR_RESYNC 11 mirrors 000637 1789111582.073471 punch from 0x0235ba to 0x023f88 (0x9cf bytes) 000638 1789111582.121564 punch from 0x039f72 to 0x03fb25 (0x5bb4 bytes) 000639 1789111582.131539 write 0x01fa84 thru 0x023509 (0x3a86 bytes) 000640 1789111582.143590 fallocate 0x039610 thru 0x03ffff (0x69f0 bytes) 000641 1789111582.150969 read 0x033d66 thru 0x03951f (0x57ba bytes) 000643 1789111582.167920 trunc from 0x0092f0 to 0x00c5cd (0x32de bytes) 000644 1789111582.172974 mapread 0x012dce thru 0x013391 (0x5c4 bytes) 000645 1789111582.189378 punch from 0x00ab68 to 0x01183c (0x6cd5 bytes) 000646 1789111582.202898 mapread 0x035a83 thru 0x03dde8 (0x8366 bytes) 000647 1789111582.215530 read 0x03e182 thru 0x03ffff (0x1e7e bytes) 000648 1789111582.216460 trunc from 0x040000 to 0x039ae5 (0x651a bytes) 000649 1789111582.238402 trunc from 0x027b8e to 0x0354bf (0xd932 bytes) 000650 1789111582.243954 mapread 0x02d4be thru 0x038eb9 (0xb9fc bytes) 000651 1789111582.258162 fallocate 0x020bc9 thru 0x0265dc (0x5a14 bytes) 000652 1789111582.273550 trunc from 0x0188e1 to 0x01f6a4 (0x6dc4 bytes) 000653 1789111582.313401 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x39ae6): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ae6): Mirror 10: 0x4a383070 (stale) Mirror 12: 0x4a383070 (stale) Mirror 13: 0x4a383070 (stale) Mirror 14: 0x4a383070 (stale) Mirror 15: 0x4a383070 (stale) Mirror 19: 0x4a383070 (stale) Mirror 20: 0x4a383070 (stale) Mirror 21: 0x4a383070 (stale) Mirror 22: 0x4a383070 (stale) Mirror 23: 0x4a383070 (stale) CRC-32 checksum value for chunk [0, 0x39ae6): Mirror 1: 0x7598a7f8 Mirror 24: 0x7598a7f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ae6: skipped 000654 1789111583.436825 trunc from 0x039ae6 to 0x00548e (0x34657 bytes) 000655 1789111583.542398 punch from 0x0030b6 to 0x00548e (0x23d9 bytes) 000656 1789111583.553019 punch from 0x001354 to 0x00548e (0x413b bytes) 000657 1789111583.562106 read 0x00535a thru 0x00548e (0x135 bytes) 000658 1789111583.567149 fallocate 0x003adc thru 0x00906c (0x5591 bytes) 000659 1789111583.572495 write 0x017247 thru 0x0211a8 (0x9f62 bytes) 000660 1789111583.577170 trunc from 0x0211a9 to 0x00b2c1 (0x15ee7 bytes) 000661 1789111583.606311 mapwrite 0x00f9e3 thru 0x01d057 (0xd675 bytes) 000662 1789111583.690588 trunc from 0x01d058 to 0x013b47 (0x9510 bytes) 000663 1789111583.705943 read 0x008e4b thru 0x0091d4 (0x38a bytes) 000664 1789111583.731928 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13b48): Mirror 10: 0x1eaa8fa (stale) Mirror 12: 0x1eaa8fa (stale) Mirror 13: 0x1eaa8fa (stale) Mirror 14: 0x1eaa8fa (stale) Mirror 15: 0x1eaa8fa (stale) Mirror 19: 0x1eaa8fa (stale) Mirror 20: 0x1eaa8fa (stale) Mirror 22: 0x1eaa8fa (stale) Mirror 23: 0x1eaa8fa (stale) Mirror 24: 0x1eaa8fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13b48): Mirror 10: 0x1eaa8fa (stale) Mirror 12: 0x1eaa8fa (stale) Mirror 13: 0x1eaa8fa (stale) Mirror 14: 0x1eaa8fa (stale) Mirror 15: 0x1eaa8fa (stale) Mirror 19: 0x1eaa8fa (stale) Mirror 20: 0x1eaa8fa (stale) Mirror 22: 0x1eaa8fa (stale) Mirror 23: 0x1eaa8fa (stale) Mirror 24: 0x1eaa8fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13b48: skipped 000665 1789111584.276190 punch from 0x00e4f2 to 0x013b47 (0x5656 bytes) 000666 1789111584.281181 read 0x00d6d0 thru 0x013b47 (0x6478 bytes) 000667 1789111584.291375 mapwrite 0x0366a0 thru 0x03bfca (0x592b bytes) 000668 1789111584.351050 trunc from 0x038cc4 to 0x03bfca (0x3307 bytes) 000669 1789111584.359020 read 0x00c868 thru 0x019977 (0xd110 bytes) 000670 1789111584.369118 trunc from 0x03bfcb to 0x01d377 (0x1ec53 bytes) 000671 1789111584.389564 trunc from 0x0021da to 0x00d025 (0xae4c bytes) 000672 1789111584.396398 fallocate 0x037a2b thru 0x03ffff (0x85d5 bytes) 000673 1789111584.407579 trunc from 0x02314f to 0x031e72 (0xed24 bytes) 000675 1789111584.415552 write 0x002218 thru 0x005c28 (0x3a11 bytes) 000676 1789111584.433392 read 0x025db4 thru 0x028a34 (0x2c81 bytes) 000677 1789111584.466650 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xd6a617 (stale) Mirror 12: 0xd6a617 (stale) Mirror 13: 0xd6a617 (stale) Mirror 14: 0xd6a617 (stale) Mirror 15: 0xd6a617 (stale) Mirror 19: 0xd6a617 (stale) Mirror 20: 0xd6a617 (stale) Mirror 23: 0xd6a617 (stale) Mirror 24: 0xeb206082 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xd6a617 (stale) Mirror 12: 0xd6a617 (stale) Mirror 13: 0xd6a617 (stale) Mirror 14: 0xd6a617 (stale) Mirror 15: 0xd6a617 (stale) Mirror 19: 0xd6a617 (stale) Mirror 20: 0xd6a617 (stale) Mirror 23: 0xd6a617 (stale) Mirror 24: 0xeb206082 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000678 1789111585.116239 mapwrite 0x03dec3 thru 0x03ffff (0x213d bytes) 000679 1789111585.193513 trunc from 0x018561 to 0x01936f (0xe0f bytes) 000680 1789111585.214321 MIRROR_RESYNC 10 mirrors 000681 1789111588.015241 MIRROR_RESYNC 10 mirrors 000682 1789111588.693413 mapread 0x01f906 thru 0x02a813 (0xaf0e bytes) 000683 1789111588.723859 mapwrite 0x0310b0 thru 0x0366ae (0x55ff bytes) 000684 1789111588.834854 mapwrite 0x03a459 thru 0x03bcf9 (0x18a1 bytes) 000685 1789111588.916577 trunc from 0x012e5a to 0x01d244 (0xa3eb bytes) 000686 1789111588.932972 write 0x00e182 thru 0x01216e (0x3fed bytes) 000687 1789111588.944461 fallocate 0x00617f thru 0x0134ed (0xd36f bytes) 000688 1789111588.950426 mapread 0x015682 thru 0x01fd2b (0xa6aa bytes) 000689 1789111588.963400 write 0x02be32 thru 0x0376c3 (0xb892 bytes) 000690 1789111588.969009 mapwrite 0x003d40 thru 0x006ff0 (0x32b1 bytes) 000691 1789111589.050420 read 0x013147 thru 0x015611 (0x24cb bytes) 000692 1789111589.052383 read 0x03d94c thru 0x03dc16 (0x2cb bytes) 000693 1789111589.054398 read 0x023a74 thru 0x028bc2 (0x514f bytes) 000694 1789111589.068185 mapwrite 0x00e591 thru 0x010c3a (0x26aa bytes) 000695 1789111589.088233 fallocate 0x033fd7 thru 0x03ffff (0xc029 bytes) 000696 1789111589.095062 trunc from 0x01d4c4 to 0x027dc8 (0xa905 bytes) 000697 1789111589.102618 trunc from 0x00312f to 0x0067f1 (0x36c3 bytes) 000699 1789111589.110430 write 0x02aa5f thru 0x03239d (0x793f bytes) 000700 1789111589.113439 read 0x006350 thru 0x00779d (0x144e bytes) 000701 1789111589.143242 punch from 0x02176e to 0x02c38b (0xac1e bytes) 000702 1789111589.166434 write 0x01dfb4 thru 0x029624 (0xb671 bytes) 000703 1789111589.178253 read 0x0318bb thru 0x036bb4 (0x52fa bytes) 000704 1789111589.182051 mapwrite 0x0064da thru 0x00babc (0x55e3 bytes) 000705 1789111589.244412 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xec8a9373 (stale) Mirror 12: 0xec8a9373 (stale) Mirror 13: 0xec8a9373 (stale) Mirror 14: 0xec8a9373 (stale) Mirror 15: 0xec8a9373 (stale) Mirror 19: 0xec8a9373 (stale) Mirror 20: 0xec8a9373 (stale) Mirror 23: 0xec8a9373 (stale) Mirror 24: 0xec8a9373 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x80234fbc Mirror 25: 0x80234fbc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000706 1789111590.780401 fallocate 0x0287ec thru 0x036600 (0xde15 bytes) 000707 1789111590.831281 trunc from 0x040000 to 0x038883 (0x777c bytes) 000708 1789111590.918585 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38884): Mirror 10: 0x9dc3a794 (stale) Mirror 12: 0x9dc3a794 (stale) Mirror 13: 0x9dc3a794 (stale) Mirror 14: 0x9dc3a794 (stale) Mirror 15: 0x9dc3a794 (stale) Mirror 19: 0x9dc3a794 (stale) Mirror 20: 0x9dc3a794 (stale) Mirror 23: 0x9dc3a794 (stale) Mirror 24: 0x9dc3a794 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38884): Mirror 10: 0x9dc3a794 (stale) Mirror 12: 0x9dc3a794 (stale) Mirror 13: 0x9dc3a794 (stale) Mirror 14: 0x9dc3a794 (stale) Mirror 15: 0x9dc3a794 (stale) Mirror 19: 0x9dc3a794 (stale) Mirror 20: 0x9dc3a794 (stale) Mirror 23: 0x9dc3a794 (stale) Mirror 24: 0x9dc3a794 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38884: skipped 000709 1789111591.499187 trunc from 0x038884 to 0x005665 (0x3321e bytes) 000711 1789111591.536318 read 0x0044c4 thru 0x005665 (0x11a2 bytes) 000712 1789111591.546654 write 0x0289bc thru 0x033ce3 (0xb328 bytes) 000713 1789111591.549581 mapwrite 0x030bfa thru 0x03cc11 (0xc018 bytes) 000714 1789111591.633114 mapwrite 0x011d96 thru 0x01b9fd (0x9c68 bytes) 000716 1789111591.680468 fallocate 0x016d38 thru 0x02651a (0xf7e3 bytes) 000717 1789111591.688352 read 0x004a74 thru 0x0088df (0x3e6c bytes) 000718 1789111591.710381 MIRROR_RESYNC 10 mirrors 000720 1789111594.686308 fallocate 0x03b013 thru 0x03f9b8 (0x49a6 bytes) 000721 1789111594.726199 trunc from 0x03f9b9 to 0x01ae12 (0x24ba6 bytes) 000722 1789111594.755307 trunc from 0x000763 to 0x00e76a (0xe008 bytes) 000723 1789111594.762490 write 0x002c15 thru 0x003310 (0x6fc bytes) 000724 1789111594.774581 read 0x00fefa thru 0x019657 (0x975e bytes) 000725 1789111594.791381 write 0x00f488 thru 0x013d35 (0x48ae bytes) 000727 1789111594.799064 MIRROR_RESYNC 10 mirrors 000728 1789111597.182998 mapread 0x019093 thru 0x019aad (0xa1b bytes) 000729 1789111597.190354 mapread 0x00635b thru 0x00dcc8 (0x796e bytes) 000732 1789111597.208960 fallocate 0x03db2c thru 0x03dde2 (0x2b7 bytes) 000733 1789111597.245506 trunc from 0x014288 to 0x01ae12 (0x6b8b bytes) 000734 1789111597.251066 read 0x016371 thru 0x019763 (0x33f3 bytes) 000735 1789111597.257514 punch from 0x00ee07 to 0x01ae12 (0xc00c bytes) 000736 1789111597.263453 write 0x038f43 thru 0x03d606 (0x46c4 bytes) 000738 1789111597.266224 trunc from 0x03d4d0 to 0x03d606 (0x137 bytes) 000739 1789111597.281971 mapread 0x021b79 thru 0x02df02 (0xc38a bytes) 000740 1789111597.301152 read 0x0092d1 thru 0x01710a (0xde3a bytes) 000741 1789111597.313001 punch from 0x02acc3 to 0x02ddba (0x30f8 bytes) 000742 1789111597.316980 trunc from 0x03d607 to 0x03dd8b (0x785 bytes) 000743 1789111597.336434 read 0x00c9f8 thru 0x0136a3 (0x6cac bytes) 000744 1789111597.339144 trunc from 0x005c65 to 0x00f88e (0x9c2a bytes) 000745 1789111597.350119 read 0x019494 thru 0x01e2fc (0x4e69 bytes) 000746 1789111597.352089 trunc from 0x021e35 to 0x0304d2 (0xe69e bytes) 000748 1789111597.361998 write 0x030b08 thru 0x03bdce (0xb2c7 bytes) 000749 1789111597.378038 trunc from 0x0088e8 to 0x010c0f (0x8328 bytes) 000750 1789111597.383186 read 0x000d25 thru 0x0092f4 (0x85d0 bytes) 000751 1789111597.391967 punch from 0x01d9ba to 0x021f2d (0x4574 bytes) 000752 1789111597.398060 read 0x03a6b8 thru 0x03dd8b (0x36d4 bytes) 000753 1789111597.399203 fallocate 0x034307 thru 0x039c12 (0x590c bytes) 000754 1789111597.403597 mapwrite 0x01f94f thru 0x02a8dd (0xaf8f bytes) 000755 1789111597.434000 trunc from 0x0283d0 to 0x02bd14 (0x3945 bytes) 000756 1789111597.438245 mapwrite 0x024198 thru 0x029c72 (0x5adb bytes) 000757 1789111597.469727 mapread 0x0386a8 thru 0x03dd8b (0x56e4 bytes) 000758 1789111597.471863 trunc from 0x02e5f8 to 0x03dc7b (0xf684 bytes) 000759 1789111597.478446 trunc from 0x00574a to 0x012421 (0xccd8 bytes) 000760 1789111597.489802 mapread 0x007d9b thru 0x00df00 (0x6166 bytes) 000761 1789111597.553495 mapread 0x02bdb4 thru 0x037bd9 (0xbe26 bytes) 000762 1789111597.609082 punch from 0x03610d to 0x0396b8 (0x35ac bytes) 000763 1789111597.614273 fallocate 0x02ef2a thru 0x02fe74 (0xf4b bytes) 000764 1789111597.619573 read 0x006e14 thru 0x00c1cb (0x53b8 bytes) 000765 1789111597.637740 fallocate 0x018589 thru 0x01e4b8 (0x5f30 bytes) 000766 1789111597.643357 fallocate 0x038802 thru 0x03926a (0xa69 bytes) 000767 1789111597.649379 trunc from 0x00eff0 to 0x018487 (0x9498 bytes) 000768 1789111597.658808 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd8c): Mirror 10: 0x2cfc4f4a (stale) Mirror 12: 0x2cfc4f4a (stale) Mirror 13: 0x2cfc4f4a (stale) Mirror 14: 0x2cfc4f4a (stale) Mirror 15: 0x2cfc4f4a (stale) Mirror 19: 0x2cfc4f4a (stale) Mirror 20: 0x2cfc4f4a (stale) Mirror 23: 0x2cfc4f4a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd8c): Mirror 10: 0x2cfc4f4a (stale) Mirror 12: 0x2cfc4f4a (stale) Mirror 13: 0x2cfc4f4a (stale) Mirror 14: 0x2cfc4f4a (stale) Mirror 15: 0x2cfc4f4a (stale) Mirror 19: 0x2cfc4f4a (stale) Mirror 20: 0x2cfc4f4a (stale) Mirror 23: 0x2cfc4f4a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd8c: skipped 000769 1789111598.172957 trunc from 0x03853c to 0x03dd8b (0x5850 bytes) 000770 1789111598.178490 read 0x03d351 thru 0x03dd8b (0xa3b bytes) 000772 1789111598.183912 trunc from 0x03dd8c to 0x01e30c (0x1fa7f bytes) 000773 1789111598.208535 mapread 0x01b497 thru 0x01e30c (0x2e76 bytes) 000774 1789111598.228188 write 0x01afca thru 0x01ed16 (0x3d4d bytes) 000775 1789111598.230217 trunc from 0x010e8f to 0x019a65 (0x8bd7 bytes) 000776 1789111598.234335 trunc from 0x01ed17 to 0x019834 (0x54e2 bytes) 000778 1789111598.253876 punch from 0x0054c7 to 0x00c647 (0x7181 bytes) 000779 1789111598.262045 write 0x012d6b thru 0x01e120 (0xb3b6 bytes) 000780 1789111598.286980 mapwrite 0x00493b thru 0x007288 (0x294e bytes) 000781 1789111598.323052 mapwrite 0x03c8ab thru 0x03ffff (0x3755 bytes) 000782 1789111598.361076 mapwrite 0x016507 thru 0x020471 (0x9f6b bytes) 000783 1789111598.394013 punch from 0x00ed65 to 0x016839 (0x7ad5 bytes) 000784 1789111598.400352 mapread 0x03f635 thru 0x03ffff (0x9cb bytes) 000785 1789111598.401560 read 0x030691 thru 0x03170f (0x107f bytes) 000786 1789111598.417476 mapwrite 0x01096e thru 0x0176a5 (0x6d38 bytes) 000787 1789111598.433642 mapread 0x01aca8 thru 0x01f1b0 (0x4509 bytes) 000788 1789111598.446910 MIRROR_RESYNC 9 mirrors 000789 1789111600.863393 punch from 0x0268e7 to 0x026e9b (0x5b5 bytes) 000790 1789111600.901355 trunc from 0x040000 to 0x017c71 (0x2838e bytes) 000791 1789111600.940304 mapwrite 0x032c9c thru 0x03ab05 (0x7e6a bytes) 000793 1789111601.034339 trunc from 0x03ab06 to 0x02e265 (0xc8a0 bytes) 000794 1789111601.053496 trunc from 0x0199f2 to 0x020a81 (0x7090 bytes) 000795 1789111601.059288 mapwrite 0x0321f5 thru 0x03ffff (0xde0b bytes) 000797 1789111601.154469 mapread 0x02facc thru 0x03c8d3 (0xce08 bytes) 000798 1789111601.156464 mapread 0x0373c3 thru 0x038e5c (0x1a9a bytes) 000799 1789111601.157551 read 0x01ccaa thru 0x01ef0d (0x2264 bytes) 000800 1789111601.168771 write 0x015756 thru 0x0211cb (0xba76 bytes) 000801 1789111601.188588 fallocate 0x01413e thru 0x01cee0 (0x8da3 bytes) 000802 1789111601.206594 punch from 0x01d720 to 0x0255bb (0x7e9c bytes) 000803 1789111601.238055 mapwrite 0x014bff thru 0x022803 (0xdc05 bytes) 000804 1789111601.305368 read 0x007d4d thru 0x009547 (0x17fb bytes) 000805 1789111601.317089 write 0x01d801 thru 0x0296d5 (0xbed5 bytes) 000806 1789111601.319392 mapread 0x025f89 thru 0x0312a2 (0xb31a bytes) 000807 1789111601.321816 trunc from 0x01b987 to 0x022f45 (0x75bf bytes) 000808 1789111601.356483 write 0x02ca23 thru 0x02f148 (0x2726 bytes) 000809 1789111601.357720 trunc from 0x040000 to 0x007898 (0x38767 bytes) 000810 1789111601.420431 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x7899): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7899): Mirror 10: 0x559fbea (stale) Mirror 12: 0x559fbea (stale) Mirror 13: 0x559fbea (stale) Mirror 14: 0x559fbea (stale) Mirror 15: 0x559fbea (stale) Mirror 19: 0x559fbea (stale) Mirror 20: 0x559fbea (stale) Mirror 23: 0x559fbea (stale) CRC-32 checksum value for chunk [0, 0x7899): Mirror 1: 0x559fbea Mirror 24: 0x559fbea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7899: skipped 000811 1789111602.317553 write 0x037615 thru 0x03f3de (0x7dca bytes) 000812 1789111602.379492 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f3df): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f3df): Mirror 10: 0xad42ebf0 (stale) Mirror 12: 0xad42ebf0 (stale) Mirror 13: 0xad42ebf0 (stale) Mirror 14: 0xad42ebf0 (stale) Mirror 15: 0xad42ebf0 (stale) Mirror 19: 0xad42ebf0 (stale) Mirror 20: 0xad42ebf0 (stale) Mirror 23: 0xad42ebf0 (stale) Mirror 24: 0x35d6306 (stale) CRC-32 checksum value for chunk [0, 0x3f3df): Mirror 1: 0xe0f53c80 Mirror 25: 0xe0f53c80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f3df: skipped 000815 1789111603.692491 trunc from 0x03f3df to 0x02a863 (0x14b7b bytes) 000816 1789111603.759280 punch from 0x004b26 to 0x00ff2b (0xb406 bytes) 000817 1789111603.772362 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a864): Mirror 10: 0x485a017f (stale) Mirror 12: 0x485a017f (stale) Mirror 13: 0x485a017f (stale) Mirror 14: 0x485a017f (stale) Mirror 15: 0x485a017f (stale) Mirror 19: 0x485a017f (stale) Mirror 20: 0x485a017f (stale) Mirror 23: 0x485a017f (stale) Mirror 24: 0x39d2d5fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a864): Mirror 10: 0x485a017f (stale) Mirror 12: 0x485a017f (stale) Mirror 13: 0x485a017f (stale) Mirror 14: 0x485a017f (stale) Mirror 15: 0x485a017f (stale) Mirror 19: 0x485a017f (stale) Mirror 20: 0x485a017f (stale) Mirror 23: 0x485a017f (stale) Mirror 24: 0x39d2d5fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a864: skipped 000818 1789111604.516062 read 0x010447 thru 0x014249 (0x3e03 bytes) 000819 1789111604.528743 read 0x012f43 thru 0x022e66 (0xff24 bytes) 000820 1789111604.553915 punch from 0x012125 to 0x01fffc (0xded8 bytes) 000821 1789111604.560879 punch from 0x007728 to 0x013100 (0xb9d9 bytes) 000822 1789111604.570323 fallocate 0x01bec4 thru 0x01db59 (0x1c96 bytes) 000823 1789111604.577285 read 0x006e8f thru 0x0132f9 (0xc46b bytes) 000824 1789111604.589495 write 0x0339ca thru 0x035fb3 (0x25ea bytes) 000825 1789111604.596555 mapread 0x02b693 thru 0x035340 (0x9cae bytes) 000827 1789111604.606612 read 0x020da5 thru 0x0294ff (0x875b bytes) 000828 1789111604.607364 mapread 0x0320aa thru 0x035fb3 (0x3f0a bytes) 000829 1789111604.614045 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35fb4): Mirror 10: 0xa14ef2dc (stale) Mirror 12: 0xa14ef2dc (stale) Mirror 13: 0xa14ef2dc (stale) Mirror 14: 0xa14ef2dc (stale) Mirror 15: 0xa14ef2dc (stale) Mirror 20: 0xa14ef2dc (stale) Mirror 23: 0xa14ef2dc (stale) Mirror 24: 0xbcbb518b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35fb4): Mirror 10: 0xa14ef2dc (stale) Mirror 12: 0xa14ef2dc (stale) Mirror 13: 0xa14ef2dc (stale) Mirror 14: 0xa14ef2dc (stale) Mirror 15: 0xa14ef2dc (stale) Mirror 20: 0xa14ef2dc (stale) Mirror 23: 0xa14ef2dc (stale) Mirror 24: 0xbcbb518b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35fb4: skipped 000830 1789111605.240501 trunc from 0x022ec5 to 0x03161f (0xe75b bytes) 000832 1789111605.250530 fallocate 0x016a96 thru 0x01d935 (0x6ea0 bytes) 000833 1789111605.258513 mapwrite 0x00912f thru 0x015903 (0xc7d5 bytes) 000834 1789111605.326125 trunc from 0x009e53 to 0x016feb (0xd199 bytes) 000835 1789111605.331779 mapwrite 0x003a48 thru 0x0068eb (0x2ea4 bytes) 000836 1789111605.370816 punch from 0x01b390 to 0x01c54a (0x11bb bytes) 000837 1789111605.376418 read 0x02a555 thru 0x035fb3 (0xba5f bytes) 000838 1789111605.391801 mapwrite 0x0068e4 thru 0x00b76a (0x4e87 bytes) 000839 1789111605.421852 read 0x020a34 thru 0x022a6f (0x203c bytes) 000840 1789111605.432759 mapread 0x0071b1 thru 0x014dfb (0xdc4b bytes) 000841 1789111605.435133 mapwrite 0x007d27 thru 0x010390 (0x866a bytes) 000842 1789111605.463223 trunc from 0x0247e1 to 0x027689 (0x2ea9 bytes) 000843 1789111605.471278 write 0x02b227 thru 0x037dad (0xcb87 bytes) 000844 1789111605.478496 mapread 0x02445b thru 0x02d6b5 (0x925b bytes) 000845 1789111605.507722 mapread 0x0206f7 thru 0x02c9e3 (0xc2ed bytes) 000846 1789111605.509793 trunc from 0x037dae to 0x00303e (0x34d6f bytes) 000847 1789111605.536040 write 0x02fddd thru 0x031cd2 (0x1ef6 bytes) 000849 1789111605.540083 fallocate 0x01d704 thru 0x02b6de (0xdfdb bytes) 000850 1789111605.545532 write 0x014eb3 thru 0x01d27a (0x83c8 bytes) 000851 1789111605.557236 write 0x034dd9 thru 0x03cb3b (0x7d63 bytes) 000852 1789111605.559342 trunc from 0x03cb3c to 0x021528 (0x1b613 bytes) 000853 1789111605.580279 read 0x000bfa thru 0x00fa8d (0xee94 bytes) 000854 1789111605.589129 fallocate 0x03a72d thru 0x03ffff (0x58d3 bytes) 000855 1789111605.595248 fallocate 0x036d0f thru 0x03ffff (0x92f1 bytes) 000856 1789111605.600307 mapread 0x033a23 thru 0x035f7d (0x255b bytes) 000857 1789111605.611954 mapwrite 0x02668f thru 0x02e33f (0x7cb1 bytes) 000858 1789111605.630934 read 0x002068 thru 0x005a03 (0x399c bytes) 000859 1789111605.631877 mapwrite 0x010dcc thru 0x01282c (0x1a61 bytes) 000860 1789111605.655680 trunc from 0x040000 to 0x038058 (0x7fa7 bytes) 000861 1789111605.677238 trunc from 0x038059 to 0x02aa05 (0xd653 bytes) 000862 1789111605.697432 fallocate 0x01a7a7 thru 0x01c9a4 (0x21fe bytes) 000863 1789111605.703391 punch from 0x011c65 to 0x016449 (0x47e5 bytes) 000864 1789111605.711975 punch from 0x003510 to 0x0106ec (0xd1dd bytes) 000865 1789111605.718014 read 0x011f33 thru 0x0136c1 (0x178f bytes) 000866 1789111605.735754 fallocate 0x02ff8d thru 0x036e87 (0x6efb bytes) 000867 1789111605.740451 punch from 0x01eacf to 0x026dd4 (0x8306 bytes) 000869 1789111605.747400 trunc from 0x0033e1 to 0x0067f2 (0x3412 bytes) 000870 1789111605.752067 mapwrite 0x01ec0a thru 0x02c0c8 (0xd4bf bytes) 000871 1789111605.839723 fallocate 0x027d5c thru 0x0283cd (0x672 bytes) 000872 1789111605.853370 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36e88): Mirror 10: 0xa6c49be4 (stale) Mirror 12: 0xa6c49be4 (stale) Mirror 13: 0xa6c49be4 (stale) Mirror 15: 0xa6c49be4 (stale) Mirror 20: 0xa6c49be4 (stale) Mirror 23: 0xa6c49be4 (stale) Mirror 24: 0xc4bdc4c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e88): Mirror 10: 0xa6c49be4 (stale) Mirror 12: 0xa6c49be4 (stale) Mirror 13: 0xa6c49be4 (stale) Mirror 15: 0xa6c49be4 (stale) Mirror 20: 0xa6c49be4 (stale) Mirror 23: 0xa6c49be4 (stale) Mirror 24: 0xc4bdc4c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e88: skipped 000873 1789111606.360508 read 0x025c1b thru 0x02be0a (0x61f0 bytes) 000874 1789111606.369709 read 0x031fd8 thru 0x036e87 (0x4eb0 bytes) 000875 1789111606.397306 MIRROR_RESYNC 8 mirrors 000877 1789111608.809527 mapread 0x02bafc thru 0x02e6b1 (0x2bb6 bytes) 000878 1789111608.835000 mapwrite 0x03fd6c thru 0x03ffff (0x294 bytes) 000879 1789111608.974633 trunc from 0x00fed3 to 0x016ac4 (0x6bf2 bytes) 000880 1789111608.988010 punch from 0x00cdff to 0x010baa (0x3dac bytes) 000881 1789111609.009999 trunc from 0x02c1b9 to 0x02e30f (0x2157 bytes) 000882 1789111609.027327 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x6fb98a9e (stale) Mirror 12: 0x6fb98a9e (stale) Mirror 13: 0x6fb98a9e (stale) Mirror 15: 0x6fb98a9e (stale) Mirror 20: 0x6fb98a9e (stale) Mirror 23: 0x6fb98a9e (stale) Mirror 24: 0x6fb98a9e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x143fdd32 Mirror 25: 0x143fdd32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000883 1789111610.106970 trunc from 0x040000 to 0x036aa8 (0x9557 bytes) 000884 1789111610.164259 punch from 0x0259e1 to 0x028e36 (0x3456 bytes) 000885 1789111610.170125 read 0x0012ad thru 0x00eb08 (0xd85c bytes) 000886 1789111610.179463 trunc from 0x036aa9 to 0x00786c (0x2f23c bytes) 000887 1789111610.209128 mapread 0x002532 thru 0x00502f (0x2afe bytes) 000888 1789111610.210193 fallocate 0x02de1f thru 0x035cf9 (0x7edb bytes) 000889 1789111610.228725 mapwrite 0x0126ce thru 0x01fa23 (0xd356 bytes) 000890 1789111610.339428 write 0x0159d6 thru 0x01fe5b (0xa486 bytes) 000891 1789111610.344415 mapwrite 0x03a6af thru 0x03ffff (0x5951 bytes) 000892 1789111610.391973 fallocate 0x01be25 thru 0x026647 (0xa823 bytes) 000893 1789111610.401357 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x6fb98a9e (stale) Mirror 12: 0x6fb98a9e (stale) Mirror 13: 0x6fb98a9e (stale) Mirror 15: 0x6fb98a9e (stale) Mirror 20: 0x6fb98a9e (stale) Mirror 23: 0x6fb98a9e (stale) Mirror 24: 0x6fb98a9e (stale) Mirror 25: 0x143fdd32 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe4a02686 Mirror 26: 0xe4a02686 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000894 1789111611.432953 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x6fb98a9e (stale) Mirror 12: 0x6fb98a9e (stale) Mirror 13: 0x6fb98a9e (stale) Mirror 15: 0x6fb98a9e (stale) Mirror 20: 0x6fb98a9e (stale) Mirror 23: 0x6fb98a9e (stale) Mirror 24: 0x6fb98a9e (stale) Mirror 25: 0x143fdd32 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe4a02686 Mirror 26: 0xe4a02686 Mirror 27: 0xe4a02686 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000896 1789111612.467030 trunc from 0x009051 to 0x015ec4 (0xce74 bytes) 000898 1789111612.564300 trunc from 0x02b71e to 0x039d5d (0xe640 bytes) 000899 1789111612.570174 punch from 0x03700c to 0x03ffff (0x8ff4 bytes) 000900 1789111612.576839 write 0x00d83f thru 0x00e5ba (0xd7c bytes) 000901 1789111612.592754 write 0x007af5 thru 0x0146eb (0xcbf7 bytes) 000902 1789111612.625919 mapread 0x007c31 thru 0x01471d (0xcaed bytes) 000903 1789111612.633447 fallocate 0x00046e thru 0x00dfeb (0xdb7e bytes) 000904 1789111612.640083 mapread 0x00fbac thru 0x012560 (0x29b5 bytes) 000905 1789111612.644075 trunc from 0x017792 to 0x01c85f (0x50ce bytes) 000906 1789111612.654500 write 0x01acc0 thru 0x022606 (0x7947 bytes) 000907 1789111612.680471 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x6fb98a9e (stale) Mirror 12: 0x6fb98a9e (stale) Mirror 13: 0x6fb98a9e (stale) Mirror 15: 0x6fb98a9e (stale) Mirror 20: 0x6fb98a9e (stale) Mirror 23: 0x6fb98a9e (stale) Mirror 24: 0x6fb98a9e (stale) Mirror 25: 0x143fdd32 (stale) Mirror 26: 0xe4a02686 (stale) Mirror 27: 0xe4a02686 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc182c508 Mirror 28: 0xc182c508 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000908 1789111613.830944 trunc from 0x01cb32 to 0x0288ef (0xbdbe bytes) 000909 1789111613.890256 mapread 0x00e273 thru 0x0124cd (0x425b bytes) 000910 1789111613.909192 mapread 0x01810b thru 0x01aa4f (0x2945 bytes) 000911 1789111613.919384 read 0x00fb91 thru 0x01474d (0x4bbd bytes) 000912 1789111613.920442 mapwrite 0x004128 thru 0x00e4e0 (0xa3b9 bytes) 000913 1789111613.946356 punch from 0x03d37d to 0x03d9c7 (0x64b bytes) 000914 1789111613.953880 MIRROR_RESYNC 12 mirrors 000915 1789111616.532944 write 0x0231c4 thru 0x0241ed (0x102a bytes) 000916 1789111616.567997 fallocate 0x03152e thru 0x0343c3 (0x2e96 bytes) 000917 1789111616.572427 mapread 0x03597c thru 0x03c528 (0x6bad bytes) 000918 1789111616.589874 fallocate 0x000160 thru 0x00d789 (0xd62a bytes) 000919 1789111616.597115 mapwrite 0x01e3c5 thru 0x02baf6 (0xd732 bytes) 000920 1789111616.665855 trunc from 0x040000 to 0x00f348 (0x30cb7 bytes) 000921 1789111616.716419 trunc from 0x00c40b to 0x00f348 (0x2f3e bytes) 000922 1789111616.723201 mapwrite 0x031e7c thru 0x03ffff (0xe184 bytes) 000923 1789111616.809113 MIRROR_RESYNC 12 mirrors 000924 1789111620.193955 mapwrite 0x01d3d0 thru 0x023115 (0x5d46 bytes) 000927 1789111620.340855 mapread 0x014a11 thru 0x0213f8 (0xc9e8 bytes) 000928 1789111620.368347 trunc from 0x040000 to 0x0198f6 (0x26709 bytes) 000929 1789111620.414729 punch from 0x00e846 to 0x0198f6 (0xb0b1 bytes) 000930 1789111620.432794 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x198f7): Mirror 10: 0x5a7350e1 (stale) Mirror 12: 0x5a7350e1 (stale) Mirror 13: 0x5a7350e1 (stale) Mirror 15: 0x5a7350e1 (stale) Mirror 23: 0x5a7350e1 (stale) Mirror 24: 0x5a7350e1 (stale) Mirror 25: 0x5a7350e1 (stale) Mirror 26: 0x5a7350e1 (stale) Mirror 27: 0x5a7350e1 (stale) Mirror 28: 0x5a7350e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x198f7): Mirror 10: 0x5a7350e1 (stale) Mirror 12: 0x5a7350e1 (stale) Mirror 13: 0x5a7350e1 (stale) Mirror 15: 0x5a7350e1 (stale) Mirror 23: 0x5a7350e1 (stale) Mirror 24: 0x5a7350e1 (stale) Mirror 25: 0x5a7350e1 (stale) Mirror 26: 0x5a7350e1 (stale) Mirror 27: 0x5a7350e1 (stale) Mirror 28: 0x5a7350e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x198f7: skipped 000931 1789111621.045853 trunc from 0x0198f7 to 0x02a872 (0x10f7c bytes) 000932 1789111621.066856 punch from 0x007d8d to 0x0166e6 (0xe95a bytes) 000933 1789111621.073078 trunc from 0x021a81 to 0x029f84 (0x8504 bytes) 000934 1789111621.082813 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a873): Mirror 10: 0xdfaaa07b (stale) Mirror 12: 0xdfaaa07b (stale) Mirror 13: 0xdfaaa07b (stale) Mirror 15: 0xdfaaa07b (stale) Mirror 23: 0xdfaaa07b (stale) Mirror 24: 0xdfaaa07b (stale) Mirror 26: 0xdfaaa07b (stale) Mirror 27: 0xdfaaa07b (stale) Mirror 28: 0xdfaaa07b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a873): Mirror 10: 0xdfaaa07b (stale) Mirror 12: 0xdfaaa07b (stale) Mirror 13: 0xdfaaa07b (stale) Mirror 15: 0xdfaaa07b (stale) Mirror 23: 0xdfaaa07b (stale) Mirror 24: 0xdfaaa07b (stale) Mirror 26: 0xdfaaa07b (stale) Mirror 27: 0xdfaaa07b (stale) Mirror 28: 0xdfaaa07b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a873: skipped 000935 1789111621.751772 fallocate 0x02ca33 thru 0x0366ef (0x9cbd bytes) 000936 1789111621.757768 fallocate 0x01063a thru 0x01b05a (0xaa21 bytes) 000937 1789111621.762377 trunc from 0x0366f0 to 0x01e94b (0x17da4 bytes) 000938 1789111621.785143 mapwrite 0x0367f0 thru 0x03ffff (0x9810 bytes) 000939 1789111621.865869 MIRROR_RESYNC 10 mirrors 000940 1789111624.019506 trunc from 0x000cdd to 0x002d03 (0x2027 bytes) 000941 1789111624.084773 read 0x03f448 thru 0x03f725 (0x2de bytes) 000943 1789111624.095436 MIRROR_RESYNC 10 mirrors 000944 1789111626.359632 trunc from 0x01baf7 to 0x028a6e (0xcf78 bytes) 000945 1789111626.385870 trunc from 0x040000 to 0x036192 (0x9e6d bytes) 000946 1789111626.404058 write 0x02fcbd thru 0x033146 (0x348a bytes) 000947 1789111626.416018 trunc from 0x011847 to 0x021100 (0xf8ba bytes) 000948 1789111626.421278 read 0x016746 thru 0x01da9f (0x735a bytes) 000949 1789111626.436284 MIRROR_RESYNC 10 mirrors 000950 1789111629.112569 punch from 0x02f177 to 0x036192 (0x701c bytes) 000952 1789111629.177103 MIRROR_RESYNC 10 mirrors 000953 1789111631.465884 mapwrite 0x026138 thru 0x031fb4 (0xbe7d bytes) 000954 1789111631.615200 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36193): Mirror 10: 0x61641389 (stale) Mirror 12: 0x61641389 (stale) Mirror 15: 0x61641389 (stale) Mirror 23: 0x61641389 (stale) Mirror 24: 0x61641389 (stale) Mirror 26: 0x61641389 (stale) Mirror 27: 0x61641389 (stale) Mirror 28: 0x61641389 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36193): Mirror 10: 0x61641389 (stale) Mirror 12: 0x61641389 (stale) Mirror 15: 0x61641389 (stale) Mirror 23: 0x61641389 (stale) Mirror 24: 0x61641389 (stale) Mirror 26: 0x61641389 (stale) Mirror 27: 0x61641389 (stale) Mirror 28: 0x61641389 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36193: skipped 000956 1789111632.161431 punch from 0x00ac2f to 0x017792 (0xcb64 bytes) 000957 1789111632.176071 fallocate 0x032e84 thru 0x03eb59 (0xbcd6 bytes) 000958 1789111632.185308 read 0x029519 thru 0x02a348 (0xe30 bytes) 000959 1789111632.196587 write 0x018cac thru 0x025ad0 (0xce25 bytes) 000960 1789111632.218226 fallocate 0x025ac1 thru 0x033458 (0xd998 bytes) 000961 1789111632.225577 mapread 0x00e45d thru 0x01888e (0xa432 bytes) 000962 1789111632.269269 fallocate 0x033a20 thru 0x0344cb (0xaac bytes) 000963 1789111632.282121 MIRROR_RESYNC 9 mirrors 000964 1789111634.521009 mapread 0x006833 thru 0x0162ce (0xfa9c bytes) 000965 1789111634.563970 mapread 0x02d9cd thru 0x036192 (0x87c6 bytes) 000966 1789111634.583305 read 0x012429 thru 0x01c37e (0x9f56 bytes) 000967 1789111634.589411 trunc from 0x032086 to 0x036192 (0x410d bytes) 000968 1789111634.636372 trunc from 0x036193 to 0x01224d (0x23f45 bytes) 000969 1789111634.657809 trunc from 0x01224e to 0x0225aa (0x1035d bytes) 000970 1789111634.672127 fallocate 0x000b8a thru 0x00dc14 (0xd08b bytes) 000971 1789111634.677246 punch from 0x019cda to 0x01cb17 (0x2e3e bytes) 000972 1789111634.681992 read 0x018fad thru 0x021896 (0x88ea bytes) 000973 1789111634.689916 write 0x03cf3e thru 0x03ffff (0x30c2 bytes) 000974 1789111634.691351 fallocate 0x03c3e6 thru 0x03ffff (0x3c1a bytes) 000975 1789111634.696307 mapwrite 0x010f29 thru 0x0171b2 (0x628a bytes) 000977 1789111634.725559 write 0x03c5da thru 0x03ffff (0x3a26 bytes) 000978 1789111634.726969 mapread 0x02d5db thru 0x038e07 (0xb82d bytes) 000979 1789111634.738053 write 0x03d24a thru 0x03d545 (0x2fc bytes) 000980 1789111634.741113 mapread 0x02bd72 thru 0x0394a5 (0xd734 bytes) 000981 1789111634.744632 mapwrite 0x00c9a1 thru 0x00f19d (0x27fd bytes) 000982 1789111634.775037 trunc from 0x03f3a8 to 0x03ffff (0xc58 bytes) 000983 1789111634.782285 punch from 0x008c7b to 0x013700 (0xaa86 bytes) 000984 1789111634.795002 MIRROR_RESYNC 9 mirrors 000985 1789111637.256210 mapread 0x017472 thru 0x021831 (0xa3c0 bytes) 000986 1789111637.295252 mapread 0x03da25 thru 0x03ffff (0x25db bytes) 000987 1789111637.316119 punch from 0x00790f to 0x00f689 (0x7d7b bytes) 000988 1789111637.404007 trunc from 0x040000 to 0x02fbaf (0x10450 bytes) 000989 1789111637.430591 fallocate 0x011d86 thru 0x01ffca (0xe245 bytes) 000990 1789111637.442277 punch from 0x020c2b to 0x023fed (0x33c3 bytes) 000991 1789111637.450546 trunc from 0x009743 to 0x017387 (0xdc45 bytes) 000992 1789111637.458570 punch from 0x003480 to 0x004b5e (0x16df bytes) 000993 1789111637.465871 read 0x02c25c thru 0x02c77c (0x521 bytes) 000994 1789111637.475317 fallocate 0x009bc6 thru 0x00f2a3 (0x56de bytes) 000995 1789111637.488571 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2fbb0): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fbb0): Mirror 10: 0x4c93b332 (stale) Mirror 12: 0x4c93b332 (stale) Mirror 15: 0x4c93b332 (stale) Mirror 23: 0x4c93b332 (stale) Mirror 24: 0x4c93b332 (stale) Mirror 26: 0x4c93b332 (stale) Mirror 27: 0x4c93b332 (stale) Mirror 28: 0x4c93b332 (stale) CRC-32 checksum value for chunk [0, 0x2fbb0): Mirror 1: 0xb4b97a41 Mirror 29: 0xb4b97a41 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fbb0: skipped 000996 1789111638.624636 fallocate 0x00d9b4 thru 0x01aced (0xd33a bytes) 000997 1789111638.691121 punch from 0x01eb23 to 0x022388 (0x3866 bytes) 000999 1789111638.697376 read 0x019074 thru 0x01c73c (0x36c9 bytes) 001000 1789111638.710261 fallocate 0x0152d6 thru 0x01539f (0xca bytes) All operations completed A-OK!