== sanity-flr test 70a: flr mode fsx test ================ 23:57:01 (1788667021) Seed set to 7022 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1788667023.244823 mapwrite 0x008f06 thru 0x015838 (0xc933 bytes) 000003 1788667023.388014 write 0x00f600 thru 0x0178ff (0x8300 bytes) 000004 1788667023.390762 write 0x03a7cd thru 0x03ffff (0x5833 bytes) 000006 1788667023.404884 mapwrite 0x030bf1 thru 0x0357d7 (0x4be7 bytes) 000007 1788667023.486499 mapread 0x03409b thru 0x03bc22 (0x7b88 bytes) 000009 1788667023.493515 punch from 0x015b55 to 0x020170 (0xa61c bytes) 000010 1788667023.502795 mapread 0x028422 thru 0x032340 (0x9f1f bytes) 000011 1788667023.522644 punch from 0x0189cd to 0x02776f (0xeda3 bytes) 000013 1788667023.536246 mapwrite 0x021651 thru 0x02c3a4 (0xad54 bytes) 000014 1788667023.633316 punch from 0x01be76 to 0x02985e (0xd9e9 bytes) 000016 1788667023.642286 mapwrite 0x011212 thru 0x012a60 (0x184f bytes) 000017 1788667023.704810 punch from 0x026feb to 0x0348db (0xd8f1 bytes) 000019 1788667023.713813 mapread 0x035835 thru 0x03e0c3 (0x888f bytes) 000021 1788667023.737255 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x31531 000022 1788667024.675802 trunc from 0x040000 to 0x031530 (0xeacf bytes) 000023 1788667024.819083 mapwrite 0x0389da thru 0x03deb0 (0x54d7 bytes) 000024 1788667024.954445 punch from 0x035743 to 0x03deb0 (0x876e bytes) 000025 1788667024.959995 read 0x038a8c thru 0x03b3cb (0x2940 bytes) 000026 1788667024.967802 mapread 0x01939d thru 0x023881 (0xa4e5 bytes) 000027 1788667025.008996 MIRROR_RESYNC 2 mirrors 000028 1788667025.883752 write 0x00ab8f thru 0x00df36 (0x33a8 bytes) 000030 1788667025.966018 write 0x02de27 thru 0x0360c1 (0x829b bytes) 000031 1788667025.990058 write 0x0236c6 thru 0x0245a3 (0xede bytes) 000032 1788667026.008333 write 0x00028c thru 0x005850 (0x55c5 bytes) 000034 1788667026.032532 punch from 0x021ab1 to 0x02fab6 (0xe006 bytes) 000035 1788667026.061276 mapwrite 0x02af69 thru 0x031ae2 (0x6b7a bytes) truncating to largest ever: 0x38295 000036 1788667026.209407 trunc from 0x03deb1 to 0x038294 (0x5c1c bytes) 000037 1788667026.272420 trunc from 0x038295 to 0x005dd6 (0x324be bytes) 000038 1788667026.309589 read 0x00234b thru 0x005dd6 (0x3a8c bytes) 000039 1788667026.311491 read 0x002ba9 thru 0x005dd6 (0x322e bytes) 000040 1788667026.312564 mapread 0x005aff thru 0x005dd6 (0x2d8 bytes) 000041 1788667026.315534 trunc from 0x005dd7 to 0x011275 (0xb49f bytes) 000042 1788667026.338316 write 0x00483c thru 0x00da0d (0x91d2 bytes) 000043 1788667026.346649 read 0x00f84d thru 0x011275 (0x1a29 bytes) 000044 1788667026.354575 mapwrite 0x03efda thru 0x03ffff (0x1026 bytes) 000045 1788667026.454492 MIRROR_RESYNC 2 mirrors 000047 1788667027.477374 read 0x021217 thru 0x026d64 (0x5b4e bytes) 000049 1788667027.490704 trunc from 0x040000 to 0x029d20 (0x162df bytes) 000050 1788667027.610556 punch from 0x0148fb to 0x024498 (0xfb9e bytes) 000053 1788667027.618970 mapwrite 0x01aa6d thru 0x0232e6 (0x887a bytes) 000054 1788667027.719884 read 0x009fd0 thru 0x019df3 (0xfe24 bytes) 000056 1788667027.731419 mapwrite 0x018874 thru 0x01fa55 (0x71e2 bytes) 000059 1788667027.781176 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) 000063 1788667027.956095 MIRROR_EXTEND to 2 mirrors 000064 1788667028.831309 mapread 0x0252e9 thru 0x029d20 (0x4a38 bytes) 000065 1788667028.851501 read 0x014df0 thru 0x015eb8 (0x10c9 bytes) 000067 1788667028.856395 read 0x01ee65 thru 0x025669 (0x6805 bytes) 000069 1788667028.865310 trunc from 0x029d21 to 0x025aea (0x4236 bytes) 000072 1788667028.989608 mapread 0x015b55 thru 0x025892 (0xfd3e bytes) 000073 1788667029.170156 trunc from 0x025aeb to 0x03532b (0xf841 bytes) 000075 1788667029.223017 write 0x01181a thru 0x0175da (0x5dc1 bytes) 000076 1788667029.249125 read 0x032c07 thru 0x03532b (0x2725 bytes) 000077 1788667029.251825 punch from 0x00b793 to 0x00c2c7 (0xb35 bytes) 000078 1788667029.279942 punch from 0x00b94d to 0x0106a0 (0x4d54 bytes) 000080 1788667029.288229 write 0x01dd7c thru 0x0214e8 (0x376d bytes) 000081 1788667029.290431 mapwrite 0x01bc46 thru 0x01f539 (0x38f4 bytes) 000082 1788667029.380552 read 0x004f59 thru 0x011843 (0xc8eb bytes) 000084 1788667029.406481 MIRROR_RESYNC 2 mirrors 000085 1788667030.224373 trunc from 0x03532c to 0x033283 (0x20a8 bytes) 000086 1788667030.385086 write 0x031724 thru 0x0332bc (0x1b99 bytes) 000087 1788667030.401243 trunc from 0x0332bd to 0x01fad9 (0x137e3 bytes) 000088 1788667030.454322 mapread 0x0137a8 thru 0x013bf0 (0x449 bytes) 000089 1788667030.466272 punch from 0x01d68c to 0x01fad9 (0x244e bytes) 000090 1788667030.474995 trunc from 0x01fada to 0x011b69 (0xdf70 bytes) 000092 1788667030.516101 write 0x01b08f thru 0x01c19a (0x110c bytes) 000093 1788667030.518071 read 0x018b2c thru 0x01c19a (0x366f bytes) 000095 1788667030.528938 write 0x02019c thru 0x02c4b0 (0xc315 bytes) 000097 1788667030.535525 read 0x018513 thru 0x021da3 (0x9891 bytes) 000098 1788667030.563220 trunc from 0x02c4b1 to 0x029019 (0x3497 bytes) 000099 1788667030.585785 punch from 0x00cfb9 to 0x018f85 (0xbfcd bytes) 000107 1788667030.608546 punch from 0x0069df to 0x00e87c (0x7e9e bytes) 000109 1788667030.624004 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x3eccc 000110 1788667031.540504 trunc from 0x02901a to 0x03eccb (0x15cb2 bytes) 000112 1788667031.738211 MIRROR_RESYNC 2 mirrors 000114 1788667032.668910 trunc from 0x03eccc to 0x02d7f4 (0x114d7 bytes) 000115 1788667032.771894 trunc from 0x02d7f5 to 0x01472e (0x190c6 bytes) 000116 1788667032.794339 MIRROR_RESYNC 2 mirrors 000117 1788667033.636338 mapread 0x01216c thru 0x01472e (0x25c3 bytes) 000118 1788667033.660262 read 0x00f30d thru 0x01472e (0x5422 bytes) 000119 1788667033.660784 mapread 0x00849a thru 0x0112ef (0x8e56 bytes) 000120 1788667033.669460 read 0x0053fb thru 0x00fb43 (0xa749 bytes) 000121 1788667033.679234 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) 000122 1788667033.831195 read 0x0132e6 thru 0x01472e (0x1449 bytes) 000124 1788667033.838113 mapwrite 0x01ca1b thru 0x02318f (0x6775 bytes) 000125 1788667033.991133 mapread 0x00585d thru 0x006cf8 (0x149c bytes) 000126 1788667034.007252 mapwrite 0x015661 thru 0x01edd5 (0x9775 bytes) 000127 1788667034.077867 read 0x00a5f9 thru 0x00d1d6 (0x2bde bytes) 000128 1788667034.078642 punch from 0x01daac to 0x01f821 (0x1d76 bytes) 000129 1788667034.084124 mapwrite 0x02fe49 thru 0x03d223 (0xd3db bytes) 000130 1788667034.184285 mapread 0x014710 thru 0x017a33 (0x3324 bytes) 000133 1788667034.187426 read 0x02520b thru 0x03452f (0xf325 bytes) 000134 1788667034.188174 mapread 0x02150c thru 0x0286a3 (0x7198 bytes) 000135 1788667034.189667 trunc from 0x03d224 to 0x0154e6 (0x27d3d bytes) 000136 1788667034.217144 write 0x003a77 thru 0x007fbe (0x4548 bytes) 000137 1788667034.218947 punch from 0x00adcf to 0x012270 (0x74a2 bytes) 000138 1788667034.231305 mapwrite 0x002c71 thru 0x009132 (0x64c2 bytes) 000141 1788667034.282001 mapwrite 0x018850 thru 0x021434 (0x8be5 bytes) 000142 1788667034.356667 mapread 0x00decd thru 0x00fc9a (0x1dce bytes) 000143 1788667034.357730 mapread 0x01bd72 thru 0x01e3bf (0x264e bytes) 000144 1788667034.359015 write 0x01d388 thru 0x02264b (0x52c4 bytes) 000147 1788667034.362529 trunc from 0x02264c to 0x00974c (0x18eff bytes) 000148 1788667034.380995 trunc from 0x00974d to 0x03bd49 (0x325fd bytes) 000151 1788667034.401257 mapwrite 0x02ce49 thru 0x02ff78 (0x3130 bytes) 000152 1788667034.475087 mapread 0x0090e1 thru 0x00a09d (0xfbd bytes) 000154 1788667034.480818 mapwrite 0x00b645 thru 0x016ae0 (0xb49c bytes) 000155 1788667034.607490 mapwrite 0x02a12d thru 0x0357ed (0xb6c1 bytes) 000156 1788667034.689328 mapwrite 0x03130c thru 0x03dd0c (0xca01 bytes) 000157 1788667034.798250 write 0x014f60 thru 0x0212b8 (0xc359 bytes) 000158 1788667034.811094 read 0x0224e1 thru 0x026f58 (0x4a78 bytes) 000160 1788667034.812500 punch from 0x026d15 to 0x02f64e (0x893a bytes) 000162 1788667034.846086 MIRROR_EXTEND to 2 mirrors 000163 1788667036.028881 write 0x00a4c6 thru 0x00b2f1 (0xe2c bytes) 000165 1788667036.131596 punch from 0x00c3fa to 0x0188f3 (0xc4fa bytes) 000166 1788667036.170622 read 0x03a78d thru 0x03b705 (0xf79 bytes) 000168 1788667036.182629 mapwrite 0x0035c0 thru 0x00e84f (0xb290 bytes) 000170 1788667036.287534 read 0x03cbf6 thru 0x03dd0c (0x1117 bytes) 000171 1788667036.298434 mapread 0x03c487 thru 0x03dd0c (0x1886 bytes) 000172 1788667036.304606 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3dd0d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd0d): Mirror 2: 0xa65eb5ab (stale) CRC-32 checksum value for chunk [0, 0x3dd0d): Mirror 1: 0x7efc4952 Mirror 3: 0x7efc4952 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd0d: skipped 000177 1788667037.313986 mapwrite 0x038317 thru 0x03e765 (0x644f bytes) 000178 1788667037.568130 punch from 0x004c50 to 0x013a16 (0xedc7 bytes) 000180 1788667037.575831 read 0x02633f thru 0x02c701 (0x63c3 bytes) 000181 1788667037.596147 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e766): Mirror 2: 0xd90aa17c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e766): Mirror 2: 0xd90aa17c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e766: skipped 000184 1788667038.089281 mapread 0x022149 thru 0x023dcc (0x1c84 bytes) 000188 1788667038.105011 trunc from 0x03e766 to 0x0252a5 (0x194c0 bytes) 000189 1788667038.123472 write 0x007751 thru 0x00ae5c (0x370c bytes) 000190 1788667038.134422 trunc from 0x0252a6 to 0x03193a (0xc695 bytes) 000191 1788667038.150798 mapread 0x013df5 thru 0x022fe2 (0xf1ee bytes) 000192 1788667038.176405 mapwrite 0x01b55b thru 0x028020 (0xcac6 bytes) 000194 1788667038.250240 read 0x01f276 thru 0x02c989 (0xd714 bytes) 000195 1788667038.250892 write 0x00db7b thru 0x0119bd (0x3e43 bytes) 000196 1788667038.251888 write 0x01e85b thru 0x020e10 (0x25b6 bytes) 000197 1788667038.255712 mapread 0x01c65c thru 0x020d9d (0x4742 bytes) 000198 1788667038.263320 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) 000200 1788667038.452019 write 0x01cf5c thru 0x0291d0 (0xc275 bytes) 000202 1788667038.473872 mapread 0x00bd13 thru 0x01723d (0xb52b bytes) 000203 1788667038.511636 trunc from 0x03193b to 0x039caa (0x8370 bytes) 000204 1788667038.536983 MIRROR_EXTEND to 2 mirrors 000205 1788667039.759414 punch from 0x004262 to 0x008978 (0x4717 bytes) 000206 1788667039.867360 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) 000207 1788667040.063411 trunc from 0x039cab to 0x03ad00 (0x1056 bytes) 000208 1788667040.093515 trunc from 0x03ad01 to 0x01562f (0x256d1 bytes) 000209 1788667040.121435 write 0x038f7f thru 0x03ffff (0x7081 bytes) 000210 1788667040.122703 mapwrite 0x03191a thru 0x03be53 (0xa53a bytes) 000214 1788667040.221756 punch from 0x01ebd6 to 0x01f873 (0xc9e bytes) 000216 1788667040.228203 mapread 0x035900 thru 0x038985 (0x3086 bytes) 000217 1788667040.229476 mapwrite 0x036458 thru 0x038c0c (0x27b5 bytes) 000218 1788667040.282185 read 0x0105a6 thru 0x01291f (0x237a bytes) 000221 1788667040.296338 write 0x00c01c thru 0x0104f5 (0x44da bytes) 000222 1788667040.302441 read 0x01e276 thru 0x0208d1 (0x265c bytes) 000224 1788667040.312921 trunc from 0x040000 to 0x02215e (0x1dea1 bytes) 000225 1788667040.330373 mapwrite 0x00e4ff thru 0x00f60e (0x1110 bytes) 000226 1788667040.377874 write 0x0085f8 thru 0x012e3d (0xa846 bytes) 000227 1788667040.379367 mapwrite 0x02b113 thru 0x03a3b9 (0xf2a7 bytes) 000228 1788667040.527648 mapread 0x022b36 thru 0x027691 (0x4b5c bytes) 000229 1788667040.574229 trunc from 0x03a3ba to 0x034a4c (0x596d bytes) 000230 1788667040.622989 trunc from 0x034a4d to 0x03a492 (0x5a46 bytes) 000231 1788667040.665484 mapread 0x00e682 thru 0x014116 (0x5a95 bytes) 000232 1788667040.671032 mapwrite 0x017943 thru 0x01cb1a (0x51d8 bytes) 000234 1788667040.803457 trunc from 0x03a493 to 0x017685 (0x22e0d bytes) 000235 1788667040.828912 mapread 0x0044a3 thru 0x00ad22 (0x6880 bytes) 000237 1788667040.835927 mapwrite 0x01e59f thru 0x02a7ad (0xc20f bytes) 000241 1788667041.010556 mapwrite 0x01251b thru 0x0208d9 (0xe3bf bytes) 000244 1788667041.104441 punch from 0x00eea8 to 0x01742b (0x8584 bytes) 000247 1788667041.114385 write 0x023023 thru 0x027be6 (0x4bc4 bytes) 000250 1788667041.117641 mapread 0x026d09 thru 0x02a7ad (0x3aa5 bytes) 000251 1788667041.119272 mapwrite 0x007701 thru 0x01119b (0x9a9b bytes) 000252 1788667041.276755 trunc from 0x02a7ae to 0x01a75f (0x1004e bytes) 000253 1788667041.296792 punch from 0x00d93c to 0x01a3d5 (0xca9a bytes) 000254 1788667041.302316 mapwrite 0x00d703 thru 0x01c604 (0xef02 bytes) 000255 1788667041.499129 write 0x00f49a thru 0x015db9 (0x6920 bytes) 000256 1788667041.500186 write 0x0000e4 thru 0x004a6a (0x4987 bytes) 000259 1788667041.503425 trunc from 0x01c605 to 0x023e07 (0x7803 bytes) 000260 1788667041.538932 read 0x023d3c thru 0x023e07 (0xcc bytes) 000263 1788667041.559923 mapread 0x01c920 thru 0x0208e8 (0x3fc9 bytes) 000264 1788667041.560967 write 0x00af63 thru 0x00d85a (0x28f8 bytes) 000265 1788667041.564018 mapread 0x014c41 thru 0x01e830 (0x9bf0 bytes) 000266 1788667041.565211 trunc from 0x023e08 to 0x00f022 (0x14de5 bytes) 000272 1788667041.623329 mapwrite 0x03519b thru 0x03ffff (0xae65 bytes) 000273 1788667041.724604 punch from 0x00d034 to 0x012399 (0x5366 bytes) 000276 1788667041.730948 mapread 0x004228 thru 0x006f9a (0x2d73 bytes) 000279 1788667041.734118 read 0x02f53a thru 0x02fa02 (0x4c9 bytes) 000281 1788667041.735216 read 0x02ee3a thru 0x037a04 (0x8bcb bytes) 000283 1788667041.737080 punch from 0x03de2c to 0x03ffff (0x21d4 bytes) 000285 1788667041.742634 read 0x034fcb thru 0x03ffff (0xb035 bytes) 000286 1788667041.762232 punch from 0x03e7af to 0x03ffff (0x1851 bytes) 000287 1788667041.767083 punch from 0x01692d to 0x01ba4f (0x5123 bytes) 000288 1788667041.772382 mapwrite 0x008049 thru 0x00a681 (0x2639 bytes) 000289 1788667041.815496 punch from 0x000c6e to 0x009af7 (0x8e8a bytes) 000290 1788667041.827361 read 0x00faef thru 0x01f353 (0xf865 bytes) 000291 1788667041.853360 mapwrite 0x009617 thru 0x00d040 (0x3a2a bytes) 000293 1788667041.921406 punch from 0x028fee to 0x02eedf (0x5ef2 bytes) 000294 1788667041.927804 write 0x024d6e thru 0x031573 (0xc806 bytes) 000295 1788667041.934539 read 0x033ba2 thru 0x03476c (0xbcb bytes) 000297 1788667041.947954 MIRROR_EXTEND to 2 mirrors 000299 1788667043.139106 trunc from 0x040000 to 0x00a1e1 (0x35e1e bytes) 000300 1788667043.235288 mapread 0x0042fd thru 0x00a1e1 (0x5ee5 bytes) 000301 1788667043.266880 read 0x00691e thru 0x006aa4 (0x187 bytes) 000302 1788667043.267741 read 0x00535a thru 0x00a1e1 (0x4e88 bytes) 000303 1788667043.275648 read 0x006b3a thru 0x00a1e1 (0x36a8 bytes) 000304 1788667043.281424 mapwrite 0x01c8e6 thru 0x02b3fd (0xeb18 bytes) 000305 1788667043.419448 trunc from 0x02b3fe to 0x02956b (0x1e92 bytes) 000306 1788667043.451982 punch from 0x016b9d to 0x02061d (0x9a81 bytes) 000307 1788667043.460379 trunc from 0x02956c to 0x035e59 (0xc8ee bytes) 000308 1788667043.480299 MIRROR_RESYNC 2 mirrors 000310 1788667044.521570 punch from 0x0155b2 to 0x01bbf9 (0x6648 bytes) 000311 1788667044.646240 mapwrite 0x03046a thru 0x03c371 (0xbf08 bytes) 000314 1788667044.798042 mapread 0x01bd73 thru 0x01f07e (0x330c bytes) 000315 1788667044.812296 write 0x037481 thru 0x03e931 (0x74b1 bytes) 000317 1788667044.815325 read 0x005dc8 thru 0x00b0a2 (0x52db bytes) 000318 1788667044.826616 mapwrite 0x00349c thru 0x004bce (0x1733 bytes) 000322 1788667044.909611 mapwrite 0x030679 thru 0x039270 (0x8bf8 bytes) 000326 1788667044.961678 read 0x00f1fe thru 0x0161b5 (0x6fb8 bytes) 000327 1788667044.979719 mapread 0x00ac06 thru 0x00b907 (0xd02 bytes) 000329 1788667044.981262 mapwrite 0x0158f1 thru 0x019dfe (0x450e bytes) 000331 1788667045.029581 mapread 0x02e944 thru 0x035836 (0x6ef3 bytes) 000334 1788667045.035128 mapread 0x02d0a9 thru 0x038c79 (0xbbd1 bytes) 000335 1788667045.037404 mapread 0x00cb43 thru 0x00db0a (0xfc8 bytes) 000336 1788667045.043121 read 0x026b9b thru 0x02e097 (0x74fd bytes) 000337 1788667045.043760 write 0x02021e thru 0x02d801 (0xd5e4 bytes) 000338 1788667045.044946 mapread 0x01c09e thru 0x020585 (0x44e8 bytes) 000339 1788667045.066554 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) 000341 1788667045.256602 write 0x023d76 thru 0x02fdd2 (0xc05d bytes) 000342 1788667045.286091 MIRROR_EXTEND to 2 mirrors 000345 1788667046.189604 punch from 0x0322f4 to 0x03a83e (0x854b bytes) 000346 1788667046.355362 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e932): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e932): Mirror 2: 0x4df525b5 (stale) CRC-32 checksum value for chunk [0, 0x3e932): Mirror 1: 0x21fb73e8 Mirror 3: 0x21fb73e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e932: skipped 000347 1788667047.649637 MIRROR_RESYNC 3 mirrors 000348 1788667048.660397 read 0x000a65 thru 0x009fb4 (0x9550 bytes) 000349 1788667048.672120 write 0x037bca thru 0x03e653 (0x6a8a bytes) 000351 1788667048.746214 read 0x00716a thru 0x013c2e (0xcac5 bytes) 000352 1788667048.760641 mapread 0x00e807 thru 0x01b6d4 (0xcece bytes) 000353 1788667048.763523 read 0x007ac6 thru 0x012776 (0xacb1 bytes) 000356 1788667048.765626 mapwrite 0x01003a thru 0x01d8af (0xd876 bytes) 000357 1788667048.841313 read 0x0308b6 thru 0x033afb (0x3246 bytes) 000358 1788667048.848552 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e932): Mirror 2: 0x21fb73e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e932): Mirror 2: 0x21fb73e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e932: skipped 000359 1788667049.179171 read 0x026711 thru 0x030e31 (0xa721 bytes) 000362 1788667049.195221 punch from 0x00ece0 to 0x01e854 (0xfb75 bytes) 000363 1788667049.204712 write 0x01e430 thru 0x01ea9a (0x66b bytes) 000364 1788667049.213893 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e932): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e932): Mirror 2: 0x21fb73e8 (stale) CRC-32 checksum value for chunk [0, 0x3e932): Mirror 1: 0x9641a456 Mirror 3: 0x9641a456 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e932: skipped 000365 1788667050.552188 trunc from 0x03e932 to 0x017c41 (0x26cf0 bytes) 000367 1788667050.733689 trunc from 0x017c42 to 0x0060bc (0x11b85 bytes) 000368 1788667050.767084 write 0x031a68 thru 0x0351ac (0x3745 bytes) 000369 1788667050.769634 punch from 0x00eb61 to 0x01b7e0 (0xcc80 bytes) 000370 1788667050.807059 punch from 0x02da37 to 0x03063d (0x2c07 bytes) 000371 1788667050.812611 punch from 0x00c2b6 to 0x01b176 (0xeec1 bytes) 000372 1788667050.825344 write 0x0227d3 thru 0x02bbf5 (0x9423 bytes) 000373 1788667050.845998 trunc from 0x0351ad to 0x008373 (0x2ce39 bytes) 000374 1788667050.889824 mapread 0x0000e6 thru 0x007647 (0x7562 bytes) 000375 1788667050.967383 write 0x0002c3 thru 0x00eb37 (0xe875 bytes) 000377 1788667050.980803 punch from 0x00e2b0 to 0x00eb37 (0x888 bytes) 000378 1788667051.009655 punch from 0x00dcce to 0x00eb37 (0xe6a bytes) 000379 1788667051.017163 punch from 0x0026b4 to 0x00a32d (0x7c7a bytes) 000383 1788667051.039351 mapread 0x00082f thru 0x002bf1 (0x23c3 bytes) 000384 1788667051.056892 trunc from 0x00eb38 to 0x03d4df (0x2e9a8 bytes) 000386 1788667051.085225 mapwrite 0x00efb9 thru 0x00f7c4 (0x80c bytes) 000388 1788667051.156746 mapwrite 0x0362bc thru 0x038992 (0x26d7 bytes) 000389 1788667051.263258 punch from 0x00a96c to 0x00adbf (0x454 bytes) 000390 1788667051.273322 read 0x01dd9f thru 0x0228a0 (0x4b02 bytes) 000391 1788667051.294112 trunc from 0x03d4e0 to 0x00f629 (0x2deb6 bytes) 000392 1788667051.325377 mapwrite 0x03ba97 thru 0x03ffff (0x4569 bytes) 000393 1788667051.547066 mapwrite 0x0182dc thru 0x01d073 (0x4d98 bytes) 000395 1788667051.636645 read 0x00c57c thru 0x017d16 (0xb79b bytes) 000396 1788667051.651335 write 0x02bc62 thru 0x02ca42 (0xde1 bytes) 000397 1788667051.663937 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x309368d4 (stale) Mirror 3: 0xad87a678 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa5a1d68f Mirror 4: 0xa5a1d68f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000398 1788667052.668615 trunc from 0x040000 to 0x0183bf (0x27c40 bytes) 000399 1788667052.792133 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x183c0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x183c0): Mirror 2: 0x6aa747ed (stale) Mirror 3: 0xba6c8ba9 (stale) Mirror 4: 0x1d33a030 (stale) CRC-32 checksum value for chunk [0, 0x183c0): Mirror 1: 0x1d33a030 Mirror 5: 0x1d33a030 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x183c0: skipped 000400 1788667053.788388 read 0x008cc2 thru 0x013287 (0xa5c6 bytes) 000401 1788667053.799004 mapread 0x001297 thru 0x005cdd (0x4a47 bytes) 000402 1788667053.820560 write 0x014b41 thru 0x01caf3 (0x7fb3 bytes) 000403 1788667053.922113 read 0x01a318 thru 0x01caf3 (0x27dc bytes) 000405 1788667053.926217 mapread 0x0163f5 thru 0x01caf3 (0x66ff bytes) 000408 1788667053.929776 read 0x011a2b thru 0x015039 (0x360f bytes) 000409 1788667053.941106 mapwrite 0x03bda4 thru 0x03ffff (0x425c bytes) 000410 1788667054.054627 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x309368d4 (stale) Mirror 3: 0xad87a678 (stale) Mirror 4: 0xa5a1d68f (stale) Mirror 5: 0xacff99f2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbf8920fc Mirror 6: 0xbf8920fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000411 1788667055.415891 trunc from 0x040000 to 0x020cfc (0x1f303 bytes) 000412 1788667055.532965 write 0x0111aa thru 0x013cce (0x2b25 bytes) 000413 1788667055.542256 mapread 0x016cb9 thru 0x0176e1 (0xa29 bytes) 000414 1788667055.558793 mapwrite 0x011116 thru 0x01e5ca (0xd4b5 bytes) 000416 1788667055.646913 MIRROR_RESYNC 6 mirrors 000418 1788667057.498478 punch from 0x0078bd to 0x00bf34 (0x4678 bytes) 000419 1788667057.572183 mapwrite 0x036b82 thru 0x036c2b (0xaa bytes) 000421 1788667057.693362 read 0x02df1f thru 0x02e3a4 (0x486 bytes) 000427 1788667057.712349 write 0x037407 thru 0x03ffff (0x8bf9 bytes) 000429 1788667057.715608 punch from 0x010b64 to 0x01ff17 (0xf3b4 bytes) 000430 1788667057.738942 trunc from 0x040000 to 0x0374b8 (0x8b47 bytes) 000431 1788667057.757471 read 0x02828e thru 0x029981 (0x16f4 bytes) 000432 1788667057.794599 mapwrite 0x00f749 thru 0x01b4ba (0xbd72 bytes) 000433 1788667057.867030 trunc from 0x0374b9 to 0x028291 (0xf227 bytes) 000434 1788667057.896207 trunc from 0x028292 to 0x03572e (0xd49d bytes) 000438 1788667057.926901 mapread 0x019b5d thru 0x01d0fa (0x359e bytes) 000440 1788667057.933364 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3572f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3572f): Mirror 2: 0x6d1d1cb9 (stale) Mirror 3: 0x6d1d1cb9 (stale) Mirror 4: 0x6d1d1cb9 (stale) Mirror 5: 0x6d1d1cb9 (stale) Mirror 6: 0x6d1d1cb9 (stale) CRC-32 checksum value for chunk [0, 0x3572f): Mirror 1: 0x8af83874 Mirror 7: 0x8af83874 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3572f: skipped 000444 1788667059.300920 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3572f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3572f): Mirror 2: 0x6d1d1cb9 (stale) Mirror 3: 0x6d1d1cb9 (stale) Mirror 4: 0x6d1d1cb9 (stale) Mirror 5: 0x6d1d1cb9 (stale) Mirror 6: 0x6d1d1cb9 (stale) CRC-32 checksum value for chunk [0, 0x3572f): Mirror 1: 0x8af83874 Mirror 7: 0x8af83874 Mirror 8: 0x8af83874 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3572f: skipped 000445 1788667060.488294 MIRROR_RESYNC 8 mirrors 000447 1788667062.243674 trunc from 0x03572f to 0x01b2d1 (0x1a45d bytes) 000448 1788667062.339318 read 0x00ade3 thru 0x019ae6 (0xed04 bytes) 000449 1788667062.348813 mapwrite 0x020ffe thru 0x022fcc (0x1fcf bytes) 000450 1788667062.461968 trunc from 0x022fcd to 0x036e2f (0x13e63 bytes) 000452 1788667062.488189 trunc from 0x036e30 to 0x023ffb (0x12e34 bytes) 000453 1788667062.525745 mapread 0x01bf52 thru 0x01cec5 (0xf74 bytes) 000456 1788667062.544515 read 0x001e85 thru 0x00a18a (0x8306 bytes) 000457 1788667062.560530 write 0x0284b6 thru 0x0335bf (0xb10a bytes) 000461 1788667062.567742 read 0x013423 thru 0x01fb61 (0xc73f bytes) 000463 1788667062.570659 mapread 0x029107 thru 0x0335bf (0xa4b9 bytes) 000464 1788667062.572107 write 0x00ed69 thru 0x01c6ee (0xd986 bytes) 000465 1788667062.575720 mapread 0x0332fb thru 0x0335bf (0x2c5 bytes) 000466 1788667062.580729 punch from 0x00a673 to 0x0192f6 (0xec84 bytes) 000467 1788667062.639487 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x335c0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x335c0): Mirror 2: 0x43dbb63e (stale) Mirror 3: 0x43dbb63e (stale) Mirror 4: 0x43dbb63e (stale) Mirror 5: 0x43dbb63e (stale) Mirror 6: 0x43dbb63e (stale) Mirror 7: 0x43dbb63e (stale) Mirror 8: 0x43dbb63e (stale) CRC-32 checksum value for chunk [0, 0x335c0): Mirror 1: 0x2f10377a Mirror 9: 0x2f10377a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x335c0: skipped 000468 1788667063.874103 mapwrite 0x0341c1 thru 0x03797d (0x37bd bytes) 000469 1788667064.072866 punch from 0x03419f to 0x0341af (0x11 bytes) 000472 1788667064.092644 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3797e): Mirror 2: 0xa6752a65 (stale) Mirror 3: 0xa6752a65 (stale) Mirror 4: 0xa6752a65 (stale) Mirror 5: 0xa6752a65 (stale) Mirror 6: 0xa6752a65 (stale) Mirror 8: 0xa6752a65 (stale) Mirror 9: 0x5dd76005 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3797e): Mirror 2: 0xa6752a65 (stale) Mirror 3: 0xa6752a65 (stale) Mirror 4: 0xa6752a65 (stale) Mirror 5: 0xa6752a65 (stale) Mirror 6: 0xa6752a65 (stale) Mirror 8: 0xa6752a65 (stale) Mirror 9: 0x5dd76005 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3797e: skipped 000475 1788667064.674042 read 0x0070a6 thru 0x007be0 (0xb3b bytes) 000477 1788667064.684900 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3797e): Mirror 2: 0xa6752a65 (stale) Mirror 3: 0xa6752a65 (stale) Mirror 4: 0xa6752a65 (stale) Mirror 5: 0xa6752a65 (stale) Mirror 8: 0xa6752a65 (stale) Mirror 9: 0x5dd76005 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3797e): Mirror 2: 0xa6752a65 (stale) Mirror 3: 0xa6752a65 (stale) Mirror 4: 0xa6752a65 (stale) Mirror 5: 0xa6752a65 (stale) Mirror 8: 0xa6752a65 (stale) Mirror 9: 0x5dd76005 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3797e: skipped 000478 1788667065.204529 read 0x003ff9 thru 0x00b8b9 (0x78c1 bytes) 000479 1788667065.212470 punch from 0x01f467 to 0x02c764 (0xd2fe bytes) 000480 1788667065.219048 mapwrite 0x00b073 thru 0x0156dc (0xa66a bytes) 000482 1788667065.308025 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3797e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3797e): Mirror 2: 0xa6752a65 (stale) Mirror 3: 0xa6752a65 (stale) Mirror 4: 0xa6752a65 (stale) Mirror 5: 0xa6752a65 (stale) Mirror 8: 0xa6752a65 (stale) Mirror 9: 0x5dd76005 (stale) CRC-32 checksum value for chunk [0, 0x3797e): Mirror 1: 0x26c87568 Mirror 10: 0x26c87568 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3797e: skipped 000483 1788667066.238523 mapread 0x000291 thru 0x0023fe (0x216e bytes) 000484 1788667066.253923 punch from 0x00d1a4 to 0x015108 (0x7f65 bytes) 000486 1788667066.345927 read 0x0146ca thru 0x02396e (0xf2a5 bytes) 000487 1788667066.372289 punch from 0x00f0a1 to 0x01b6c8 (0xc628 bytes) 000488 1788667066.383133 mapwrite 0x01e9c0 thru 0x021dbc (0x33fd bytes) 000489 1788667066.448108 mapread 0x01a3d9 thru 0x0245a0 (0xa1c8 bytes) 000490 1788667066.472021 mapwrite 0x035ed4 thru 0x03c5ac (0x66d9 bytes) 000491 1788667066.619650 mapread 0x012a26 thru 0x01d322 (0xa8fd bytes) 000492 1788667066.641814 MIRROR_RESYNC 8 mirrors 000493 1788667068.255275 write 0x000666 thru 0x0013cc (0xd67 bytes) 000494 1788667068.351503 trunc from 0x03c5ad to 0x028455 (0x14157 bytes) 000495 1788667068.378112 trunc from 0x028456 to 0x01162f (0x16e26 bytes) 000496 1788667068.394295 mapwrite 0x01227d thru 0x01deb2 (0xbc36 bytes) 000498 1788667068.518724 read 0x01a7a4 thru 0x01deb2 (0x370f bytes) 000499 1788667068.522598 trunc from 0x01deb3 to 0x00d9e3 (0x104cf bytes) 000500 1788667068.546861 write 0x007451 thru 0x00e894 (0x7444 bytes) 000505 1788667068.570730 punch from 0x001b98 to 0x00e894 (0xccfd bytes) 000506 1788667068.592112 punch from 0x0080dd to 0x00e894 (0x67b8 bytes) 000507 1788667068.606509 write 0x006999 thru 0x010b66 (0xa1ce bytes) 000508 1788667068.617016 write 0x0036d8 thru 0x009469 (0x5d92 bytes) 000510 1788667068.625983 punch from 0x003b4c to 0x00e283 (0xa738 bytes) 000511 1788667068.640178 mapread 0x004bfc thru 0x010b66 (0xbf6b bytes) 000513 1788667068.661739 read 0x00858d thru 0x009c86 (0x16fa bytes) 000514 1788667068.662355 punch from 0x00b2e0 to 0x00f21b (0x3f3c bytes) 000515 1788667068.672884 MIRROR_RESYNC 8 mirrors 000516 1788667070.454424 trunc from 0x010b67 to 0x017d6f (0x7209 bytes) 000517 1788667070.566660 mapwrite 0x001aaf thru 0x0039f8 (0x1f4a bytes) 000518 1788667070.678541 trunc from 0x017d70 to 0x00626a (0x11b05 bytes) 000519 1788667070.708816 trunc from 0x00626b to 0x005e2a (0x440 bytes) 000521 1788667070.732653 read 0x001945 thru 0x005e2a (0x44e6 bytes) 000524 1788667070.742800 MIRROR_RESYNC 8 mirrors 000525 1788667072.373446 mapwrite 0x00d46a thru 0x0127bb (0x5352 bytes) 000526 1788667072.677689 write 0x0336c2 thru 0x036e11 (0x3750 bytes) 000529 1788667072.684433 mapread 0x003383 thru 0x010d88 (0xda06 bytes) 000532 1788667072.725789 trunc from 0x036e12 to 0x0277dd (0xf634 bytes) 000536 1788667072.762741 write 0x001dad thru 0x00d8b5 (0xbb09 bytes) 000537 1788667072.765161 punch from 0x0056b0 to 0x00b2bb (0x5c0c bytes) 000538 1788667072.784148 read 0x018611 thru 0x026b2c (0xe51c bytes) 000539 1788667072.793296 read 0x01c412 thru 0x021f50 (0x5b3f bytes) 000540 1788667072.802531 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x277de): Mirror 2: 0x80f0414b (stale) Mirror 3: 0x80f0414b (stale) Mirror 4: 0x80f0414b (stale) Mirror 5: 0x80f0414b (stale) Mirror 9: 0x80f0414b (stale) Mirror 10: 0x80f0414b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x277de): Mirror 2: 0x80f0414b (stale) Mirror 3: 0x80f0414b (stale) Mirror 4: 0x80f0414b (stale) Mirror 5: 0x80f0414b (stale) Mirror 9: 0x80f0414b (stale) Mirror 10: 0x80f0414b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x277de: skipped 000541 1788667073.399153 read 0x00248a thru 0x00bd57 (0x98ce bytes) 000545 1788667073.413150 read 0x01c1cc thru 0x0277dd (0xb612 bytes) 000547 1788667073.429350 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x277de): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x277de): Mirror 2: 0x80f0414b (stale) Mirror 3: 0x80f0414b (stale) Mirror 4: 0x80f0414b (stale) Mirror 5: 0x80f0414b (stale) Mirror 9: 0x80f0414b (stale) Mirror 10: 0x80f0414b (stale) CRC-32 checksum value for chunk [0, 0x277de): Mirror 1: 0x2d86cf0b Mirror 11: 0x2d86cf0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x277de: skipped 000548 1788667074.950425 read 0x004586 thru 0x0135cc (0xf047 bytes) 000549 1788667074.965742 write 0x0316ff thru 0x03cd47 (0xb649 bytes) 000550 1788667075.058816 mapwrite 0x004f0b thru 0x00c3df (0x74d5 bytes) 000551 1788667075.140656 trunc from 0x03cd48 to 0x005cec (0x3705b bytes) 000552 1788667075.205958 mapread 0x005762 thru 0x005c00 (0x49f bytes) 000554 1788667075.207278 punch from 0x0018cc to 0x005cec (0x4421 bytes) 000555 1788667075.212608 trunc from 0x005ced to 0x01db54 (0x17e68 bytes) 000557 1788667075.239039 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1db55): Mirror 2: 0xd58dce10 (stale) Mirror 3: 0xd58dce10 (stale) Mirror 4: 0xd58dce10 (stale) Mirror 5: 0xd58dce10 (stale) Mirror 10: 0xd58dce10 (stale) Mirror 11: 0x8618e54b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1db55): Mirror 2: 0xd58dce10 (stale) Mirror 3: 0xd58dce10 (stale) Mirror 4: 0xd58dce10 (stale) Mirror 5: 0xd58dce10 (stale) Mirror 10: 0xd58dce10 (stale) Mirror 11: 0x8618e54b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1db55: skipped 000558 1788667075.670128 MIRROR_RESYNC 7 mirrors 000560 1788667078.069220 write 0x03bd1b thru 0x03ffff (0x42e5 bytes) 000561 1788667078.136741 read 0x004ee9 thru 0x00afd5 (0x60ed bytes) 000563 1788667078.174203 MIRROR_RESYNC 7 mirrors 000564 1788667080.957923 mapwrite 0x033807 thru 0x03ffff (0xc7f9 bytes) 000566 1788667081.301948 write 0x003ce5 thru 0x005e9f (0x21bb bytes) 000567 1788667081.319403 mapread 0x01edee thru 0x01f03c (0x24f bytes) 000568 1788667081.330618 trunc from 0x040000 to 0x0012e5 (0x3ed1a bytes) 000569 1788667081.357491 mapwrite 0x01f1a7 thru 0x0285a3 (0x93fd bytes) 000570 1788667081.469094 punch from 0x027ec1 to 0x0285a3 (0x6e3 bytes) 000571 1788667081.480547 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x285a4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x285a4): Mirror 2: 0x19647f7f (stale) Mirror 3: 0x19647f7f (stale) Mirror 4: 0x19647f7f (stale) Mirror 5: 0x19647f7f (stale) Mirror 10: 0x19647f7f (stale) Mirror 11: 0x19647f7f (stale) CRC-32 checksum value for chunk [0, 0x285a4): Mirror 1: 0x98d02279 Mirror 12: 0x98d02279 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x285a4: skipped 000572 1788667083.089561 MIRROR_RESYNC 8 mirrors 000574 1788667084.881779 MIRROR_EXTEND to 9 mirrors 000576 1788667085.808132 write 0x02f766 thru 0x03f38c (0xfc27 bytes) 000577 1788667085.867999 mapwrite 0x03d370 thru 0x03ffff (0x2c90 bytes) 000579 1788667086.000083 read 0x0290b5 thru 0x037940 (0xe88c bytes) 000580 1788667086.013742 mapread 0x03e753 thru 0x03ffff (0x18ad bytes) 000581 1788667086.014823 punch from 0x007cbc to 0x00bf45 (0x428a bytes) 000582 1788667086.026772 punch from 0x027165 to 0x02f6e7 (0x8583 bytes) 000584 1788667086.049515 read 0x038dd0 thru 0x03ffff (0x7230 bytes) 000590 1788667086.068168 mapread 0x00bce7 thru 0x01bbc0 (0xfeda bytes) 000593 1788667086.124918 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 5: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 11: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 5: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 11: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000594 1788667086.984383 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 5: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 11: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x389f842b Mirror 14: 0x389f842b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000595 1788667088.442818 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 5: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 5: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x389f842b Mirror 14: 0x389f842b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000596 1788667089.315328 write 0x01dd64 thru 0x026eba (0x9157 bytes) 000598 1788667089.420618 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 5: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 5: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000599 1788667090.062145 read 0x022a06 thru 0x031e73 (0xf46e bytes) 000600 1788667090.077092 write 0x02e5ad thru 0x031e2b (0x387f bytes) 000601 1788667090.078249 read 0x02de1e thru 0x030ba7 (0x2d8a bytes) 000602 1788667090.078886 write 0x03ec12 thru 0x03ffff (0x13ee bytes) 000605 1788667090.091021 write 0x035e4a thru 0x03ffff (0xa1b6 bytes) 000606 1788667090.097302 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) Mirror 13: 0x5bc23fdf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000607 1788667090.859719 read 0x032445 thru 0x03bfcd (0x9b89 bytes) 000608 1788667090.894096 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5bc23fdf (stale) Mirror 4: 0x5bc23fdf (stale) Mirror 10: 0x5bc23fdf (stale) Mirror 12: 0x5bc23fdf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000609 1788667091.575014 write 0x00d4f9 thru 0x00d7d2 (0x2da bytes) 000610 1788667091.583288 punch from 0x010129 to 0x018386 (0x825e bytes) 000611 1788667091.593983 trunc from 0x040000 to 0x038a44 (0x75bb bytes) 000612 1788667091.611964 mapread 0x02fab4 thru 0x032d52 (0x329f bytes) 000614 1788667091.631939 mapread 0x019047 thru 0x026f52 (0xdf0c bytes) 000615 1788667091.653823 read 0x0288bb thru 0x0328b2 (0x9ff8 bytes) 000616 1788667091.663507 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38a45): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a45): Mirror 3: 0xc33279c8 (stale) Mirror 4: 0xc33279c8 (stale) Mirror 10: 0xc33279c8 (stale) Mirror 12: 0xc33279c8 (stale) CRC-32 checksum value for chunk [0, 0x38a45): Mirror 1: 0x3de812e2 Mirror 13: 0x3de812e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a45: skipped 000617 1788667093.299917 mapwrite 0x0155fa thru 0x0173df (0x1de6 bytes) 000618 1788667093.559200 mapwrite 0x038041 thru 0x03bf8f (0x3f4f bytes) 000619 1788667093.682932 read 0x023fd9 thru 0x02cd82 (0x8daa bytes) 000620 1788667093.699907 mapwrite 0x017d50 thru 0x0218b0 (0x9b61 bytes) 000622 1788667093.807330 trunc from 0x03bf90 to 0x0357e4 (0x67ab bytes) 000624 1788667093.877975 punch from 0x029ab3 to 0x02b88f (0x1ddd bytes) 000626 1788667093.889790 read 0x005ef5 thru 0x00c86c (0x6978 bytes) 000627 1788667093.939415 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x357e5): Mirror 3: 0x61233e7 (stale) Mirror 4: 0x61233e7 (stale) Mirror 10: 0x61233e7 (stale) Mirror 13: 0xe3a2d3c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x357e5): Mirror 3: 0x61233e7 (stale) Mirror 4: 0x61233e7 (stale) Mirror 10: 0x61233e7 (stale) Mirror 13: 0xe3a2d3c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x357e5: skipped 000629 1788667094.609098 write 0x0395f7 thru 0x03e0a7 (0x4ab1 bytes) 000630 1788667094.618303 mapwrite 0x03fb61 thru 0x03ffff (0x49f bytes) 000631 1788667094.718469 punch from 0x028834 to 0x02de97 (0x5664 bytes) 000635 1788667094.732332 write 0x034b8b thru 0x03bae1 (0x6f57 bytes) 000637 1788667094.753115 mapread 0x02d674 thru 0x03cd2f (0xf6bc bytes) 000640 1788667094.818096 punch from 0x017eb4 to 0x026fb0 (0xf0fd bytes) 000641 1788667094.860786 punch from 0x034774 to 0x03bfc9 (0x7856 bytes) 000642 1788667094.873827 punch from 0x01099b to 0x01ac74 (0xa2da bytes) 000645 1788667094.887186 trunc from 0x040000 to 0x016875 (0x2978a bytes) 000646 1788667094.946806 mapread 0x00e325 thru 0x01136e (0x304a bytes) 000647 1788667094.961025 mapread 0x011054 thru 0x0166ae (0x565b bytes) 000649 1788667094.962064 read 0x00dfa1 thru 0x016875 (0x88d5 bytes) 000655 1788667094.969654 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x16876): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16876): Mirror 3: 0x1b877cfd (stale) Mirror 4: 0x1b877cfd (stale) Mirror 10: 0x1b877cfd (stale) Mirror 13: 0xe89b3c5b (stale) CRC-32 checksum value for chunk [0, 0x16876): Mirror 1: 0xe89b3c5b Mirror 14: 0xe89b3c5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16876: skipped 000656 1788667096.583518 punch from 0x0053ad to 0x01475c (0xf3b0 bytes) 000658 1788667096.681014 mapwrite 0x02814a thru 0x02cfd0 (0x4e87 bytes) 000659 1788667096.870308 trunc from 0x02cfd1 to 0x001e6f (0x2b161 bytes) 000660 1788667096.919364 read 0x0008b9 thru 0x001e6f (0x15b7 bytes) 000661 1788667096.928964 mapread 0x000249 thru 0x001351 (0x1109 bytes) 000662 1788667096.933030 mapread 0x001e42 thru 0x001e6f (0x2e bytes) 000663 1788667096.937938 mapwrite 0x029268 thru 0x02a083 (0xe1c bytes) 000668 1788667097.117063 mapread 0x00b98c thru 0x012fc5 (0x763a bytes) 000674 1788667097.150800 trunc from 0x02a084 to 0x03d76e (0x136eb bytes) 000676 1788667097.184317 mapwrite 0x0244a9 thru 0x02dcbd (0x9815 bytes) 000677 1788667097.391894 mapread 0x021669 thru 0x02320d (0x1ba5 bytes) 000678 1788667097.423285 punch from 0x00f7f4 to 0x0175de (0x7deb bytes) 000680 1788667097.446690 mapread 0x03d379 thru 0x03d3d6 (0x5e bytes) 000681 1788667097.463669 trunc from 0x03d76f to 0x032120 (0xb64e bytes) 000682 1788667097.480781 mapread 0x0026b4 thru 0x002a96 (0x3e3 bytes) 000683 1788667097.493624 MIRROR_RESYNC 6 mirrors 000685 1788667100.339609 punch from 0x009321 to 0x015d7e (0xca5e bytes) 000686 1788667100.544534 mapwrite 0x017611 thru 0x019ca7 (0x2697 bytes) 000687 1788667100.632168 mapwrite 0x015a0c thru 0x024a80 (0xf075 bytes) 000688 1788667100.748506 read 0x00c074 thru 0x0171e2 (0xb16f bytes) 000691 1788667100.780987 trunc from 0x032121 to 0x02b515 (0x6c0b bytes) 000692 1788667100.851385 mapread 0x0294b5 thru 0x02b515 (0x2061 bytes) 000693 1788667100.865451 mapread 0x01e995 thru 0x02b515 (0xcb81 bytes) 000694 1788667100.881724 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b516): Mirror 3: 0xb272ff52 (stale) Mirror 4: 0xb272ff52 (stale) Mirror 13: 0xb272ff52 (stale) Mirror 14: 0xb272ff52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b516): Mirror 3: 0xb272ff52 (stale) Mirror 4: 0xb272ff52 (stale) Mirror 13: 0xb272ff52 (stale) Mirror 14: 0xb272ff52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b516: skipped 000695 1788667101.691997 punch from 0x01ada5 to 0x026867 (0xbac3 bytes) 000696 1788667101.699129 trunc from 0x02b516 to 0x006dc9 (0x2474c bytes) 000697 1788667101.737975 mapread 0x004214 thru 0x006dc9 (0x2bb6 bytes) 000701 1788667101.765227 mapread 0x000bda thru 0x006dc9 (0x61f0 bytes) 000702 1788667101.792798 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6dca): Mirror 4: 0x375a1223 (stale) Mirror 13: 0x375a1223 (stale) Mirror 14: 0x375a1223 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6dca): Mirror 4: 0x375a1223 (stale) Mirror 13: 0x375a1223 (stale) Mirror 14: 0x375a1223 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6dca: skipped 000705 1788667102.446912 punch from 0x000d23 to 0x006dc9 (0x60a7 bytes) 000706 1788667102.456511 read 0x003ec2 thru 0x006dc9 (0x2f08 bytes) 000707 1788667102.495124 trunc from 0x006dca to 0x03bd8d (0x34fc4 bytes) 000708 1788667102.538612 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bd8e): Mirror 13: 0x644aa19a (stale) Mirror 14: 0x644aa19a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd8e): Mirror 13: 0x644aa19a (stale) Mirror 14: 0x644aa19a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd8e: skipped 000709 1788667103.294955 read 0x0307d5 thru 0x037e92 (0x76be bytes) 000710 1788667103.326782 mapread 0x02d630 thru 0x0377ed (0xa1be bytes) 000712 1788667103.381337 write 0x0316e3 thru 0x038743 (0x7061 bytes) 000714 1788667103.407507 trunc from 0x03bd8e to 0x000bc6 (0x3b1c7 bytes) 000715 1788667103.448571 write 0x024d23 thru 0x02ec29 (0x9f07 bytes) 000717 1788667103.478496 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ec2a): Mirror 13: 0xa953e243 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ec2a): Mirror 13: 0xa953e243 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ec2a: skipped 000719 1788667104.087792 write 0x01eb44 thru 0x020533 (0x19f0 bytes) 000721 1788667104.139798 MIRROR_RESYNC 2 mirrors 000723 1788667105.266742 mapwrite 0x000184 thru 0x009a61 (0x98de bytes) 000724 1788667105.414830 trunc from 0x02ec2a to 0x02a19d (0x4a8c bytes) 000725 1788667105.448785 mapread 0x023711 thru 0x02a19d (0x6a8d bytes) 000726 1788667105.465709 punch from 0x028856 to 0x02a19d (0x1948 bytes) 000727 1788667105.471526 write 0x032145 thru 0x0338a4 (0x1760 bytes) 000728 1788667105.483036 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x338a5): Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x338a5): Mirror 13: 0xb2ec3e14 (stale) CRC-32 checksum value for chunk [0, 0x338a5): Mirror 1: 0x7891d0d3 Mirror 14: 0x7891d0d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x338a5: skipped 000731 1788667107.007475 read 0x0196ed thru 0x02539b (0xbcaf bytes) 000733 1788667107.042579 write 0x009c63 thru 0x00da4d (0x3deb bytes) 000734 1788667107.123636 read 0x00c6c6 thru 0x00ed8c (0x26c7 bytes) 000736 1788667107.137354 read 0x021b47 thru 0x031709 (0xfbc3 bytes) 000737 1788667107.138629 write 0x030c4f thru 0x0380cb (0x747d bytes) 000738 1788667107.140730 mapwrite 0x02bf75 thru 0x039673 (0xd6ff bytes) 000739 1788667107.278761 write 0x01cc31 thru 0x029e51 (0xd221 bytes) 000741 1788667107.289015 mapread 0x017741 thru 0x023428 (0xbce8 bytes) 000742 1788667107.306690 MIRROR_RESYNC 3 mirrors 000744 1788667109.067626 MIRROR_EXTEND to 4 mirrors 000745 1788667110.376867 read 0x0251c1 thru 0x027ba2 (0x29e2 bytes) 000747 1788667110.386402 trunc from 0x039674 to 0x0156e3 (0x23f90 bytes) 000749 1788667110.576912 mapread 0x013071 thru 0x0156e3 (0x2673 bytes) 000750 1788667110.645501 punch from 0x009e9c to 0x0156e3 (0xb848 bytes) 000751 1788667110.666938 mapwrite 0x033c3b thru 0x035678 (0x1a3e bytes) 000752 1788667110.921644 read 0x004d8e thru 0x008f0c (0x417f bytes) 000753 1788667110.938084 punch from 0x015a13 to 0x0250ac (0xf69a bytes) 000754 1788667110.947734 write 0x02de0b thru 0x038dc6 (0xafbc bytes) 000758 1788667110.964819 write 0x00a043 thru 0x011893 (0x7851 bytes) 000760 1788667110.982249 MIRROR_RESYNC 4 mirrors 000761 1788667112.717781 mapread 0x01420f thru 0x022943 (0xe735 bytes) 000762 1788667112.788644 mapwrite 0x02eb87 thru 0x036f59 (0x83d3 bytes) 000766 1788667113.047009 punch from 0x02d5cc to 0x036cb3 (0x96e8 bytes) 000767 1788667113.070716 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38dc7): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38dc7): Mirror 13: 0xe57a81d6 (stale) Mirror 14: 0xe57a81d6 (stale) Mirror 15: 0xe57a81d6 (stale) CRC-32 checksum value for chunk [0, 0x38dc7): Mirror 1: 0x71e3f503 Mirror 16: 0x71e3f503 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38dc7: skipped 000768 1788667114.612251 mapread 0x00f089 thru 0x018429 (0x93a1 bytes) 000771 1788667114.635655 mapwrite 0x0219b8 thru 0x030846 (0xee8f bytes) 000772 1788667114.972104 read 0x029751 thru 0x031b9f (0x844f bytes) 000774 1788667114.973232 read 0x03333d thru 0x038dc6 (0x5a8a bytes) 000775 1788667114.991177 mapread 0x012e88 thru 0x018d9b (0x5f14 bytes) 000776 1788667114.992431 trunc from 0x038dc7 to 0x02971c (0xf6aa bytes) 000778 1788667115.035546 read 0x015840 thru 0x0226c1 (0xce82 bytes) 000781 1788667115.044223 write 0x03e9f9 thru 0x03ffff (0x1607 bytes) 000782 1788667115.050628 punch from 0x000bdb to 0x010227 (0xf64d bytes) 000783 1788667115.070175 read 0x014172 thru 0x016180 (0x200f bytes) 000784 1788667115.080794 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4fce150f (stale) Mirror 14: 0x4fce150f (stale) Mirror 15: 0x4fce150f (stale) Mirror 16: 0x99fc772 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb4b763fa Mirror 17: 0xb4b763fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000786 1788667116.881381 MIRROR_RESYNC 6 mirrors 000788 1788667118.491508 trunc from 0x040000 to 0x01bc75 (0x2438a bytes) 000789 1788667118.701424 write 0x027ee2 thru 0x034021 (0xc140 bytes) 000790 1788667118.704486 write 0x02005d thru 0x02adf8 (0xad9c bytes) 000791 1788667118.711662 mapwrite 0x028972 thru 0x033f66 (0xb5f5 bytes) 000792 1788667118.842139 trunc from 0x034022 to 0x0266be (0xd963 bytes) 000795 1788667118.892710 read 0x019815 thru 0x01ae62 (0x164e bytes) 000796 1788667118.904900 write 0x014891 thru 0x0238be (0xf02e bytes) 000797 1788667118.917055 read 0x016623 thru 0x0219f8 (0xb3d6 bytes) 000798 1788667118.919588 mapwrite 0x0283e9 thru 0x03098b (0x85a3 bytes) 000799 1788667119.015103 mapread 0x017291 thru 0x021ce3 (0xaa53 bytes) 000803 1788667119.018305 trunc from 0x03098c to 0x010a99 (0x1fef2 bytes) 000804 1788667119.042580 punch from 0x008acf to 0x010a99 (0x7fcb bytes) 000806 1788667119.048222 mapwrite 0x038526 thru 0x03ffff (0x7ada bytes) 000809 1788667119.139621 mapwrite 0x00a45c thru 0x0165bb (0xc160 bytes) 000810 1788667119.265580 read 0x00087f thru 0x00a842 (0x9fc4 bytes) 000811 1788667119.297117 write 0x025622 thru 0x030f42 (0xb921 bytes) 000812 1788667119.301135 punch from 0x0343c8 to 0x03497b (0x5b4 bytes) 000813 1788667119.325394 write 0x03de65 thru 0x03ffff (0x219b bytes) 000815 1788667119.326900 write 0x028572 thru 0x029bec (0x167b bytes) 000817 1788667119.333557 mapread 0x01549a thru 0x024f24 (0xfa8b bytes) 000818 1788667119.334644 trunc from 0x040000 to 0x0290f1 (0x16f0e bytes) 000819 1788667119.380508 read 0x01844a thru 0x01d9ab (0x5562 bytes) 000820 1788667119.381553 read 0x01293d thru 0x01d18e (0xa852 bytes) 000821 1788667119.382537 mapwrite 0x039319 thru 0x03ffff (0x6ce7 bytes) 000822 1788667119.509425 trunc from 0x040000 to 0x0201fc (0x1fe03 bytes) 000823 1788667119.533468 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x201fd): Mirror 14: 0xd7a617f7 (stale) Mirror 15: 0xd7a617f7 (stale) Mirror 16: 0xd7a617f7 (stale) Mirror 17: 0xd7a617f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x201fd): Mirror 14: 0xd7a617f7 (stale) Mirror 15: 0xd7a617f7 (stale) Mirror 16: 0xd7a617f7 (stale) Mirror 17: 0xd7a617f7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x201fd: skipped 000824 1788667119.954519 mapread 0x00cbe0 thru 0x00d2af (0x6d0 bytes) 000825 1788667119.990394 mapread 0x00b1bd thru 0x00e3e1 (0x3225 bytes) 000826 1788667120.003755 write 0x035eea thru 0x03ffff (0xa116 bytes) 000828 1788667120.006523 trunc from 0x040000 to 0x006b62 (0x3949d bytes) 000830 1788667120.032168 read 0x001c00 thru 0x005ad5 (0x3ed6 bytes) 000831 1788667120.047285 write 0x033cf1 thru 0x035c37 (0x1f47 bytes) 000832 1788667120.071170 MIRROR_RESYNC 5 mirrors 000833 1788667121.711787 write 0x03d598 thru 0x03f35f (0x1dc8 bytes) 000834 1788667121.815371 MIRROR_RESYNC 5 mirrors 000835 1788667123.686560 punch from 0x0122ee to 0x01a98c (0x869f bytes) 000836 1788667123.759375 trunc from 0x03f360 to 0x01a2ad (0x250b2 bytes) 000837 1788667123.776195 read 0x010630 thru 0x01a2ad (0x9c7e bytes) 000838 1788667123.786436 mapwrite 0x02822e thru 0x02e01a (0x5ded bytes) 000839 1788667123.891295 trunc from 0x02e01b to 0x028895 (0x5785 bytes) 000840 1788667123.914358 read 0x01b1f5 thru 0x028895 (0xd6a1 bytes) 000842 1788667123.933222 MIRROR_RESYNC 5 mirrors 000844 1788667126.225144 mapwrite 0x026ed6 thru 0x027535 (0x660 bytes) 000845 1788667126.485578 write 0x02b2d1 thru 0x02e448 (0x3178 bytes) 000848 1788667126.506294 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e449): Mirror 15: 0xc2106568 (stale) Mirror 16: 0xc2106568 (stale) Mirror 17: 0xc2106568 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e449): Mirror 15: 0xc2106568 (stale) Mirror 16: 0xc2106568 (stale) Mirror 17: 0xc2106568 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e449: skipped 000849 1788667127.016915 mapwrite 0x01f577 thru 0x02c5be (0xd048 bytes) 000853 1788667127.228239 read 0x00626e thru 0x0142d5 (0xe068 bytes) 000854 1788667127.261425 trunc from 0x02e449 to 0x02d5ee (0xe5a bytes) 000855 1788667127.285660 punch from 0x013d95 to 0x017643 (0x38af bytes) 000860 1788667127.299782 read 0x014e58 thru 0x0246b1 (0xf85a bytes) 000861 1788667127.332071 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d5ef): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d5ef): Mirror 15: 0x9b6a1975 (stale) Mirror 16: 0x9b6a1975 (stale) Mirror 17: 0x9b6a1975 (stale) CRC-32 checksum value for chunk [0, 0x2d5ef): Mirror 1: 0x2b1dcfb9 Mirror 18: 0x2b1dcfb9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d5ef: skipped 000862 1788667128.809109 mapread 0x021b1a thru 0x02bc08 (0xa0ef bytes) 000863 1788667128.842173 punch from 0x01788b to 0x01d4ed (0x5c63 bytes) 000864 1788667129.003042 punch from 0x001e4c to 0x008b2a (0x6cdf bytes) 000865 1788667129.011735 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d5ef): Mirror 15: 0x9b6a1975 (stale) Mirror 16: 0x9b6a1975 (stale) Mirror 18: 0x2b1dcfb9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d5ef): Mirror 15: 0x9b6a1975 (stale) Mirror 16: 0x9b6a1975 (stale) Mirror 18: 0x2b1dcfb9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d5ef: skipped 000866 1788667129.496961 punch from 0x0274d8 to 0x02d5ee (0x6117 bytes) 000867 1788667129.515319 read 0x006ed5 thru 0x01634b (0xf477 bytes) 000868 1788667129.551822 write 0x002caf thru 0x00a25d (0x75af bytes) 000869 1788667129.560490 mapwrite 0x02eca9 thru 0x03423f (0x5597 bytes) 000870 1788667129.801430 trunc from 0x034240 to 0x0041c0 (0x3007f bytes) 000871 1788667129.852656 punch from 0x002a2f to 0x003c40 (0x1212 bytes) 000873 1788667129.884801 mapwrite 0x01d107 thru 0x01db82 (0xa7c bytes) 000874 1788667129.999119 write 0x001c4b thru 0x00a15e (0x8514 bytes) 000875 1788667130.017811 write 0x01ce79 thru 0x02aaef (0xdc77 bytes) 000876 1788667130.019538 trunc from 0x02aaf0 to 0x02263f (0x84b0 bytes) 000879 1788667130.040536 write 0x01d8cb thru 0x0290a4 (0xb7da bytes) 000880 1788667130.047991 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x290a5): Mirror 15: 0x1f95f70d (stale) Mirror 18: 0x5382525a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x290a5): Mirror 15: 0x1f95f70d (stale) Mirror 18: 0x5382525a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x290a5: skipped 000882 1788667130.567139 mapread 0x01aeac thru 0x01b321 (0x476 bytes) 000883 1788667130.582601 punch from 0x01e591 to 0x023e83 (0x58f3 bytes) 000884 1788667130.608505 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x290a5): Mirror 15: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x290a5): Mirror 15: 0x1f95f70d (stale) Mirror 18: 0x5382525a (stale) CRC-32 checksum value for chunk [0, 0x290a5): Mirror 1: 0x4c75128c Mirror 19: 0x4c75128c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x290a5: skipped 000885 1788667131.956041 mapread 0x02259a thru 0x0235ab (0x1012 bytes) 000886 1788667131.968554 punch from 0x015c2f to 0x01b216 (0x55e8 bytes) 000887 1788667132.071235 read 0x01ce05 thru 0x01ea29 (0x1c25 bytes) 000888 1788667132.081752 trunc from 0x0290a5 to 0x00ffc3 (0x190e1 bytes) 000889 1788667132.125209 trunc from 0x00ffc4 to 0x01b72c (0xb769 bytes) 000890 1788667132.178255 mapwrite 0x021885 thru 0x025f39 (0x46b5 bytes) 000891 1788667132.302437 trunc from 0x025f3a to 0x00ec6e (0x172cb bytes) 000892 1788667132.345935 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xec6f): Mirror 15: 0x1a5c0261 (stale) Mirror 18: 0x1a5c0261 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xec6f): Mirror 15: 0x1a5c0261 (stale) Mirror 18: 0x1a5c0261 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xec6f: skipped 000893 1788667132.774256 punch from 0x00a742 to 0x00b3c4 (0xc83 bytes) 000895 1788667132.781128 write 0x019a64 thru 0x0224d1 (0x8a6e bytes) 000896 1788667132.783596 punch from 0x004d71 to 0x013a68 (0xecf8 bytes) 000899 1788667132.801070 write 0x01621d thru 0x019c87 (0x3a6b bytes) 000900 1788667132.811764 punch from 0x001380 to 0x004d45 (0x39c6 bytes) 000903 1788667132.826213 trunc from 0x0224d2 to 0x020968 (0x1b69 bytes) 000904 1788667132.876477 write 0x032f32 thru 0x03696e (0x3a3d bytes) 000907 1788667132.885805 mapread 0x02687e thru 0x0276f5 (0xe78 bytes) 000908 1788667132.897826 punch from 0x0207fe to 0x02919e (0x89a1 bytes) 000909 1788667132.916404 trunc from 0x03696f to 0x02b9af (0xafbf bytes) 000910 1788667132.940702 read 0x002ac3 thru 0x009c13 (0x7151 bytes) 000911 1788667132.971827 MIRROR_RESYNC 3 mirrors 000912 1788667133.959526 read 0x0090c8 thru 0x00ff81 (0x6eba bytes) 000914 1788667133.972532 mapwrite 0x016d3d thru 0x01a1c2 (0x3486 bytes) 000915 1788667134.230508 trunc from 0x02b9b0 to 0x023069 (0x8946 bytes) 000916 1788667134.251166 write 0x02b0fb thru 0x03137c (0x6282 bytes) 000917 1788667134.252329 read 0x002a21 thru 0x0121bb (0xf79b bytes) 000918 1788667134.268086 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3137d): Mirror 15: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3137d): Mirror 15: 0xdb83a0e3 (stale) Mirror 18: 0xdb83a0e3 (stale) CRC-32 checksum value for chunk [0, 0x3137d): Mirror 1: 0x603fa7d9 Mirror 19: 0x603fa7d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3137d: skipped 000920 1788667135.377544 write 0x0312ec thru 0x03ffff (0xed14 bytes) 000921 1788667135.479871 read 0x02fb63 thru 0x031baf (0x204d bytes) 000922 1788667135.485826 trunc from 0x040000 to 0x02463e (0x1b9c1 bytes) 000923 1788667135.544570 mapread 0x023d71 thru 0x02463e (0x8ce bytes) 000924 1788667135.555809 write 0x002f94 thru 0x00e1c3 (0xb230 bytes) 000925 1788667135.566986 write 0x00d1b0 thru 0x014156 (0x6fa7 bytes) 000926 1788667135.572673 mapwrite 0x015d11 thru 0x022c5b (0xcf4b bytes) 000927 1788667135.664774 punch from 0x01848e to 0x02267c (0xa1ef bytes) 000929 1788667135.670469 punch from 0x01735f to 0x01e10e (0x6db0 bytes) 000930 1788667135.675303 mapread 0x019e53 thru 0x01a3d7 (0x585 bytes) 000931 1788667135.692083 punch from 0x01f695 to 0x02463e (0x4faa bytes) 000932 1788667135.696675 mapwrite 0x02fc6b thru 0x032e10 (0x31a6 bytes) 000933 1788667135.782765 mapwrite 0x03f91a thru 0x03ffff (0x6e6 bytes) 000937 1788667135.889471 punch from 0x02f714 to 0x02f902 (0x1ef bytes) 000940 1788667135.896459 write 0x02ceb2 thru 0x030ff4 (0x4143 bytes) 000941 1788667135.902215 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xc096313e (stale) Mirror 18: 0xc096313e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xc096313e (stale) Mirror 18: 0xc096313e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000944 1788667136.294729 mapread 0x027419 thru 0x02a29f (0x2e87 bytes) 000945 1788667136.328800 punch from 0x02c103 to 0x03393f (0x783d bytes) 000946 1788667136.333729 mapwrite 0x038ae2 thru 0x03ffff (0x751e bytes) 000947 1788667136.412509 punch from 0x012340 to 0x01c564 (0xa225 bytes) 000948 1788667136.423312 MIRROR_RESYNC 3 mirrors 000949 1788667137.503026 read 0x019c79 thru 0x01bd00 (0x2088 bytes) 000950 1788667137.507310 write 0x01b064 thru 0x0270cf (0xc06c bytes) 000951 1788667137.622727 mapwrite 0x037037 thru 0x03b302 (0x42cc bytes) 000954 1788667137.709869 mapread 0x015c1c thru 0x01e1df (0x85c4 bytes) 000955 1788667137.753740 MIRROR_RESYNC 3 mirrors 000957 1788667138.600517 read 0x022d00 thru 0x02a18e (0x748f bytes) 000958 1788667138.610538 read 0x031168 thru 0x03cd88 (0xbc21 bytes) 000959 1788667138.623419 mapwrite 0x0128fb thru 0x020f9e (0xe6a4 bytes) 000960 1788667138.961098 punch from 0x022150 to 0x023bdd (0x1a8e bytes) 000961 1788667138.968356 read 0x00b42e thru 0x01865f (0xd232 bytes) 000964 1788667138.994616 write 0x02a07f thru 0x02ae71 (0xdf3 bytes) 000965 1788667139.002777 MIRROR_RESYNC 3 mirrors 000966 1788667139.940619 punch from 0x0244ed to 0x02f8d6 (0xb3ea bytes) 000969 1788667140.007965 write 0x01b781 thru 0x029185 (0xda05 bytes) 000972 1788667140.024342 read 0x0344a9 thru 0x03ffff (0xbb57 bytes) 000974 1788667140.038832 trunc from 0x040000 to 0x0380f1 (0x7f0e bytes) 000975 1788667140.061148 trunc from 0x0380f2 to 0x020446 (0x17cab bytes) 000976 1788667140.082046 punch from 0x018718 to 0x020446 (0x7d2f bytes) 000978 1788667140.096440 mapwrite 0x036a15 thru 0x0383cb (0x19b7 bytes) 000979 1788667140.199797 write 0x021948 thru 0x02e4f2 (0xcbab bytes) 000980 1788667140.220576 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x383cc): Mirror 18: 0xf05cd95c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x383cc): Mirror 18: 0xf05cd95c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x383cc: skipped 000981 1788667140.581916 mapwrite 0x0352be thru 0x03ffff (0xad42 bytes) 000983 1788667140.657659 mapwrite 0x006712 thru 0x014444 (0xdd33 bytes) 000985 1788667140.725459 mapread 0x03d3e1 thru 0x03ea12 (0x1632 bytes) 000986 1788667140.730797 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x198:0x0]: Invalid argument (22) 000987 1788667140.891536 write 0x00ebc1 thru 0x01d3cb (0xe80b bytes) 000989 1788667140.908630 mapwrite 0x02ad3f thru 0x032b48 (0x7e0a bytes) 000991 1788667141.016492 write 0x039421 thru 0x03d140 (0x3d20 bytes) 000992 1788667141.035804 mapwrite 0x0395ff thru 0x03ffff (0x6a01 bytes) 000993 1788667141.174292 read 0x00f65c thru 0x01395f (0x4304 bytes) 000995 1788667141.175301 write 0x03b15b thru 0x03ffff (0x4ea5 bytes) 000996 1788667141.178148 mapwrite 0x011b7a thru 0x0174e3 (0x596a bytes) 000997 1788667141.361623 read 0x032de0 thru 0x0337bb (0x9dc bytes) 000998 1788667141.364859 mapwrite 0x03755d thru 0x03d1d4 (0x5c78 bytes) 000999 1788667141.488639 punch from 0x0022af to 0x00abfa (0x894c bytes) 001000 1788667141.494540 mapwrite 0x02d9d7 thru 0x03337c (0x59a6 bytes) All operations completed A-OK!