== sanity-flr test 70a: flr mode fsx test ================ 10:27:50 (1789136870) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 6872 000001 1789136872.338302 MIRROR_EXTEND to 2 mirrors skipping zero length zero range 000003 1789136872.735204 mapwrite 0x02063b thru 0x026f43 (0x6909 bytes) 000004 1789136872.882508 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x26f44): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26f44): Mirror 2: 0x52c367e1 (stale) CRC-32 checksum value for chunk [0, 0x26f44): Mirror 1: 0xd654b783 Mirror 3: 0xd654b783 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26f44: skipped truncating to largest ever: 0x35de6 000005 1789136873.741309 trunc from 0x026f44 to 0x035de5 (0xeea2 bytes) 000006 1789136873.805431 read 0x00233a thru 0x00d160 (0xae27 bytes) 000007 1789136873.817238 mapread 0x004151 thru 0x011ebb (0xdd6b bytes) 000008 1789136873.853428 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35de6): Mirror 2: 0xe0232a13 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35de6): Mirror 2: 0xe0232a13 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35de6: skipped 000009 1789136874.194115 mapwrite 0x01ae75 thru 0x020fe1 (0x616d bytes) 000010 1789136874.273357 mapread 0x0035db thru 0x00ab08 (0x752e bytes) 000011 1789136874.281989 punch from 0x024ee1 to 0x02db92 (0x8cb2 bytes) 000013 1789136874.288333 read 0x002544 thru 0x009ea4 (0x7961 bytes) 000014 1789136874.291209 read 0x00a2c3 thru 0x0138fe (0x963c bytes) 000015 1789136874.311138 fallocate 0x02b7d8 thru 0x02dca0 (0x24c9 bytes) 000016 1789136874.321295 MIRROR_RESYNC 2 mirrors 000017 1789136874.885276 trunc from 0x003cf3 to 0x00b14c (0x745a bytes) 000019 1789136874.953363 read 0x024f6f thru 0x034207 (0xf299 bytes) 000020 1789136874.974452 MIRROR_RESYNC 2 mirrors 000021 1789136875.663208 trunc from 0x02c773 to 0x033cd5 (0x7563 bytes) 000022 1789136875.699460 read 0x027a55 thru 0x029531 (0x1add bytes) 000023 1789136875.706630 mapread 0x03272a thru 0x0335a6 (0xe7d bytes) 000024 1789136875.716375 fallocate 0x01f6b2 thru 0x023fb2 (0x4901 bytes) fallocating to largest ever: 0x36616 000025 1789136875.722144 fallocate 0x033c68 thru 0x036615 (0x29ae bytes) 000026 1789136875.727409 read 0x011088 thru 0x011b07 (0xa80 bytes) 000027 1789136875.736696 trunc from 0x02f179 to 0x035de5 (0x6c6d bytes) 000028 1789136875.741151 punch from 0x033116 to 0x035de5 (0x2cd0 bytes) 000029 1789136875.748955 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35de6): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35de6): Mirror 2: 0xf61978bc (stale) CRC-32 checksum value for chunk [0, 0x35de6): Mirror 1: 0xf61978bc Mirror 3: 0xf61978bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35de6: skipped 000030 1789136876.738362 punch from 0x000414 to 0x00ef9c (0xeb89 bytes) 000031 1789136876.809168 write 0x030cef thru 0x03a18f (0x94a1 bytes) 000032 1789136876.821362 read 0x01a03f thru 0x01b727 (0x16e9 bytes) 000033 1789136876.828280 punch from 0x01a3d3 to 0x01c739 (0x2367 bytes) 000034 1789136876.837019 mapread 0x033f81 thru 0x03a18f (0x620f bytes) 000035 1789136876.838522 punch from 0x00250a to 0x010bb7 (0xe6ae bytes) 000036 1789136876.844307 trunc from 0x03a190 to 0x01ce61 (0x1d32e bytes) 000037 1789136876.878275 fallocate 0x01b6e1 thru 0x02a30c (0xec2c bytes) 000038 1789136876.885485 fallocate 0x001b0b thru 0x002bb2 (0x10a8 bytes) 000039 1789136876.894002 read 0x00df3b thru 0x01ce61 (0xef27 bytes) 000040 1789136876.909252 read 0x010b46 thru 0x01c9b0 (0xbe6b bytes) fallocating to largest ever: 0x40000 000041 1789136876.910534 fallocate 0x034107 thru 0x03ffff (0xbef9 bytes) 000042 1789136876.916396 punch from 0x026e2e to 0x0289d9 (0x1bac bytes) 000043 1789136876.921888 punch from 0x02f8d4 to 0x03043f (0xb6c bytes) 000044 1789136876.926643 mapwrite 0x03a983 thru 0x03ffff (0x567d bytes) 000046 1789136876.996239 mapread 0x0040b4 thru 0x005f09 (0x1e56 bytes) 000047 1789136876.999041 read 0x02fb32 thru 0x03b2d9 (0xb7a8 bytes) 000048 1789136877.001552 trunc from 0x02e844 to 0x03cd3e (0xe4fb bytes) 000049 1789136877.006926 fallocate 0x03ca14 thru 0x03ffff (0x35ec bytes) 000050 1789136877.011749 read 0x00ec5d thru 0x016451 (0x77f5 bytes) 000051 1789136877.015841 write 0x009ffc thru 0x013314 (0x9319 bytes) 000052 1789136877.018882 trunc from 0x03e682 to 0x03ffff (0x197e bytes) 000053 1789136877.026938 mapread 0x03dfa0 thru 0x03f286 (0x12e7 bytes) 000054 1789136877.045850 trunc from 0x040000 to 0x000bcb (0x3f434 bytes) 000055 1789136877.068176 mapread 0x00081c thru 0x000bcb (0x3b0 bytes) 000056 1789136877.074973 punch from 0x000225 to 0x000bcb (0x9a7 bytes) 000057 1789136877.079376 read 0x000a7f thru 0x000bcb (0x14d bytes) 000058 1789136877.092354 trunc from 0x000bcc to 0x0039bd (0x2df2 bytes) 000059 1789136877.107465 trunc from 0x0002a1 to 0x0039bd (0x371d bytes) 000060 1789136877.112771 punch from 0x00284c to 0x0039bd (0x1172 bytes) 000061 1789136877.124115 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39be): Mirror 3: 0xfdcabb49 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39be): Mirror 3: 0xfdcabb49 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39be: skipped 000062 1789136877.430183 trunc from 0x000f98 to 0x0039bd (0x2a26 bytes) 000063 1789136877.435328 read 0x00295f thru 0x0039bd (0x105f bytes) 000064 1789136877.441197 mapread 0x00159c thru 0x0039bd (0x2422 bytes) 000065 1789136877.454121 write 0x02697f thru 0x0277fe (0xe80 bytes) 000067 1789136877.466324 mapwrite 0x02d369 thru 0x030ff3 (0x3c8b bytes) 000068 1789136877.539891 mapwrite 0x005818 thru 0x013a64 (0xe24d bytes) 000069 1789136877.586998 mapwrite 0x01ff1a thru 0x02382f (0x3916 bytes) 000070 1789136877.630550 fallocate 0x02f2b8 thru 0x03d10d (0xde56 bytes) 000071 1789136877.640413 read 0x0169b5 thru 0x01d1e6 (0x6832 bytes) 000072 1789136877.641043 fallocate 0x02dddf thru 0x03056e (0x2790 bytes) 000073 1789136877.659063 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000074 1789136877.825465 punch from 0x001a2e to 0x00dbef (0xc1c2 bytes) 000075 1789136877.833400 trunc from 0x03d10e to 0x002d18 (0x3a3f5 bytes) 000077 1789136877.882569 trunc from 0x00159b to 0x002d18 (0x177e bytes) 000078 1789136877.895088 trunc from 0x000517 to 0x002d18 (0x2802 bytes) 000079 1789136877.904765 punch from 0x00005f to 0x002d18 (0x2cba bytes) 000080 1789136877.911450 punch from 0x001f40 to 0x002d18 (0xdd9 bytes) 000081 1789136877.936062 MIRROR_EXTEND to 2 mirrors 000082 1789136878.562515 mapread 0x0029b2 thru 0x002d18 (0x367 bytes) 000084 1789136878.576406 write 0x017f3b thru 0x019bfa (0x1cc0 bytes) 000085 1789136878.633815 mapread 0x001dc4 thru 0x007a2f (0x5c6c bytes) 000086 1789136878.663816 fallocate 0x00e53c thru 0x010e06 (0x28cb bytes) 000087 1789136878.679748 MIRROR_RESYNC 2 mirrors 000088 1789136879.202682 trunc from 0x012694 to 0x019bfa (0x7567 bytes) 000089 1789136879.263204 trunc from 0x019bfb to 0x002907 (0x172f3 bytes) 000092 1789136879.338012 trunc from 0x0011a2 to 0x002907 (0x1766 bytes) 000093 1789136879.343783 mapwrite 0x00b490 thru 0x019001 (0xdb72 bytes) 000094 1789136879.422827 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000095 1789136879.593987 write 0x034d23 thru 0x039005 (0x42e3 bytes) 000096 1789136879.604270 read 0x00b084 thru 0x00e337 (0x32b4 bytes) 000097 1789136879.628220 write 0x001e3f thru 0x006d76 (0x4f38 bytes) 000099 1789136879.647261 read 0x033441 thru 0x0376be (0x427e bytes) 000100 1789136879.660721 write 0x03f189 thru 0x03ffff (0xe77 bytes) 000101 1789136879.663501 mapread 0x0070b3 thru 0x01517c (0xe0ca bytes) 000102 1789136879.665820 read 0x00aae2 thru 0x00e47f (0x399e bytes) 000103 1789136879.667067 trunc from 0x040000 to 0x00f736 (0x308c9 bytes) 000104 1789136879.702094 mapwrite 0x009539 thru 0x00b424 (0x1eec bytes) 000105 1789136879.730780 read 0x006f23 thru 0x00f736 (0x8814 bytes) 000106 1789136879.733442 mapwrite 0x038438 thru 0x03fa0d (0x75d6 bytes) 000107 1789136879.808002 write 0x0057e4 thru 0x014c58 (0xf475 bytes) 000108 1789136879.809712 read 0x01d4a9 thru 0x01fbb3 (0x270b bytes) 000109 1789136879.813359 fallocate 0x00b337 thru 0x01ac45 (0xf90f bytes) 000110 1789136879.822526 trunc from 0x0089b9 to 0x012c73 (0xa2bb bytes) 000111 1789136879.848368 write 0x00b22b thru 0x00f8bf (0x4695 bytes) 000112 1789136879.882450 write 0x02642c thru 0x0301fa (0x9dcf bytes) 000113 1789136879.883900 trunc from 0x03fa0e to 0x005a4e (0x39fbf bytes) 000114 1789136879.898781 write 0x0390c6 thru 0x03ffff (0x6f3a bytes) 000116 1789136879.903328 mapread 0x035b0e thru 0x0382a7 (0x279a bytes) 000118 1789136879.926541 trunc from 0x0139e7 to 0x0163d7 (0x29f1 bytes) 000119 1789136879.934318 mapread 0x02fb46 thru 0x034db0 (0x526b bytes) 000120 1789136879.968114 write 0x016014 thru 0x025a3c (0xfa29 bytes) 000121 1789136880.004411 mapwrite 0x014ebf thru 0x01b792 (0x68d4 bytes) 000123 1789136880.065396 mapread 0x035efa thru 0x03d3c5 (0x74cc bytes) 000124 1789136880.066542 trunc from 0x040000 to 0x031878 (0xe787 bytes) 000125 1789136880.096841 punch from 0x008dec to 0x010084 (0x7299 bytes) 000126 1789136880.104313 write 0x034f5b thru 0x03cf6e (0x8014 bytes) 000127 1789136880.106707 read 0x0192db thru 0x0269d8 (0xd6fe bytes) 000128 1789136880.120440 write 0x003cd6 thru 0x0072dd (0x3608 bytes) 000129 1789136880.122262 trunc from 0x00576f to 0x01406a (0xe8fc bytes) 000130 1789136880.156375 MIRROR_EXTEND to 2 mirrors 000132 1789136880.865932 read 0x01f8e3 thru 0x02588c (0x5faa bytes) 000133 1789136880.877851 fallocate 0x01e772 thru 0x02e015 (0xf8a4 bytes) 000134 1789136880.924025 write 0x019902 thru 0x025194 (0xb893 bytes) 000135 1789136880.947399 trunc from 0x005842 to 0x012719 (0xced8 bytes) 000136 1789136880.954447 mapread 0x01711a thru 0x01c1bf (0x50a6 bytes) 000137 1789136880.965047 mapread 0x037151 thru 0x039f99 (0x2e49 bytes) 000138 1789136880.977950 write 0x003d1d thru 0x011d85 (0xe069 bytes) 000139 1789136880.987196 mapwrite 0x02bd5a thru 0x02c1ec (0x493 bytes) 000140 1789136881.023376 mapread 0x00b07a thru 0x00c2e7 (0x126e bytes) 000142 1789136881.025103 read 0x012b8f thru 0x017c5b (0x50cd bytes) 000143 1789136881.036302 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000144 1789136881.191887 write 0x011011 thru 0x01b7b9 (0xa7a9 bytes) 000146 1789136881.215247 punch from 0x01a6a7 to 0x024415 (0x9d6f bytes) 000147 1789136881.239332 trunc from 0x03cf6f to 0x03d86e (0x900 bytes) 000148 1789136881.288363 fallocate 0x035f53 thru 0x03f1d8 (0x9286 bytes) 000150 1789136881.295295 write 0x03b315 thru 0x03eab1 (0x379d bytes) 000151 1789136881.304164 trunc from 0x03f1d9 to 0x01428b (0x2af4d bytes) 000152 1789136881.329509 fallocate 0x024867 thru 0x026d6d (0x2507 bytes) 000155 1789136881.337766 punch from 0x017505 to 0x01c928 (0x5424 bytes) 000157 1789136881.343897 write 0x02724a thru 0x03718a (0xff41 bytes) 000158 1789136881.350253 read 0x02802a thru 0x0365ef (0xe5c6 bytes) 000159 1789136881.351199 punch from 0x01a959 to 0x01ecba (0x4362 bytes) 000160 1789136881.360379 fallocate 0x0084ef thru 0x00e123 (0x5c35 bytes) 000161 1789136881.367417 trunc from 0x01e675 to 0x01e71a (0xa6 bytes) 000162 1789136881.378981 mapread 0x01d71d thru 0x025cd6 (0x85ba bytes) 000164 1789136881.432740 mapwrite 0x008457 thru 0x00a547 (0x20f1 bytes) 000166 1789136881.477947 write 0x000dfc thru 0x00e5b8 (0xd7bd bytes) 000167 1789136881.487030 read 0x02774f thru 0x035c3c (0xe4ee bytes) 000168 1789136881.490382 mapwrite 0x00ba65 thru 0x00d124 (0x16c0 bytes) 000169 1789136881.508987 fallocate 0x0226df thru 0x02bd9d (0x96bf bytes) 000171 1789136881.518095 write 0x039882 thru 0x03ffff (0x677e bytes) 000173 1789136881.521098 trunc from 0x0225af to 0x02ef9c (0xc9ee bytes) 000176 1789136881.527490 trunc from 0x027710 to 0x02ea18 (0x7309 bytes) 000177 1789136881.534075 fallocate 0x00632b thru 0x012a2f (0xc705 bytes) 000179 1789136881.541402 fallocate 0x0125fe thru 0x01592c (0x332f bytes) 000180 1789136881.546972 mapread 0x019609 thru 0x019b95 (0x58d bytes) 000181 1789136881.549312 write 0x014740 thru 0x01dfde (0x989f bytes) 000183 1789136881.558064 fallocate 0x01ec35 thru 0x02da31 (0xedfd bytes) 000184 1789136881.571583 mapwrite 0x03be90 thru 0x03ffff (0x4170 bytes) 000185 1789136881.603176 fallocate 0x0122b8 thru 0x01ba0c (0x9755 bytes) 000186 1789136881.607093 read 0x005c85 thru 0x0079ab (0x1d27 bytes) 000187 1789136881.608453 mapread 0x007b51 thru 0x00d0ff (0x55af bytes) 000188 1789136881.609320 mapwrite 0x025b22 thru 0x02f4ab (0x998a bytes) 000189 1789136881.634250 mapread 0x0214d8 thru 0x029557 (0x8080 bytes) 000191 1789136881.636639 trunc from 0x040000 to 0x03926e (0x6d91 bytes) 000192 1789136881.663392 mapwrite 0x002799 thru 0x00a633 (0x7e9b bytes) 000193 1789136881.683827 fallocate 0x02b35b thru 0x030271 (0x4f17 bytes) 000195 1789136881.701242 write 0x03d54c thru 0x03e21c (0xcd1 bytes) 000197 1789136881.707173 trunc from 0x03e21d to 0x01f6e0 (0x1eb3c bytes) 000198 1789136881.740372 punch from 0x0050b0 to 0x011b0f (0xca60 bytes) 000200 1789136881.748647 read 0x01d5c4 thru 0x01f6e0 (0x211d bytes) 000201 1789136881.749179 punch from 0x003712 to 0x0126b2 (0xefa1 bytes) 000202 1789136881.760409 MIRROR_EXTEND to 2 mirrors 000203 1789136882.555953 trunc from 0x01163b to 0x01a4d2 (0x8e98 bytes) 000204 1789136882.602319 mapread 0x011be0 thru 0x01384a (0x1c6b bytes) 000206 1789136882.639790 mapread 0x016fa6 thru 0x018ebc (0x1f17 bytes) 000207 1789136882.640760 fallocate 0x002ab1 thru 0x006a5a (0x3faa bytes) 000208 1789136882.645524 mapwrite 0x015990 thru 0x01c961 (0x6fd2 bytes) 000209 1789136882.667343 punch from 0x012eba to 0x016552 (0x3699 bytes) 000210 1789136882.671816 trunc from 0x013a41 to 0x0169f0 (0x2fb0 bytes) 000211 1789136882.677339 trunc from 0x012237 to 0x0143c3 (0x218d bytes) 000212 1789136882.689098 write 0x0262ef thru 0x02b40e (0x5120 bytes) 000213 1789136882.697058 trunc from 0x017a83 to 0x01f60d (0x7b8b bytes) 000215 1789136882.704223 mapread 0x01f601 thru 0x02b40e (0xbe0e bytes) 000217 1789136882.733490 write 0x004427 thru 0x00d8d8 (0x94b2 bytes) 000218 1789136882.739512 fallocate 0x0010cd thru 0x00b008 (0x9f3c bytes) 000220 1789136882.746311 mapread 0x009f9d thru 0x0137e3 (0x9847 bytes) 000221 1789136882.769878 trunc from 0x02b40f to 0x01e02c (0xd3e2 bytes) 000223 1789136882.807749 fallocate 0x01d42a thru 0x026115 (0x8cec bytes) 000225 1789136882.814875 mapwrite 0x012e79 thru 0x01c9f7 (0x9b7f bytes) 000226 1789136882.844776 trunc from 0x00c5ee to 0x012fbb (0x69ce bytes) 000227 1789136882.854137 mapwrite 0x03eea1 thru 0x03ffff (0x115f bytes) 000228 1789136882.887634 mapread 0x02d270 thru 0x035c41 (0x89d2 bytes) 000229 1789136882.901358 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4da8c9ca (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x111f6998 Mirror 3: 0x111f6998 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000230 1789136883.819264 trunc from 0x01ef8e to 0x028b67 (0x9bda bytes) 000231 1789136883.868519 read 0x0199f7 thru 0x028007 (0xe611 bytes) 000232 1789136883.882040 write 0x028d9d thru 0x02b9da (0x2c3e bytes) 000233 1789136883.897232 trunc from 0x040000 to 0x03eab0 (0x154f bytes) 000234 1789136883.912033 punch from 0x00f46f to 0x00f8c9 (0x45b bytes) 000235 1789136883.915446 punch from 0x01b85a to 0x028244 (0xc9eb bytes) 000236 1789136883.934342 trunc from 0x016b09 to 0x01f895 (0x8d8d bytes) 000237 1789136883.940169 read 0x002c70 thru 0x004d94 (0x2125 bytes) 000238 1789136883.951299 write 0x00a744 thru 0x01197f (0x723c bytes) 000239 1789136883.953538 punch from 0x0059a8 to 0x0102b3 (0xa90c bytes) 000240 1789136883.965771 punch from 0x02e0b8 to 0x035074 (0x6fbd bytes) 000242 1789136883.971089 write 0x033363 thru 0x03ffff (0xcc9d bytes) 000243 1789136883.981528 MIRROR_RESYNC 3 mirrors 000244 1789136884.942877 fallocate 0x02b8c2 thru 0x0300d4 (0x4813 bytes) 000245 1789136884.975503 write 0x0250b3 thru 0x032e01 (0xdd4f bytes) 000246 1789136884.985439 write 0x03a33a thru 0x03ffff (0x5cc6 bytes) 000247 1789136884.991204 read 0x00d4eb thru 0x011306 (0x3e1c bytes) 000248 1789136885.002566 punch from 0x02782d to 0x03342d (0xbc01 bytes) 000249 1789136885.020523 write 0x018101 thru 0x01e634 (0x6534 bytes) 000250 1789136885.032849 trunc from 0x040000 to 0x0281cf (0x17e30 bytes) 000251 1789136885.052040 fallocate 0x038606 thru 0x03ffff (0x79fa bytes) 000252 1789136885.058086 punch from 0x000b21 to 0x00400f (0x34ef bytes) 000253 1789136885.062014 write 0x02c3c1 thru 0x03be09 (0xfa49 bytes) 000254 1789136885.091385 trunc from 0x0021f1 to 0x00cf3c (0xad4c bytes) 000255 1789136885.100300 read 0x01238f thru 0x01e5d6 (0xc248 bytes) 000256 1789136885.113533 trunc from 0x007d52 to 0x014c0b (0xceba bytes) 000257 1789136885.119833 mapread 0x03a06d thru 0x03ffff (0x5f93 bytes) 000258 1789136885.121011 punch from 0x03fc6c to 0x03ffff (0x394 bytes) 000259 1789136885.125729 write 0x00c285 thru 0x012035 (0x5db1 bytes) 000260 1789136885.137010 trunc from 0x0355b9 to 0x03c38e (0x6dd6 bytes) 000261 1789136885.158354 fallocate 0x02a2cb thru 0x02f125 (0x4e5b bytes) 000262 1789136885.164747 fallocate 0x03d04b thru 0x03ffff (0x2fb5 bytes) 000263 1789136885.176412 trunc from 0x040000 to 0x00905f (0x36fa0 bytes) 000264 1789136885.197819 mapread 0x003377 thru 0x003720 (0x3aa bytes) 000265 1789136885.198749 read 0x006737 thru 0x00905f (0x2929 bytes) 000266 1789136885.207384 trunc from 0x001255 to 0x0029d8 (0x1784 bytes) 000267 1789136885.212232 mapwrite 0x01ea12 thru 0x01f95d (0xf4c bytes) 000268 1789136885.253752 trunc from 0x019a89 to 0x01ced4 (0x344c bytes) 000271 1789136885.264988 trunc from 0x01f95e to 0x0147a3 (0xb1ba bytes) 000272 1789136885.293459 mapwrite 0x021b2d thru 0x02ca67 (0xaf3b bytes) 000273 1789136885.365935 trunc from 0x005503 to 0x00bbcc (0x66ca bytes) 000274 1789136885.375329 read 0x00570c thru 0x00d0a8 (0x799d bytes) 000275 1789136885.392236 trunc from 0x00dfd4 to 0x01cfe2 (0xf00f bytes) 000276 1789136885.398539 fallocate 0x01972f thru 0x023810 (0xa0e2 bytes) 000277 1789136885.407316 mapwrite 0x00d934 thru 0x017285 (0x9952 bytes) 000278 1789136885.504847 mapwrite 0x02ef03 thru 0x039a75 (0xab73 bytes) 000279 1789136885.567999 read 0x01e6db thru 0x023189 (0x4aaf bytes) 000280 1789136885.568901 trunc from 0x023f70 to 0x032c13 (0xeca4 bytes) 000281 1789136885.575355 trunc from 0x039a76 to 0x031bbb (0x7eba bytes) 000282 1789136885.598839 MIRROR_RESYNC 3 mirrors 000283 1789136886.432375 mapwrite 0x015038 thru 0x024b37 (0xfb00 bytes) 000284 1789136886.543116 trunc from 0x0050de to 0x00a24a (0x516d bytes) 000285 1789136886.555361 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31bbc): Mirror 3: 0xf191b581 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31bbc): Mirror 3: 0xf191b581 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31bbc: skipped 000286 1789136886.877338 fallocate 0x01fc6c thru 0x028fc6 (0x935b bytes) 000287 1789136886.886448 write 0x00e2d8 thru 0x01d251 (0xef7a bytes) 000288 1789136886.912201 trunc from 0x00bb48 to 0x00d516 (0x19cf bytes) 000289 1789136886.924413 punch from 0x0249bc to 0x02c936 (0x7f7b bytes) 000290 1789136886.930354 trunc from 0x007e07 to 0x01053a (0x8734 bytes) 000291 1789136886.956748 mapread 0x011211 thru 0x01b407 (0xa1f7 bytes) 000292 1789136886.970098 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31bbc): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31bbc): Mirror 3: 0xf191b581 (stale) CRC-32 checksum value for chunk [0, 0x31bbc): Mirror 1: 0x8b822adf Mirror 4: 0x8b822adf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31bbc: skipped 000293 1789136887.715186 mapwrite 0x004038 thru 0x00ca59 (0x8a22 bytes) 000294 1789136887.841399 trunc from 0x031bbc to 0x030df6 (0xdc5 bytes) 000295 1789136887.860952 trunc from 0x005800 to 0x0127fd (0xcffe bytes) 000296 1789136887.869943 write 0x03c5aa thru 0x03ffff (0x3a56 bytes) 000298 1789136887.871536 trunc from 0x040000 to 0x0160db (0x29f24 bytes) 000299 1789136887.891343 mapwrite 0x0028b6 thru 0x007bea (0x5335 bytes) 000301 1789136887.941765 mapwrite 0x00191e thru 0x0104db (0xebbe bytes) 000303 1789136887.968748 fallocate 0x01bd7e thru 0x020fdb (0x525e bytes) 000304 1789136887.974808 read 0x00d0db thru 0x0160db (0x9001 bytes) 000305 1789136887.990339 trunc from 0x0160dc to 0x002d78 (0x13363 bytes) 000306 1789136888.011870 trunc from 0x002d79 to 0x01f3c8 (0x1c650 bytes) 000307 1789136888.033868 write 0x0210c5 thru 0x02bec7 (0xae03 bytes) 000308 1789136888.035379 mapread 0x025ca4 thru 0x02bec7 (0x6224 bytes) 000309 1789136888.037323 fallocate 0x038eeb thru 0x03ffff (0x7115 bytes) 000310 1789136888.043384 read 0x0333f5 thru 0x03ffff (0xcc0b bytes) 000311 1789136888.062114 mapwrite 0x030f79 thru 0x03c0c5 (0xb14d bytes) 000312 1789136888.087584 mapread 0x03cc8e thru 0x03ffff (0x3372 bytes) 000313 1789136888.092540 write 0x0087bc thru 0x00dc2b (0x5470 bytes) 000314 1789136888.094414 trunc from 0x040000 to 0x0010b8 (0x3ef47 bytes) 000315 1789136888.125864 punch from 0x0005d6 to 0x0010b8 (0xae3 bytes) 000316 1789136888.133189 trunc from 0x0010b9 to 0x030e32 (0x2fd7a bytes) 000317 1789136888.155531 mapread 0x003ae0 thru 0x003b22 (0x43 bytes) 000318 1789136888.166155 MIRROR_RESYNC 3 mirrors 000319 1789136888.803257 fallocate 0x01a228 thru 0x01e820 (0x45f9 bytes) 000320 1789136888.852858 trunc from 0x0008cb to 0x00769a (0x6dd0 bytes) 000321 1789136888.861394 trunc from 0x030e33 to 0x02074c (0x106e6 bytes) 000322 1789136888.929133 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2074d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2074d): Mirror 3: 0x4e82af57 (stale) Mirror 4: 0x4e82af57 (stale) CRC-32 checksum value for chunk [0, 0x2074d): Mirror 1: 0x4e82af57 Mirror 5: 0x4e82af57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2074d: skipped 000324 1789136889.884286 read 0x005a9c thru 0x0128b5 (0xce1a bytes) 000325 1789136889.906913 mapread 0x00623f thru 0x014431 (0xe1f3 bytes) 000326 1789136889.921109 trunc from 0x02074d to 0x02a763 (0xa017 bytes) 000327 1789136890.027128 trunc from 0x022e90 to 0x029630 (0x67a1 bytes) 000328 1789136890.032882 read 0x022f56 thru 0x028bb0 (0x5c5b bytes) 000329 1789136890.045072 read 0x012931 thru 0x02193a (0xf00a bytes) 000330 1789136890.045947 trunc from 0x02a764 to 0x01b711 (0xf052 bytes) 000332 1789136890.074785 fallocate 0x00943c thru 0x00f05c (0x5c21 bytes) 000333 1789136890.080684 trunc from 0x00e699 to 0x0146fe (0x6066 bytes) 000335 1789136890.084741 read 0x00aaf8 thru 0x012ae1 (0x7fea bytes) 000336 1789136890.094322 write 0x038c84 thru 0x03ffff (0x737c bytes) 000337 1789136890.096394 mapwrite 0x01bf5d thru 0x01c878 (0x91c bytes) 000338 1789136890.118891 punch from 0x003357 to 0x00e9a3 (0xb64d bytes) 000339 1789136890.123843 punch from 0x01f1bb to 0x02b672 (0xc4b8 bytes) 000340 1789136890.129063 write 0x01d39b thru 0x028687 (0xb2ed bytes) 000341 1789136890.144981 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000342 1789136890.597654 mapwrite 0x0344fb thru 0x03ffff (0xbb05 bytes) 000344 1789136890.678414 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000345 1789136891.058458 mapwrite 0x0012ae thru 0x0054cb (0x421e bytes) 000346 1789136891.130779 write 0x029e01 thru 0x02d6f0 (0x38f0 bytes) 000348 1789136891.154905 trunc from 0x040000 to 0x00a460 (0x35b9f bytes) 000349 1789136891.173677 write 0x01bf8b thru 0x027254 (0xb2ca bytes) 000350 1789136891.176966 punch from 0x008fef to 0x00df34 (0x4f46 bytes) 000351 1789136891.183109 fallocate 0x02c0c4 thru 0x034c5a (0x8b97 bytes) 000352 1789136891.188140 mapread 0x0149a6 thru 0x01dc0c (0x9267 bytes) 000353 1789136891.196502 trunc from 0x027255 to 0x00be51 (0x1b403 bytes) 000355 1789136891.210453 punch from 0x005e4a to 0x00be51 (0x6008 bytes) 000356 1789136891.216346 punch from 0x005d7f to 0x00be51 (0x60d3 bytes) 000357 1789136891.224278 mapread 0x00bc8a thru 0x00be51 (0x1c8 bytes) 000358 1789136891.236513 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000359 1789136891.431130 punch from 0x002c0e to 0x009dcb (0x71be bytes) 000360 1789136891.435492 fallocate 0x02dfc6 thru 0x037017 (0x9052 bytes) 000361 1789136891.441447 mapwrite 0x011bc9 thru 0x01fad8 (0xdf10 bytes) 000363 1789136891.509080 fallocate 0x0344c5 thru 0x03c224 (0x7d60 bytes) 000364 1789136891.513483 punch from 0x018c21 to 0x01fad8 (0x6eb8 bytes) 000366 1789136891.520053 punch from 0x00f381 to 0x017c19 (0x8899 bytes) 000367 1789136891.525219 write 0x023b4c thru 0x024102 (0x5b7 bytes) 000369 1789136891.528371 mapwrite 0x028254 thru 0x036ec0 (0xec6d bytes) 000370 1789136891.583283 mapwrite 0x02f517 thru 0x038e8c (0x9976 bytes) 000371 1789136891.628351 trunc from 0x01f6c0 to 0x02556c (0x5ead bytes) 000372 1789136891.634090 punch from 0x02be23 to 0x031d86 (0x5f64 bytes) 000373 1789136891.643313 MIRROR_EXTEND to 2 mirrors 000374 1789136892.721209 mapwrite 0x033552 thru 0x03d416 (0x9ec5 bytes) 000375 1789136892.815296 trunc from 0x03d417 to 0x035855 (0x7bc1 bytes) 000376 1789136892.835093 fallocate 0x01f451 thru 0x02012c (0xcdc bytes) 000377 1789136892.839898 trunc from 0x035856 to 0x03b5de (0x5d89 bytes) 000378 1789136892.860004 punch from 0x03b439 to 0x03b5de (0x1a6 bytes) 000379 1789136892.866010 fallocate 0x007d20 thru 0x00c483 (0x4764 bytes) 000380 1789136892.877781 mapread 0x0221e2 thru 0x0236a4 (0x14c3 bytes) 000381 1789136892.895567 trunc from 0x03b5df to 0x035662 (0x5f7c bytes) 000382 1789136892.914963 fallocate 0x0251d2 thru 0x025981 (0x7b0 bytes) 000383 1789136892.921168 write 0x03a20b thru 0x03ffff (0x5df5 bytes) 000384 1789136892.923233 mapwrite 0x032f1c thru 0x03ffff (0xd0e4 bytes) 000385 1789136892.967678 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000386 1789136893.146325 mapwrite 0x03fec2 thru 0x03ffff (0x13e bytes) 000388 1789136893.184715 MIRROR_EXTEND to 2 mirrors 000389 1789136894.130573 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000390 1789136894.272790 fallocate 0x01fcbe thru 0x023ecb (0x420e bytes) 000391 1789136894.290832 trunc from 0x01e49b to 0x026530 (0x8096 bytes) 000393 1789136894.298357 fallocate 0x039256 thru 0x03ffff (0x6daa bytes) 000394 1789136894.304313 write 0x024f96 thru 0x02634f (0x13ba bytes) 000395 1789136894.324571 read 0x02f816 thru 0x03bdd3 (0xc5be bytes) 000396 1789136894.351552 trunc from 0x0017ea to 0x004127 (0x293e bytes) 000397 1789136894.365707 trunc from 0x040000 to 0x00da36 (0x325c9 bytes) 000398 1789136894.384298 fallocate 0x01fea4 thru 0x02b14f (0xb2ac bytes) 000400 1789136894.394098 read 0x00116d thru 0x007eca (0x6d5e bytes) 000402 1789136894.414552 MIRROR_EXTEND to 2 mirrors 000403 1789136895.054141 read 0x023812 thru 0x028973 (0x5162 bytes) 000404 1789136895.072832 write 0x02deca thru 0x03087c (0x29b3 bytes) 000405 1789136895.116305 mapread 0x02a597 thru 0x03087c (0x62e6 bytes) 000406 1789136895.148075 MIRROR_RESYNC 2 mirrors 000407 1789136895.888238 fallocate 0x01c08d thru 0x02558a (0x94fe bytes) 000408 1789136895.950506 mapwrite 0x014151 thru 0x022563 (0xe413 bytes) 000409 1789136896.039536 trunc from 0x013b59 to 0x022978 (0xee20 bytes) 000410 1789136896.045472 mapwrite 0x013db5 thru 0x01cb8c (0x8dd8 bytes) 000411 1789136896.091476 mapwrite 0x0366a1 thru 0x03fd04 (0x9664 bytes) 000412 1789136896.172177 write 0x00cafa thru 0x01a8b9 (0xddc0 bytes) 000413 1789136896.173907 punch from 0x0136cc to 0x01d9b1 (0xa2e6 bytes) 000414 1789136896.190479 punch from 0x01d441 to 0x02bc0e (0xe7ce bytes) 000415 1789136896.196401 mapwrite 0x0007a2 thru 0x0062d9 (0x5b38 bytes) 000416 1789136896.267163 MIRROR_RESYNC 2 mirrors 000418 1789136897.112722 write 0x02b670 thru 0x02e3ea (0x2d7b bytes) 000419 1789136897.189471 read 0x0160d8 thru 0x01fa1a (0x9943 bytes) 000420 1789136897.203330 fallocate 0x0255a4 thru 0x02dd9d (0x87fa bytes) 000421 1789136897.212755 write 0x02853f thru 0x02e192 (0x5c54 bytes) 000422 1789136897.223335 mapwrite 0x0333a5 thru 0x03a601 (0x725d bytes) 000423 1789136897.280792 fallocate 0x011b66 thru 0x01f5cb (0xda66 bytes) 000424 1789136897.289253 punch from 0x01b812 to 0x023ed0 (0x86bf bytes) 000425 1789136897.296322 trunc from 0x03fd05 to 0x0140c5 (0x2bc3f bytes) 000426 1789136897.332633 write 0x029e14 thru 0x034d72 (0xaf5f bytes) 000427 1789136897.336160 trunc from 0x034d73 to 0x00b1ac (0x29bc6 bytes) 000428 1789136897.354404 read 0x000e7c thru 0x009e8f (0x9014 bytes) 000429 1789136897.370690 MIRROR_RESYNC 2 mirrors 000430 1789136898.120507 read 0x00360e thru 0x00701b (0x3a0e bytes) 000431 1789136898.131304 fallocate 0x00bb39 thru 0x00fb3c (0x4004 bytes) 000432 1789136898.200165 write 0x013e78 thru 0x01764d (0x37d6 bytes) 000433 1789136898.212918 MIRROR_RESYNC 2 mirrors 000435 1789136898.969960 punch from 0x00363b to 0x0114f1 (0xdeb7 bytes) 000436 1789136899.018199 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000437 1789136899.146236 fallocate 0x011ce9 thru 0x01adcf (0x90e7 bytes) 000438 1789136899.156040 read 0x007d44 thru 0x008895 (0xb52 bytes) 000439 1789136899.163242 trunc from 0x00eaf2 to 0x01764d (0x8b5c bytes) 000440 1789136899.168383 mapread 0x012f82 thru 0x01764d (0x46cc bytes) 000441 1789136899.186848 trunc from 0x000650 to 0x0052cd (0x4c7e bytes) 000442 1789136899.191792 mapwrite 0x029e0c thru 0x034ce3 (0xaed8 bytes) 000443 1789136899.250376 mapread 0x02cc9b thru 0x02ea8b (0x1df1 bytes) 000444 1789136899.252132 fallocate 0x0018b1 thru 0x00c219 (0xa969 bytes) 000445 1789136899.259987 punch from 0x018fef to 0x01b69f (0x26b1 bytes) 000448 1789136899.269009 fallocate 0x026055 thru 0x0323db (0xc387 bytes) 000449 1789136899.280850 mapwrite 0x02ea96 thru 0x0322b1 (0x381c bytes) 000450 1789136899.324512 MIRROR_EXTEND to 2 mirrors 000451 1789136899.990112 fallocate 0x0053f3 thru 0x008db7 (0x39c5 bytes) 000452 1789136900.047445 punch from 0x014343 to 0x018a33 (0x46f1 bytes) 000453 1789136900.061065 read 0x0288c6 thru 0x030b88 (0x82c3 bytes) 000454 1789136900.080008 fallocate 0x0064a6 thru 0x0141ef (0xdd4a bytes) 000455 1789136900.090050 read 0x00be93 thru 0x011b22 (0x5c90 bytes) 000456 1789136900.104202 trunc from 0x00cbe8 to 0x019046 (0xc45f bytes) 000457 1789136900.118124 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000458 1789136900.267847 read 0x015e18 thru 0x022314 (0xc4fd bytes) 000459 1789136900.278414 fallocate 0x01ab45 thru 0x027327 (0xc7e3 bytes) 000460 1789136900.287763 trunc from 0x034ce4 to 0x0276dc (0xd607 bytes) 000461 1789136900.329672 mapread 0x0129cb thru 0x01b636 (0x8c6c bytes) 000462 1789136900.349814 read 0x00f212 thru 0x01d72b (0xe51a bytes) 000464 1789136900.352032 mapwrite 0x019e93 thru 0x01be7f (0x1fed bytes) 000465 1789136900.366192 punch from 0x015168 to 0x015ab4 (0x94d bytes) 000466 1789136900.370925 mapread 0x00947a thru 0x00febc (0x6a43 bytes) 000467 1789136900.382385 fallocate 0x03e7e1 thru 0x03ffff (0x181f bytes) 000468 1789136900.389399 read 0x017a95 thru 0x01fedf (0x844b bytes) 000469 1789136900.390491 trunc from 0x02be5c to 0x03a47e (0xe623 bytes) 000470 1789136900.395855 mapread 0x004e14 thru 0x00e94c (0x9b39 bytes) 000471 1789136900.397487 trunc from 0x01c695 to 0x025446 (0x8db2 bytes) 000472 1789136900.407422 MIRROR_EXTEND to 2 mirrors 000473 1789136901.172171 mapread 0x0150ab thru 0x01f0d3 (0xa029 bytes) 000474 1789136901.199579 trunc from 0x040000 to 0x0282d2 (0x17d2d bytes) 000475 1789136901.305722 punch from 0x01aeb0 to 0x025c8a (0xaddb bytes) 000476 1789136901.312192 write 0x0315fb thru 0x03ca0c (0xb412 bytes) 000477 1789136901.313906 trunc from 0x00dbd6 to 0x010344 (0x276f bytes) 000478 1789136901.336391 MIRROR_RESYNC 2 mirrors 000479 1789136902.088642 trunc from 0x03ca0d to 0x02013f (0x1c8cd bytes) 000480 1789136902.151394 read 0x007841 thru 0x014551 (0xcd11 bytes) 000481 1789136902.171777 MIRROR_RESYNC 2 mirrors 000482 1789136902.851287 write 0x02ca9a thru 0x0346d3 (0x7c3a bytes) 000483 1789136902.887379 punch from 0x033e3f to 0x0346d3 (0x895 bytes) 000484 1789136902.906161 read 0x01caed thru 0x027b10 (0xb024 bytes) 000485 1789136902.915771 fallocate 0x03ace7 thru 0x03ffff (0x5319 bytes) 000486 1789136902.920861 punch from 0x025e87 to 0x0323d2 (0xc54c bytes) 000487 1789136902.926250 read 0x011616 thru 0x01171b (0x106 bytes) 000488 1789136902.936991 punch from 0x014382 to 0x018627 (0x42a6 bytes) 000489 1789136902.942899 fallocate 0x009daa thru 0x00ed5a (0x4fb1 bytes) 000490 1789136902.947724 mapwrite 0x020208 thru 0x02ed14 (0xeb0d bytes) 000491 1789136902.970872 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000492 1789136903.131700 mapread 0x01fbf1 thru 0x02073e (0xb4e bytes) 000493 1789136903.150052 trunc from 0x00c2bd to 0x00f619 (0x335d bytes) 000494 1789136903.161987 MIRROR_EXTEND to 2 mirrors 000495 1789136903.997482 MIRROR_RESYNC 2 mirrors 000496 1789136904.428143 mapwrite 0x03064c thru 0x03249a (0x1e4f bytes) 000498 1789136904.575940 trunc from 0x0346d4 to 0x03ff3c (0xb869 bytes) 000499 1789136904.625587 write 0x0084a7 thru 0x00a640 (0x219a bytes) 000500 1789136904.646614 write 0x03c889 thru 0x03ffff (0x3777 bytes) 000501 1789136904.666663 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x58ce7b3d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfa49075b Mirror 3: 0xfa49075b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000502 1789136905.804624 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000503 1789136906.119476 trunc from 0x040000 to 0x010dde (0x2f221 bytes) 000504 1789136906.187819 mapread 0x00fc26 thru 0x010dde (0x11b9 bytes) 000505 1789136906.202583 fallocate 0x00a795 thru 0x01a0c7 (0xf933 bytes) 000506 1789136906.210845 trunc from 0x0017cf to 0x0045f7 (0x2e29 bytes) 000507 1789136906.215728 mapread 0x0114e9 thru 0x016444 (0x4f5c bytes) 000508 1789136906.224892 mapwrite 0x02c2c1 thru 0x0313e7 (0x5127 bytes) 000510 1789136906.300091 trunc from 0x0313e8 to 0x0205d9 (0x10e0e bytes) 000511 1789136906.321510 mapread 0x00cf92 thru 0x014c5f (0x7cce bytes) 000512 1789136906.325737 fallocate 0x001870 thru 0x00270a (0xe9b bytes) 000514 1789136906.339325 mapread 0x010e7d thru 0x020028 (0xf1ac bytes) 000515 1789136906.351256 punch from 0x00445f to 0x00640e (0x1fb0 bytes) 000516 1789136906.356107 mapwrite 0x0141b4 thru 0x023f74 (0xfdc1 bytes) 000517 1789136906.423211 fallocate 0x01aeac thru 0x0284a9 (0xd5fe bytes) 000519 1789136906.435897 trunc from 0x023f75 to 0x016d37 (0xd23d bytes) 000520 1789136906.468911 MIRROR_RESYNC 2 mirrors 000521 1789136907.174767 punch from 0x0081a7 to 0x00927a (0x10d4 bytes) 000522 1789136907.215952 write 0x00a54c thru 0x011689 (0x713e bytes) 000523 1789136907.226148 write 0x01af60 thru 0x01cefa (0x1f9b bytes) 000524 1789136907.227584 trunc from 0x01cefb to 0x023822 (0x6928 bytes) 000525 1789136907.268796 punch from 0x0168eb to 0x01fa47 (0x915d bytes) 000526 1789136907.285117 trunc from 0x023823 to 0x001740 (0x220e2 bytes) 000527 1789136907.296979 trunc from 0x000bef to 0x001740 (0xb52 bytes) 000528 1789136907.301379 mapwrite 0x0335d0 thru 0x038c4a (0x567b bytes) 000529 1789136907.376180 write 0x02143d thru 0x027ff9 (0x6bbd bytes) 000530 1789136907.388857 read 0x0305a2 thru 0x038c4a (0x86a9 bytes) 000531 1789136907.390021 write 0x034c47 thru 0x03cbc0 (0x7f7a bytes) 000532 1789136907.393074 trunc from 0x0371b3 to 0x03c9e5 (0x5833 bytes) 000534 1789136907.412078 punch from 0x02013a to 0x02d874 (0xd73b bytes) 000535 1789136907.420866 mapwrite 0x0397e1 thru 0x03ffff (0x681f bytes) 000536 1789136907.513322 mapread 0x0086b7 thru 0x010a2d (0x8377 bytes) 000537 1789136907.530211 fallocate 0x01a156 thru 0x0290fb (0xefa6 bytes) 000538 1789136907.544722 mapread 0x034521 thru 0x03e739 (0xa219 bytes) 000540 1789136907.552229 mapread 0x03fbee thru 0x03ffff (0x412 bytes) 000542 1789136907.565212 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcdf51b4c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdb93d469 Mirror 4: 0xdb93d469 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000543 1789136908.617556 trunc from 0x031fb5 to 0x03e469 (0xc4b5 bytes) 000544 1789136908.667182 trunc from 0x040000 to 0x01c372 (0x23c8d bytes) 000546 1789136908.704413 write 0x02912b thru 0x036637 (0xd50d bytes) 000547 1789136908.707185 write 0x00e841 thru 0x019e56 (0xb616 bytes) 000548 1789136908.719874 fallocate 0x03deda thru 0x03ffff (0x2126 bytes) 000549 1789136908.740218 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36638): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36638): Mirror 3: 0xd8fe532d (stale) Mirror 4: 0x8a5b3219 (stale) CRC-32 checksum value for chunk [0, 0x36638): Mirror 1: 0x6a991afc Mirror 5: 0x6a991afc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36638: skipped 000550 1789136909.865053 trunc from 0x036638 to 0x0265b9 (0x1007e bytes) 000551 1789136909.931090 read 0x017a57 thru 0x023f7c (0xc526 bytes) 000552 1789136909.947200 punch from 0x0235f1 to 0x024f0c (0x191c bytes) 000553 1789136909.951294 fallocate 0x02b39b thru 0x02e1cb (0x2e31 bytes) 000554 1789136909.960070 fallocate 0x03cddf thru 0x03ffff (0x3221 bytes) 000556 1789136909.967944 trunc from 0x0265ba to 0x030dfb (0xa842 bytes) 000558 1789136910.001500 read 0x0127b4 thru 0x01b320 (0x8b6d bytes) 000559 1789136910.011307 punch from 0x00c154 to 0x00cd36 (0xbe3 bytes) 000560 1789136910.022918 fallocate 0x015f55 thru 0x01811a (0x21c6 bytes) 000562 1789136910.035924 mapread 0x003b32 thru 0x00ce78 (0x9347 bytes) 000563 1789136910.053197 trunc from 0x02a787 to 0x030dfb (0x6675 bytes) 000564 1789136910.061970 MIRROR_RESYNC 4 mirrors 000565 1789136911.188908 read 0x000ec5 thru 0x003cf6 (0x2e32 bytes) 000566 1789136911.199994 mapwrite 0x003e27 thru 0x0127b7 (0xe991 bytes) 000567 1789136911.344354 fallocate 0x012d78 thru 0x019f02 (0x718b bytes) 000568 1789136911.350904 punch from 0x008539 to 0x00b260 (0x2d28 bytes) 000569 1789136911.357855 trunc from 0x002ead to 0x004079 (0x11cd bytes) 000570 1789136911.364791 mapwrite 0x0234e3 thru 0x02e05a (0xab78 bytes) 000571 1789136911.411277 write 0x03d069 thru 0x03deea (0xe82 bytes) 000572 1789136911.413736 trunc from 0x03deeb to 0x01e004 (0x1fee6 bytes) 000573 1789136911.455880 read 0x005d5d thru 0x00686e (0xb12 bytes) 000574 1789136911.458145 write 0x03ee4d thru 0x03ffff (0x11b3 bytes) 000575 1789136911.459893 mapread 0x00ec80 thru 0x017b88 (0x8f09 bytes) 000576 1789136911.462420 trunc from 0x036fe4 to 0x03ffff (0x901c bytes) 000577 1789136911.476399 write 0x031e3d thru 0x03660a (0x47ce bytes) 000578 1789136911.505274 MIRROR_RESYNC 4 mirrors 000579 1789136913.209682 punch from 0x01d97d to 0x02b5a3 (0xdc27 bytes) 000580 1789136913.268349 read 0x02f16e thru 0x033422 (0x42b5 bytes) 000582 1789136913.290978 trunc from 0x0223a4 to 0x02cc31 (0xa88e bytes) 000583 1789136913.297249 read 0x006c1c thru 0x015631 (0xea16 bytes) 000584 1789136913.314456 trunc from 0x040000 to 0x000997 (0x3f668 bytes) 000585 1789136913.345896 fallocate 0x0278fe thru 0x0320ac (0xa7af bytes) 000586 1789136913.358409 fallocate 0x005e71 thru 0x00ce07 (0x6f97 bytes) 000587 1789136913.366811 write 0x00cc82 thru 0x00fb8d (0x2f0c bytes) 000589 1789136913.378040 trunc from 0x027185 to 0x0320ac (0xaf28 bytes) 000590 1789136913.383358 mapread 0x003c3c thru 0x00cc00 (0x8fc5 bytes) 000592 1789136913.429234 trunc from 0x0320ad to 0x031af2 (0x5ba bytes) 000593 1789136913.445026 write 0x012629 thru 0x01d2a0 (0xac78 bytes) 000595 1789136913.463160 punch from 0x0315ed to 0x031af2 (0x506 bytes) 000596 1789136913.473141 read 0x02c4df thru 0x031af2 (0x5614 bytes) 000597 1789136913.487278 fallocate 0x002f1d thru 0x0108b5 (0xd999 bytes) 000598 1789136913.495322 mapwrite 0x038c53 thru 0x03ffff (0x73ad bytes) 000599 1789136913.594219 read 0x01a92c thru 0x0202ce (0x59a3 bytes) 000600 1789136913.594837 fallocate 0x0357ab thru 0x0385de (0x2e34 bytes) 000602 1789136913.616519 mapread 0x025451 thru 0x0315d5 (0xc185 bytes) 000603 1789136913.617409 fallocate 0x03c4c2 thru 0x03ffff (0x3b3e bytes) 000604 1789136913.631298 read 0x03a9b4 thru 0x03ffff (0x564c bytes) 000605 1789136913.639010 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x91bc9b0 (stale) Mirror 5: 0x91bc9b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x91bc9b0 (stale) Mirror 5: 0x91bc9b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000606 1789136914.010947 mapread 0x01ce00 thru 0x021d22 (0x4f23 bytes) 000607 1789136914.042175 write 0x0034a6 thru 0x010e1f (0xd97a bytes) 000608 1789136914.089719 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x91bc9b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x91bc9b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000609 1789136914.435691 fallocate 0x015157 thru 0x021000 (0xbeaa bytes) 000610 1789136914.445989 trunc from 0x006bdc to 0x0084fd (0x1922 bytes) 000611 1789136914.456546 mapwrite 0x026eeb thru 0x029772 (0x2888 bytes) 000613 1789136914.504845 write 0x00297b thru 0x00f39c (0xca22 bytes) 000614 1789136914.534897 mapwrite 0x01acf3 thru 0x022201 (0x750f bytes) 000615 1789136914.585689 read 0x037819 thru 0x038f67 (0x174f bytes) 000616 1789136914.597070 MIRROR_RESYNC 2 mirrors 000617 1789136915.365866 MIRROR_RESYNC 2 mirrors 000618 1789136915.784061 mapwrite 0x037ca6 thru 0x03b58e (0x38e9 bytes) 000619 1789136915.931044 write 0x0163d5 thru 0x016825 (0x451 bytes) 000620 1789136915.942331 trunc from 0x040000 to 0x02c9ca (0x13635 bytes) 000621 1789136915.975398 punch from 0x021a21 to 0x022bc9 (0x11a9 bytes) 000622 1789136915.979492 punch from 0x02b8a1 to 0x02c9ca (0x112a bytes) 000623 1789136915.984377 mapwrite 0x007f6c thru 0x01638e (0xe423 bytes) 000624 1789136916.090655 punch from 0x00ab69 to 0x00d53f (0x29d7 bytes) 000625 1789136916.099516 mapread 0x009cb7 thru 0x00afac (0x12f6 bytes) 000626 1789136916.132629 mapwrite 0x03baa1 thru 0x03ffff (0x455f bytes) 000627 1789136916.205965 punch from 0x013b8a to 0x0150d0 (0x1547 bytes) 000628 1789136916.212037 read 0x009361 thru 0x010437 (0x70d7 bytes) 000629 1789136916.214035 mapread 0x001135 thru 0x004d84 (0x3c50 bytes) 000630 1789136916.220685 MIRROR_RESYNC 2 mirrors 000631 1789136917.090315 write 0x027fa6 thru 0x037209 (0xf264 bytes) 000632 1789136917.144367 punch from 0x0293eb to 0x0362af (0xcec5 bytes) 000633 1789136917.158471 mapwrite 0x0027a0 thru 0x00fb8d (0xd3ee bytes) 000634 1789136917.230268 fallocate 0x037c70 thru 0x03fdb9 (0x814a bytes) 000635 1789136917.239151 fallocate 0x01f008 thru 0x025d6e (0x6d67 bytes) 000636 1789136917.250365 write 0x02fa0a thru 0x03a940 (0xaf37 bytes) 000637 1789136917.271943 read 0x008f74 thru 0x00eea1 (0x5f2e bytes) 000638 1789136917.273167 mapwrite 0x01290a thru 0x015b7e (0x3275 bytes) 000640 1789136917.315848 fallocate 0x01a37d thru 0x01c161 (0x1de5 bytes) 000642 1789136917.322141 write 0x001747 thru 0x00795e (0x6218 bytes) 000643 1789136917.325533 mapwrite 0x024dfb thru 0x0288ba (0x3ac0 bytes) 000644 1789136917.371547 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000646 1789136917.527101 write 0x021741 thru 0x025f92 (0x4852 bytes) 000647 1789136917.543808 read 0x01676b thru 0x0199cb (0x3261 bytes) 000648 1789136917.550703 trunc from 0x040000 to 0x03e37b (0x1c84 bytes) 000649 1789136917.603707 read 0x005019 thru 0x0126b0 (0xd698 bytes) 000650 1789136917.630951 fallocate 0x01c9af thru 0x0286d8 (0xbd2a bytes) 000651 1789136917.635040 trunc from 0x03bde1 to 0x03e37b (0x259b bytes) 000652 1789136917.639658 fallocate 0x01a0c8 thru 0x024384 (0xa2bd bytes) 000654 1789136917.644989 fallocate 0x03d7e2 thru 0x03ffff (0x281e bytes) 000655 1789136917.652703 mapwrite 0x034113 thru 0x03a15d (0x604b bytes) 000656 1789136917.672230 punch from 0x02b6bf to 0x037408 (0xbd4a bytes) 000657 1789136917.680329 fallocate 0x02ab7f thru 0x034a88 (0x9f0a bytes) 000658 1789136917.698449 trunc from 0x03bc2c to 0x03e37b (0x2750 bytes) 000659 1789136917.706189 trunc from 0x03ccea to 0x03e37b (0x1692 bytes) 000660 1789136917.715235 punch from 0x009ba7 to 0x017328 (0xd782 bytes) 000661 1789136917.721168 read 0x02c87f thru 0x030f46 (0x46c8 bytes) 000663 1789136917.739568 mapwrite 0x015d3d thru 0x020a4b (0xad0f bytes) 000664 1789136917.764511 read 0x021915 thru 0x02800f (0x66fb bytes) 000665 1789136917.772556 MIRROR_EXTEND to 2 mirrors 000666 1789136918.570723 trunc from 0x01dfca to 0x01f233 (0x126a bytes) 000667 1789136918.618649 trunc from 0x03e37c to 0x0002f8 (0x3e083 bytes) 000668 1789136918.682309 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f9): Mirror 2: 0x48738358 (stale) CRC-32 checksum value for chunk [0, 0x2f9): Mirror 1: 0x48738358 Mirror 3: 0x48738358 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f9: skipped 000669 1789136919.433256 write 0x0356e2 thru 0x03ffff (0xa91e bytes) 000670 1789136919.495135 punch from 0x02da7d to 0x032714 (0x4c98 bytes) 000671 1789136919.501148 read 0x01c8ee thru 0x025b18 (0x922b bytes) 000672 1789136919.514027 mapread 0x020b25 thru 0x029b9e (0x907a bytes) 000673 1789136919.549218 MIRROR_RESYNC 3 mirrors 000674 1789136920.512636 punch from 0x006b1d to 0x013e5a (0xd33e bytes) 000675 1789136920.586095 punch from 0x02e00f to 0x030b07 (0x2af9 bytes) 000676 1789136920.596442 trunc from 0x005e61 to 0x010cad (0xae4d bytes) 000677 1789136920.610848 fallocate 0x031298 thru 0x032b06 (0x186f bytes) 000679 1789136920.626981 fallocate 0x01d162 thru 0x023247 (0x60e6 bytes) 000680 1789136920.633292 mapread 0x02041b thru 0x020e21 (0xa07 bytes) 000681 1789136920.640179 punch from 0x02f299 to 0x0325a6 (0x330e bytes) 000682 1789136920.647065 fallocate 0x00e007 thru 0x014a69 (0x6a63 bytes) 000683 1789136920.655368 trunc from 0x040000 to 0x006dff (0x39200 bytes) 000684 1789136920.702774 trunc from 0x00100f to 0x006dff (0x5df1 bytes) 000685 1789136920.708738 mapread 0x000118 thru 0x006dff (0x6ce8 bytes) 000686 1789136920.724925 trunc from 0x006e00 to 0x004011 (0x2dee bytes) 000687 1789136920.734909 trunc from 0x000729 to 0x004011 (0x38e9 bytes) 000688 1789136920.746114 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4012): Mirror 3: 0xe775ded7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4012): Mirror 3: 0xe775ded7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4012: skipped 000689 1789136921.088082 mapread 0x000196 thru 0x004011 (0x3e7c bytes) 000690 1789136921.114245 mapread 0x001c1d thru 0x002919 (0xcfd bytes) 000691 1789136921.128924 MIRROR_RESYNC 2 mirrors 000692 1789136921.675183 read 0x001a25 thru 0x004011 (0x25ed bytes) 000693 1789136921.683653 trunc from 0x0005f2 to 0x004011 (0x3a20 bytes) 000694 1789136921.717465 read 0x0039ff thru 0x004011 (0x613 bytes) 000695 1789136921.726928 fallocate 0x003e01 thru 0x006f24 (0x3124 bytes) 000696 1789136921.732040 mapwrite 0x00e402 thru 0x011eef (0x3aee bytes) 000697 1789136921.778951 punch from 0x0005f4 to 0x00d98b (0xd398 bytes) 000698 1789136921.784993 mapwrite 0x03874e thru 0x03ffff (0x78b2 bytes) 000699 1789136921.839066 punch from 0x0262e2 to 0x02cd4a (0x6a69 bytes) 000700 1789136921.843462 punch from 0x031a39 to 0x03ffff (0xe5c7 bytes) 000701 1789136921.849353 trunc from 0x02d66e to 0x03cca6 (0xf639 bytes) 000702 1789136921.854334 mapwrite 0x0218f9 thru 0x021cda (0x3e2 bytes) 000704 1789136921.876554 punch from 0x01be4e to 0x01c746 (0x8f9 bytes) 000705 1789136921.890802 read 0x02de17 thru 0x0349e9 (0x6bd3 bytes) 000706 1789136921.910535 fallocate 0x036397 thru 0x038527 (0x2191 bytes) 000707 1789136921.923044 mapwrite 0x00187b thru 0x00dc9d (0xc423 bytes) 000708 1789136921.960306 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000709 1789136922.201373 write 0x00c4f0 thru 0x01a258 (0xdd69 bytes) 000710 1789136922.230466 mapwrite 0x005ab0 thru 0x005cd1 (0x222 bytes) 000711 1789136922.293045 write 0x0191ce thru 0x01ffe0 (0x6e13 bytes) 000712 1789136922.305678 read 0x034a94 thru 0x038d06 (0x4273 bytes) 000713 1789136922.325151 fallocate 0x024430 thru 0x024b5d (0x72e bytes) 000714 1789136922.342681 mapwrite 0x01be0c thru 0x01d79e (0x1993 bytes) 000715 1789136922.414701 fallocate 0x021fd0 thru 0x02203e (0x6f bytes) 000716 1789136922.429497 fallocate 0x018f07 thru 0x01ce20 (0x3f1a bytes) 000717 1789136922.441116 punch from 0x002fa0 to 0x004519 (0x157a bytes) 000718 1789136922.456639 mapwrite 0x013284 thru 0x0172d6 (0x4053 bytes) 000719 1789136922.496742 trunc from 0x040000 to 0x0280fc (0x17f03 bytes) 000720 1789136922.536942 write 0x00e5cd thru 0x0107c9 (0x21fd bytes) 000721 1789136922.539131 trunc from 0x01821e to 0x01cc64 (0x4a47 bytes) 000722 1789136922.550469 write 0x00a565 thru 0x00cf22 (0x29be bytes) 000723 1789136922.560229 mapread 0x01247e thru 0x013e41 (0x19c4 bytes) 000724 1789136922.561441 mapread 0x006db8 thru 0x00f944 (0x8b8d bytes) 000725 1789136922.580157 trunc from 0x0280fd to 0x02b161 (0x3065 bytes) 000726 1789136922.598529 trunc from 0x02b162 to 0x004d0c (0x26455 bytes) 000727 1789136922.623293 write 0x03b23f thru 0x03ffff (0x4dc1 bytes) 000730 1789136922.628481 mapwrite 0x0215c0 thru 0x02f257 (0xdc98 bytes) 000731 1789136922.708139 mapread 0x0053df thru 0x00a619 (0x523b bytes) 000733 1789136922.725326 mapread 0x037403 thru 0x03d35d (0x5f5b bytes) 000734 1789136922.743746 mapread 0x02d4f6 thru 0x0367e4 (0x92ef bytes) 000735 1789136922.745656 write 0x02a8b3 thru 0x02b9b0 (0x10fe bytes) 000736 1789136922.748251 punch from 0x024900 to 0x02642e (0x1b2f bytes) 000737 1789136922.757543 punch from 0x01ca7b to 0x01d926 (0xeac bytes) 000738 1789136922.765699 mapread 0x02420f thru 0x02fc14 (0xba06 bytes) 000739 1789136922.774572 trunc from 0x040000 to 0x009d13 (0x362ec bytes) 000740 1789136922.793426 trunc from 0x001c8f to 0x005777 (0x3ae9 bytes) 000741 1789136922.799547 mapwrite 0x032a4c thru 0x03a947 (0x7efc bytes) 000742 1789136922.849082 fallocate 0x01ddd7 thru 0x02588a (0x7ab4 bytes) 000743 1789136922.860232 write 0x01e39d thru 0x02bbce (0xd832 bytes) 000745 1789136922.867454 punch from 0x0347d4 to 0x034af7 (0x324 bytes) 000746 1789136922.874049 mapwrite 0x02389c thru 0x02b60d (0x7d72 bytes) 000747 1789136922.897946 trunc from 0x03a948 to 0x033e28 (0x6b1f bytes) 000748 1789136922.912303 mapread 0x01eb76 thru 0x029c6f (0xb0fa bytes) 000749 1789136922.917573 punch from 0x0066d4 to 0x0134ce (0xcdfb bytes) 000751 1789136922.924850 fallocate 0x0362ad thru 0x039732 (0x3486 bytes) 000752 1789136922.931189 mapread 0x012d7c thru 0x0162d4 (0x3559 bytes) 000753 1789136922.944563 fallocate 0x00fb6c thru 0x01247e (0x2913 bytes) 000754 1789136922.959073 fallocate 0x002ef9 thru 0x012ec4 (0xffcc bytes) 000755 1789136922.969096 mapread 0x01b610 thru 0x022805 (0x71f6 bytes) 000756 1789136922.979579 write 0x037719 thru 0x03951b (0x1e03 bytes) 000758 1789136922.982250 trunc from 0x004df2 to 0x010342 (0xb551 bytes) 000760 1789136922.990537 mapwrite 0x0098b4 thru 0x016c0c (0xd359 bytes) 000761 1789136923.030091 read 0x03518b thru 0x039406 (0x427c bytes) 000762 1789136923.043074 trunc from 0x03951c to 0x015b86 (0x23995 bytes) 000763 1789136923.071578 mapwrite 0x027fc1 thru 0x028c88 (0xcc8 bytes) 000764 1789136923.128113 punch from 0x0115a2 to 0x015628 (0x4087 bytes) 000765 1789136923.136254 trunc from 0x028c89 to 0x02e15d (0x54d5 bytes) 000766 1789136923.151745 fallocate 0x002ecc thru 0x00859a (0x56cf bytes) 000767 1789136923.157943 mapread 0x022311 thru 0x02e15d (0xbe4d bytes) 000768 1789136923.225312 fallocate 0x0096b8 thru 0x012d3b (0x9684 bytes) 000769 1789136923.239090 mapwrite 0x02a499 thru 0x037319 (0xce81 bytes) 000770 1789136923.394940 MIRROR_EXTEND to 2 mirrors 000771 1789136924.170790 trunc from 0x03731a to 0x001621 (0x35cf8 bytes) 000772 1789136924.279202 fallocate 0x03b2f5 thru 0x03ffff (0x4d0b bytes) 000773 1789136924.285273 read 0x00757d thru 0x0127b7 (0xb23b bytes) 000774 1789136924.298052 write 0x02b41a thru 0x037325 (0xbf0c bytes) 000775 1789136924.307717 write 0x0396b7 thru 0x03f287 (0x5bd1 bytes) 000776 1789136924.329860 trunc from 0x02ccef to 0x03bad4 (0xede6 bytes) 000777 1789136924.345981 write 0x024b0a thru 0x02848c (0x3983 bytes) 000778 1789136924.361012 write 0x00b29c thru 0x00c7ce (0x1533 bytes) 000779 1789136924.362325 trunc from 0x040000 to 0x027300 (0x18cff bytes) 000780 1789136924.384350 write 0x03c150 thru 0x03ffff (0x3eb0 bytes) 000781 1789136924.388538 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf61915ec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x112c8f33 Mirror 3: 0x112c8f33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000782 1789136925.362867 mapread 0x00bb9d thru 0x01b398 (0xf7fc bytes) 000783 1789136925.396944 read 0x0099ec thru 0x00bdb6 (0x23cb bytes) 000785 1789136925.397669 punch from 0x0100f8 to 0x01bd34 (0xbc3d bytes) 000786 1789136925.452914 trunc from 0x00aea5 to 0x01864d (0xd7a9 bytes) 000787 1789136925.457179 read 0x039018 thru 0x03ee18 (0x5e01 bytes) 000788 1789136925.474261 punch from 0x03b3ce to 0x03daa6 (0x26d9 bytes) 000790 1789136925.501638 MIRROR_RESYNC 3 mirrors 000791 1789136926.374683 mapwrite 0x038024 thru 0x03ffff (0x7fdc bytes) 000792 1789136926.481134 fallocate 0x02f935 thru 0x030cbf (0x138b bytes) 000793 1789136926.490782 mapwrite 0x0367c6 thru 0x03caa7 (0x62e2 bytes) 000794 1789136926.539637 punch from 0x03b47c to 0x03c32c (0xeb1 bytes) 000796 1789136926.555809 mapread 0x034973 thru 0x036e22 (0x24b0 bytes) 000797 1789136926.560422 trunc from 0x040000 to 0x00412d (0x3bed2 bytes) 000798 1789136926.607258 punch from 0x002deb to 0x00412d (0x1343 bytes) 000799 1789136926.621379 read 0x000185 thru 0x00412d (0x3fa9 bytes) 000800 1789136926.636100 fallocate 0x033330 thru 0x03b1d2 (0x7ea3 bytes) 000801 1789136926.643671 fallocate 0x01156f thru 0x01e435 (0xcec7 bytes) 000802 1789136926.650396 punch from 0x013132 to 0x01e435 (0xb304 bytes) 000803 1789136926.661342 mapwrite 0x009c49 thru 0x016721 (0xcad9 bytes) 000804 1789136926.737866 write 0x03eaf2 thru 0x03ffff (0x150e bytes) 000805 1789136926.739049 read 0x020453 thru 0x022ec8 (0x2a76 bytes) 000806 1789136926.781696 MIRROR_RESYNC 3 mirrors 000807 1789136927.715546 write 0x015559 thru 0x01913d (0x3be5 bytes) 000808 1789136927.775117 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x59b07efb (stale) Mirror 3: 0x59b07efb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4bb5279c Mirror 4: 0x4bb5279c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000809 1789136928.594314 mapread 0x01c769 thru 0x028fc0 (0xc858 bytes) 000810 1789136928.642993 write 0x015df1 thru 0x01665d (0x86d bytes) 000811 1789136928.750245 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x59b07efb (stale) Mirror 4: 0x4bb5279c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x59b07efb (stale) Mirror 4: 0x4bb5279c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000812 1789136929.089737 trunc from 0x040000 to 0x020a32 (0x1f5cd bytes) 000816 1789136929.119260 fallocate 0x03dced thru 0x03ffff (0x2313 bytes) 000817 1789136929.129436 punch from 0x01678a to 0x01cdd3 (0x664a bytes) 000818 1789136929.135682 read 0x000830 thru 0x00ef81 (0xe752 bytes) 000819 1789136929.147588 mapwrite 0x037c4e thru 0x03ffff (0x83b2 bytes) 000820 1789136929.242746 write 0x03053e thru 0x03114d (0xc10 bytes) 000821 1789136929.262917 MIRROR_RESYNC 3 mirrors 000822 1789136930.248073 trunc from 0x040000 to 0x006e17 (0x391e8 bytes) 000823 1789136930.348963 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x6e18): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6e18): Mirror 2: 0x618c8277 (stale) Mirror 4: 0x618c8277 (stale) CRC-32 checksum value for chunk [0, 0x6e18): Mirror 1: 0x618c8277 Mirror 5: 0x618c8277 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6e18: skipped 000824 1789136931.185426 fallocate 0x007c9a thru 0x0117fd (0x9b64 bytes) 000825 1789136931.248544 mapwrite 0x00f758 thru 0x0108d4 (0x117d bytes) 000826 1789136931.271383 write 0x01469c thru 0x01b659 (0x6fbe bytes) 000828 1789136931.277792 fallocate 0x0212e8 thru 0x030c9f (0xf9b8 bytes) 000829 1789136931.282831 read 0x00c82e thru 0x018093 (0xb866 bytes) 000830 1789136931.291393 mapwrite 0x03b7ab thru 0x03ffff (0x4855 bytes) 000831 1789136931.341561 mapread 0x00ee86 thru 0x01bd08 (0xce83 bytes) 000832 1789136931.342684 trunc from 0x01ec7f to 0x02a294 (0xb616 bytes) 000833 1789136931.347253 trunc from 0x02dc7c to 0x03876d (0xaaf2 bytes) 000835 1789136931.353143 fallocate 0x002ed2 thru 0x010e98 (0xdfc7 bytes) 000836 1789136931.357768 mapwrite 0x014c6c thru 0x01b236 (0x65cb bytes) 000837 1789136931.381664 punch from 0x01a891 to 0x028ff4 (0xe764 bytes) 000839 1789136931.387738 read 0x01fccb thru 0x023be7 (0x3f1d bytes) 000840 1789136931.401456 read 0x00e0f3 thru 0x0139d0 (0x58de bytes) 000841 1789136931.402453 mapread 0x018841 thru 0x0255bc (0xcd7c bytes) 000842 1789136931.404551 read 0x038b89 thru 0x03ffff (0x7477 bytes) 000843 1789136931.406327 mapread 0x036ab6 thru 0x03de06 (0x7351 bytes) 000844 1789136931.409151 punch from 0x03bd4a to 0x03fe83 (0x413a bytes) 000845 1789136931.415690 mapwrite 0x01e2e3 thru 0x02376e (0x548c bytes) 000846 1789136931.435195 write 0x016001 thru 0x016236 (0x236 bytes) 000847 1789136931.441044 trunc from 0x040000 to 0x00f253 (0x30dac bytes) 000849 1789136931.463438 trunc from 0x002196 to 0x0056a8 (0x3513 bytes) 000850 1789136931.469451 fallocate 0x03e7a1 thru 0x03ffff (0x185f bytes) 000852 1789136931.475202 mapread 0x00362d thru 0x009937 (0x630b bytes) 000853 1789136931.487032 MIRROR_RESYNC 4 mirrors 000854 1789136932.529491 write 0x01183f thru 0x02004f (0xe811 bytes) 000855 1789136932.564111 punch from 0x01cfbc to 0x02004f (0x3094 bytes) 000856 1789136932.585134 mapread 0x00db78 thru 0x01a28c (0xc715 bytes) 000857 1789136932.643255 trunc from 0x020050 to 0x0256ba (0x566b bytes) 000858 1789136932.691167 write 0x016403 thru 0x017179 (0xd77 bytes) 000859 1789136932.692286 read 0x0166ff thru 0x019810 (0x3112 bytes) 000860 1789136932.692928 trunc from 0x0256bb to 0x028062 (0x29a8 bytes) 000861 1789136932.722349 trunc from 0x004ec4 to 0x013e70 (0xefad bytes) 000862 1789136932.734041 mapwrite 0x033048 thru 0x03ab59 (0x7b12 bytes) 000864 1789136932.795817 mapread 0x01fd6b thru 0x023778 (0x3a0e bytes) 000866 1789136932.808697 trunc from 0x018723 to 0x02406b (0xb949 bytes) 000867 1789136932.818056 mapwrite 0x007eb0 thru 0x009f71 (0x20c2 bytes) 000868 1789136932.889540 punch from 0x02a9bc to 0x0397d3 (0xee18 bytes) 000869 1789136932.895962 mapread 0x03864a thru 0x03ab59 (0x2510 bytes) 000870 1789136932.908204 read 0x016e93 thru 0x019a9f (0x2c0d bytes) 000871 1789136932.919002 mapread 0x00fa54 thru 0x01225a (0x2807 bytes) 000872 1789136932.919986 trunc from 0x03ab5a to 0x007a5d (0x330fc bytes) 000873 1789136932.939738 mapread 0x0024e0 thru 0x007a5d (0x557e bytes) 000875 1789136932.941255 mapwrite 0x007699 thru 0x0088ee (0x1256 bytes) 000876 1789136932.975850 trunc from 0x00554c to 0x0088ee (0x33a3 bytes) 000877 1789136932.981490 mapwrite 0x017492 thru 0x0214ec (0xa05b bytes) 000878 1789136933.088072 mapwrite 0x00f6ed thru 0x0167b8 (0x70cc bytes) 000879 1789136933.202096 write 0x033429 thru 0x03ffff (0xcbd7 bytes) 000880 1789136933.216251 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2a2f347a Mirror 6: 0x2a2f347a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000881 1789136934.467644 fallocate 0x00fe77 thru 0x012b60 (0x2cea bytes) 000882 1789136934.525941 punch from 0x010f3c to 0x01dc4c (0xcd11 bytes) 000883 1789136934.540150 trunc from 0x040000 to 0x003f56 (0x3c0a9 bytes) 000884 1789136934.616360 mapwrite 0x008389 thru 0x01733c (0xefb4 bytes) 000885 1789136934.768278 trunc from 0x00fe66 to 0x01733c (0x74d7 bytes) 000886 1789136934.778544 mapread 0x00a89c thru 0x014d88 (0xa4ed bytes) 000887 1789136934.797276 punch from 0x000270 to 0x002ec9 (0x2c5a bytes) 000888 1789136934.803245 mapread 0x012def thru 0x01733c (0x454e bytes) 000890 1789136934.804748 punch from 0x00d41b to 0x00dee6 (0xacc bytes) 000891 1789136934.821717 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1733d): Mirror 2: 0x7477e325 (stale) Mirror 5: 0x7477e325 (stale) Mirror 6: 0xcd549562 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1733d): Mirror 2: 0x7477e325 (stale) Mirror 5: 0x7477e325 (stale) Mirror 6: 0xcd549562 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1733d: skipped 000892 1789136935.253792 fallocate 0x010dec thru 0x020bf1 (0xfe06 bytes) 000893 1789136935.258908 punch from 0x012bce to 0x01733c (0x476f bytes) 000894 1789136935.269030 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1733d): Mirror 5: 0x7477e325 (stale) Mirror 6: 0xcd549562 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1733d): Mirror 5: 0x7477e325 (stale) Mirror 6: 0xcd549562 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1733d: skipped 000895 1789136935.632156 read 0x010071 thru 0x01733c (0x72cc bytes) 000896 1789136935.645417 read 0x014462 thru 0x01733c (0x2edb bytes) 000897 1789136935.646967 trunc from 0x004d88 to 0x008b2a (0x3da3 bytes) 000898 1789136935.657946 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1733d): Mirror 6: 0xcd549562 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1733d): Mirror 6: 0xcd549562 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1733d: skipped 000899 1789136935.923000 read 0x0114f5 thru 0x01733c (0x5e48 bytes) 000900 1789136935.932453 mapwrite 0x01c74d thru 0x01d3b6 (0xc6a bytes) 000901 1789136936.002016 fallocate 0x008ea2 thru 0x014d36 (0xbe95 bytes) 000902 1789136936.019329 read 0x01d0f1 thru 0x01d3b6 (0x2c6 bytes) 000903 1789136936.023223 trunc from 0x002182 to 0x006e29 (0x4ca8 bytes) 000904 1789136936.036533 write 0x0154e9 thru 0x015e16 (0x92e bytes) 000905 1789136936.063981 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d3b7): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d3b7): Mirror 6: 0xbf8c2c65 (stale) CRC-32 checksum value for chunk [0, 0x1d3b7): Mirror 1: 0x94ba9c10 Mirror 7: 0x94ba9c10 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d3b7: skipped 000906 1789136937.222643 punch from 0x01a751 to 0x01d3b6 (0x2c66 bytes) 000907 1789136937.285375 trunc from 0x01ca7f to 0x01d3b6 (0x938 bytes) 000908 1789136937.305890 fallocate 0x0239c9 thru 0x02b084 (0x76bc bytes) 000909 1789136937.336162 read 0x01ae88 thru 0x01d3b6 (0x252f bytes) 000910 1789136937.353474 mapwrite 0x02c8eb thru 0x03a692 (0xdda8 bytes) 000911 1789136937.496067 write 0x034459 thru 0x039e26 (0x59ce bytes) 000912 1789136937.497252 punch from 0x029f06 to 0x039a73 (0xfb6e bytes) 000913 1789136937.519572 mapread 0x035b36 thru 0x037cb7 (0x2182 bytes) 000914 1789136937.540112 read 0x01af8f thru 0x01c501 (0x1573 bytes) 000915 1789136937.540884 fallocate 0x0152d1 thru 0x01c0bb (0x6deb bytes) 000916 1789136937.556872 read 0x039445 thru 0x03a04f (0xc0b bytes) 000917 1789136937.557632 fallocate 0x034b95 thru 0x03ffff (0xb46b bytes) 000918 1789136937.574538 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a693): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a693): Mirror 6: 0x4d0aa0c7 (stale) Mirror 7: 0x23550d48 (stale) CRC-32 checksum value for chunk [0, 0x3a693): Mirror 1: 0xc069616f Mirror 8: 0xc069616f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a693: skipped 000919 1789136938.671105 read 0x0298b5 thru 0x030d4d (0x7499 bytes) 000920 1789136938.681948 mapread 0x020589 thru 0x02fbd7 (0xf64f bytes) 000923 1789136938.700503 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a693): Mirror 7: 0x23550d48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a693): Mirror 7: 0x23550d48 (stale) CRC-32 checksum value for chunk [0, 0x3a693): Mirror 1: 0xc069616f Mirror 8: 0xc069616f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a693: skipped 000924 1789136939.197520 punch from 0x03150b to 0x035974 (0x446a bytes) 000927 1789136939.266854 read 0x02c38e thru 0x038b1c (0xc78f bytes) 000929 1789136939.302512 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a693): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a693): Mirror 7: 0x23550d48 (stale) Mirror 8: 0xc069616f (stale) CRC-32 checksum value for chunk [0, 0x3a693): Mirror 1: 0xc069616f Mirror 9: 0xc069616f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a693: skipped 000930 1789136940.381084 mapread 0x010267 thru 0x01ab63 (0xa8fd bytes) 000931 1789136940.412833 MIRROR_RESYNC 4 mirrors 000932 1789136941.629204 mapread 0x0169b5 thru 0x01ad53 (0x439f bytes) 000933 1789136941.649766 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) 000934 1789136942.085128 trunc from 0x027669 to 0x031662 (0x9ffa bytes) 000935 1789136942.153388 mapread 0x0020b5 thru 0x0102ba (0xe206 bytes) 000936 1789136942.204496 trunc from 0x03a693 to 0x0202b3 (0x1a3df bytes) 000937 1789136942.250414 trunc from 0x00f1f7 to 0x018cbc (0x9ac6 bytes) 000938 1789136942.258542 mapwrite 0x01af23 thru 0x021496 (0x6574 bytes) 000939 1789136942.334441 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x21497): Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21497): Mirror 7: 0x78d6f8a6 (stale) Mirror 9: 0x78d6f8a6 (stale) CRC-32 checksum value for chunk [0, 0x21497): Mirror 1: 0x5e662145 Mirror 10: 0x5e662145 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21497: skipped 000940 1789136943.092053 punch from 0x004fad to 0x00896a (0x39be bytes) 000941 1789136943.137989 MIRROR_RESYNC 4 mirrors 000942 1789136944.226158 punch from 0x0042a0 to 0x01087c (0xc5dd bytes) 000943 1789136944.280047 fallocate 0x02f9be thru 0x03f997 (0xffda bytes) 000944 1789136944.295209 read 0x010e26 thru 0x011073 (0x24e bytes) 000946 1789136944.319790 trunc from 0x024116 to 0x02bea5 (0x7d90 bytes) 000947 1789136944.325023 mapread 0x007d98 thru 0x009613 (0x187c bytes) 000948 1789136944.347150 read 0x018bcb thru 0x028bb4 (0xffea bytes) 000949 1789136944.357992 trunc from 0x03f998 to 0x03a879 (0x511e bytes) 000951 1789136944.374154 trunc from 0x012196 to 0x01b88b (0x96f6 bytes) 000953 1789136944.380498 fallocate 0x019840 thru 0x028317 (0xead8 bytes) 000954 1789136944.385545 mapwrite 0x02aef0 thru 0x031e99 (0x6faa bytes) 000955 1789136944.406501 punch from 0x019763 to 0x01adef (0x168d bytes) 000956 1789136944.410939 mapread 0x00cfcf thru 0x00d308 (0x33a bytes) 000957 1789136944.412029 mapread 0x024c7f thru 0x02b977 (0x6cf9 bytes) 000958 1789136944.413965 mapread 0x0394a9 thru 0x03a879 (0x13d1 bytes) 000959 1789136944.418532 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a87a): Mirror 9: 0x27c92992 (stale) Mirror 10: 0x27c92992 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a87a): Mirror 9: 0x27c92992 (stale) Mirror 10: 0x27c92992 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a87a: skipped 000960 1789136944.814540 write 0x0271f0 thru 0x02d8d2 (0x66e3 bytes) 000961 1789136944.830677 trunc from 0x03a87a to 0x02bf65 (0xe914 bytes) 000962 1789136944.854578 read 0x00cea6 thru 0x01bcaf (0xee0a bytes) 000963 1789136944.882467 read 0x018177 thru 0x020715 (0x859f bytes) 000964 1789136944.905558 punch from 0x001880 to 0x006cf3 (0x5474 bytes) 000965 1789136944.910825 trunc from 0x01b2bf to 0x025261 (0x9fa3 bytes) 000967 1789136944.919257 mapread 0x0153ad thru 0x01d72e (0x8382 bytes) 000968 1789136944.943795 write 0x027063 thru 0x03461e (0xd5bc bytes) 000969 1789136944.957245 MIRROR_RESYNC 3 mirrors 000970 1789136945.901395 trunc from 0x03461f to 0x033dd3 (0x84b bytes) 000971 1789136945.977276 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 9: 0x670eb207 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 9: 0x670eb207 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33dd4: skipped 000972 1789136946.378375 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 9: 0x670eb207 (stale) CRC-32 checksum value for chunk [0, 0x33dd4): Mirror 1: 0x670eb207 Mirror 10: 0x670eb207 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33dd4: skipped 000973 1789136947.412795 punch from 0x01ae27 to 0x027758 (0xc932 bytes) 000974 1789136947.457060 read 0x027c14 thru 0x033a80 (0xbe6d bytes) 000975 1789136947.480364 MIRROR_RESYNC 3 mirrors 000976 1789136948.372537 fallocate 0x00e712 thru 0x0119c2 (0x32b1 bytes) 000977 1789136948.421359 mapread 0x003db8 thru 0x00a4ad (0x66f6 bytes) 000979 1789136948.440126 read 0x008c79 thru 0x00ccfe (0x4086 bytes) 000980 1789136948.441114 read 0x00e2ea thru 0x011ff1 (0x3d08 bytes) 000981 1789136948.450864 read 0x0002ac thru 0x001067 (0xdbc bytes) 000982 1789136948.451519 mapread 0x00e42f thru 0x014bd9 (0x67ab bytes) 000983 1789136948.452434 fallocate 0x0225cc thru 0x0251e8 (0x2c1d bytes) 000984 1789136948.462032 MIRROR_RESYNC 3 mirrors 000985 1789136949.260979 trunc from 0x02c41c to 0x033dd3 (0x79b8 bytes) 000986 1789136949.300383 write 0x030f90 thru 0x03a6c2 (0x9733 bytes) 000987 1789136949.308499 write 0x0018fc thru 0x00f6be (0xddc3 bytes) 000988 1789136949.321024 write 0x03e74a thru 0x03ffff (0x18b6 bytes) 000989 1789136949.327237 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x16946e47 (stale) Mirror 10: 0x16946e47 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x693a0476 Mirror 11: 0x693a0476 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000990 1789136950.328815 trunc from 0x040000 to 0x013235 (0x2cdca bytes) 000991 1789136950.401511 fallocate 0x030405 thru 0x03836c (0x7f68 bytes) 000992 1789136950.409851 read 0x033bcb thru 0x03836c (0x47a2 bytes) 000993 1789136950.418925 punch from 0x01c7c7 to 0x02708e (0xa8c8 bytes) 000994 1789136950.422963 mapwrite 0x03b96a thru 0x03ffff (0x4696 bytes) 000995 1789136950.500911 trunc from 0x00694c to 0x016462 (0xfb17 bytes) 000996 1789136950.516023 mapwrite 0x03ab62 thru 0x03bc78 (0x1117 bytes) 000997 1789136950.543007 mapread 0x00c332 thru 0x014e85 (0x8b54 bytes) 000998 1789136950.611823 mapread 0x009908 thru 0x00f2b5 (0x59ae bytes) 000999 1789136950.614420 punch from 0x006188 to 0x01560c (0xf485 bytes) 001000 1789136950.622426 trunc from 0x040000 to 0x036ea4 (0x915b bytes) All operations completed A-OK!