== sanity-flr test 70a: flr mode fsx test ================ 03:16:35 (1789024595) Seed set to 4596 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1789024597.220556 write 0x02a0c4 thru 0x02dd7b (0x3cb8 bytes) 000004 1789024597.227618 read 0x00586f thru 0x01279b (0xcf2d bytes) 000006 1789024597.237654 mapwrite 0x0165a8 thru 0x021b83 (0xb5dc bytes) truncating to largest ever: 0xfbe9 000007 1789024597.423468 trunc from 0x02dd7c to 0x00fbe8 (0x1e193 bytes) 000008 1789024597.459643 mapread 0x008834 thru 0x00fbe8 (0x73b5 bytes) 000009 1789024597.460592 mapwrite 0x01c5ac thru 0x0280f5 (0xbb4a bytes) 000011 1789024597.634093 punch from 0x008079 to 0x0122f1 (0xa279 bytes) truncating to largest ever: 0x3308f 000012 1789024597.643232 trunc from 0x0280f6 to 0x03308e (0xaf99 bytes) 000013 1789024597.665096 mapread 0x02435b thru 0x02b3ce (0x7074 bytes) 000017 1789024597.683826 mapwrite 0x024668 thru 0x032cab (0xe644 bytes) 000020 1789024597.796429 write 0x030090 thru 0x03f5f5 (0xf566 bytes) 000021 1789024597.803230 punch from 0x03a8a1 to 0x03f5f5 (0x4d55 bytes) 000022 1789024597.839291 punch from 0x011a02 to 0x01ac3b (0x923a bytes) 000024 1789024597.852468 mapread 0x013eeb thru 0x01cb8f (0x8ca5 bytes) 000025 1789024597.886582 punch from 0x02b814 to 0x030185 (0x4972 bytes) 000026 1789024597.893203 read 0x017e35 thru 0x01c09b (0x4267 bytes) 000030 1789024597.901204 read 0x03e762 thru 0x03f5f5 (0xe94 bytes) 000032 1789024597.921967 write 0x003179 thru 0x00e7d7 (0xb65f bytes) 000033 1789024597.923326 punch from 0x0012b1 to 0x00a3ee (0x913e bytes) 000034 1789024597.954690 mapwrite 0x02a03d thru 0x02f446 (0x540a bytes) 000036 1789024598.070917 mapwrite 0x0035bb thru 0x01100d (0xda53 bytes) 000038 1789024598.307879 read 0x038eb1 thru 0x03b7cc (0x291c bytes) 000039 1789024598.310965 mapread 0x012f6a thru 0x016f31 (0x3fc8 bytes) 000041 1789024598.314827 trunc from 0x03f5f6 to 0x017272 (0x28383 bytes) 000042 1789024598.352101 read 0x005fa5 thru 0x014907 (0xe963 bytes) 000044 1789024598.357225 trunc from 0x017273 to 0x01de99 (0x6c27 bytes) 000045 1789024598.382187 trunc from 0x01de9a to 0x026659 (0x87c0 bytes) 000047 1789024598.405653 mapwrite 0x002954 thru 0x00a88a (0x7f37 bytes) 000050 1789024598.555736 trunc from 0x02665a to 0x031ec7 (0xb86e bytes) 000051 1789024598.594030 mapwrite 0x017c0d thru 0x01cd36 (0x512a bytes) 000052 1789024598.739180 mapwrite 0x03dd4d thru 0x03ffff (0x22b3 bytes) 000053 1789024598.881798 trunc from 0x040000 to 0x032b3a (0xd4c5 bytes) 000056 1789024598.909062 write 0x02845f thru 0x034da5 (0xc947 bytes) 000058 1789024598.912444 trunc from 0x034da6 to 0x0078be (0x2d4e7 bytes) 000059 1789024598.946522 read 0x005436 thru 0x0078be (0x2489 bytes) 000060 1789024598.949723 punch from 0x006356 to 0x0078be (0x1569 bytes) 000063 1789024598.961454 mapread 0x0055fb thru 0x0078be (0x22c4 bytes) 000064 1789024598.972431 trunc from 0x0078bf to 0x0021d3 (0x56eb bytes) 000065 1789024598.993557 punch from 0x000c85 to 0x0021d3 (0x154f bytes) 000066 1789024599.007595 mapread 0x001b49 thru 0x0021d3 (0x68b bytes) truncating to largest ever: 0x3c1e0 000067 1789024599.033943 trunc from 0x0021d4 to 0x03c1df (0x3a00c bytes) 000069 1789024599.069080 trunc from 0x03c1e0 to 0x00710f (0x350d0 bytes) 000070 1789024599.092668 trunc from 0x007110 to 0x01de45 (0x16d36 bytes) 000071 1789024599.112105 write 0x03d5d8 thru 0x03ffff (0x2a28 bytes) 000072 1789024599.114537 write 0x034ce6 thru 0x0350f7 (0x412 bytes) truncating to largest ever: 0x3ced6 000074 1789024599.128574 trunc from 0x040000 to 0x03ced5 (0x312a bytes) 000075 1789024599.160360 write 0x027b26 thru 0x030897 (0x8d72 bytes) 000076 1789024599.161647 write 0x00bc46 thru 0x0121b1 (0x656c bytes) 000077 1789024599.172720 punch from 0x01b1b4 to 0x029a72 (0xe8bf bytes) 000079 1789024599.206885 mapwrite 0x0183aa thru 0x018db8 (0xa0f bytes) 000081 1789024599.305983 mapread 0x01bbe6 thru 0x0225a3 (0x69be bytes) 000082 1789024599.413787 read 0x00f183 thru 0x01b0f8 (0xbf76 bytes) 000083 1789024599.414741 punch from 0x03a8cd to 0x03ced5 (0x2609 bytes) 000084 1789024599.424325 mapwrite 0x01986d thru 0x0260ef (0xc883 bytes) 000085 1789024599.492000 mapwrite 0x01e182 thru 0x027152 (0x8fd1 bytes) 000090 1789024599.542576 read 0x01c532 thru 0x01f13b (0x2c0a bytes) 000092 1789024599.549879 MIRROR_EXTEND to 2 mirrors 000093 1789024600.691300 MIRROR_EXTEND to 3 mirrors 000094 1789024601.891044 MIRROR_EXTEND to 4 mirrors 000095 1789024603.462362 mapwrite 0x01337a thru 0x021580 (0xe207 bytes) 000096 1789024603.661418 punch from 0x0264fa to 0x02f642 (0x9149 bytes) 000097 1789024603.687062 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ced6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ced6): Mirror 2: 0xfeac2d3a (stale) Mirror 3: 0xfeac2d3a (stale) Mirror 4: 0xfeac2d3a (stale) CRC-32 checksum value for chunk [0, 0x3ced6): Mirror 1: 0xc405759f Mirror 5: 0xc405759f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ced6: skipped 000098 1789024605.445726 write 0x0331b3 thru 0x035812 (0x2660 bytes) 000099 1789024605.578764 trunc from 0x03ced6 to 0x02859a (0x1493b bytes) 000100 1789024605.623412 mapwrite 0x008551 thru 0x009bf6 (0x16a6 bytes) 000101 1789024605.701443 read 0x004f90 thru 0x0064d6 (0x1547 bytes) 000102 1789024605.706233 mapread 0x0166d3 thru 0x023942 (0xd270 bytes) 000103 1789024605.720479 mapread 0x022999 thru 0x02485f (0x1ec7 bytes) 000104 1789024605.722362 mapwrite 0x01d27f thru 0x0243e1 (0x7163 bytes) 000106 1789024605.791655 mapread 0x023cf4 thru 0x02859a (0x48a7 bytes) 000107 1789024605.799907 punch from 0x01686e to 0x020a27 (0xa1ba bytes) 000108 1789024605.812928 read 0x00e201 thru 0x011884 (0x3684 bytes) 000109 1789024605.831430 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2859b): Mirror 2: 0x87f677bd (stale) Mirror 3: 0x87f677bd (stale) Mirror 4: 0x87f677bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2859b): Mirror 2: 0x87f677bd (stale) Mirror 3: 0x87f677bd (stale) Mirror 4: 0x87f677bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2859b: skipped 000111 1789024606.239835 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2859b): Mirror 3: 0x87f677bd (stale) Mirror 4: 0x87f677bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2859b): Mirror 3: 0x87f677bd (stale) Mirror 4: 0x87f677bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2859b: skipped 000114 1789024606.635793 trunc from 0x02859b to 0x0052ae (0x232ec bytes) 000115 1789024606.655002 punch from 0x002828 to 0x0052ae (0x2a87 bytes) 000116 1789024606.660532 mapread 0x002fd0 thru 0x0052ae (0x22df bytes) 000117 1789024606.681080 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x52af): Mirror 3: 0x1ad8efa9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x52af): Mirror 3: 0x1ad8efa9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x52af: skipped 000118 1789024607.132348 write 0x00d8c2 thru 0x010676 (0x2db5 bytes) 000119 1789024607.146629 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x10677): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10677): Mirror 3: 0x3207861f (stale) CRC-32 checksum value for chunk [0, 0x10677): Mirror 1: 0x5db6cc87 Mirror 4: 0x5db6cc87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10677: skipped 000120 1789024608.510573 write 0x011389 thru 0x020bdc (0xf854 bytes) 000121 1789024608.605970 write 0x02372d thru 0x02afb7 (0x788b bytes) 000122 1789024608.608629 punch from 0x011f08 to 0x01db74 (0xbc6d bytes) 000123 1789024608.624322 trunc from 0x02afb8 to 0x010a4f (0x1a568 bytes) 000124 1789024608.664030 mapwrite 0x038a22 thru 0x03c52e (0x3b0d bytes) 000126 1789024608.803803 mapwrite 0x02d0d9 thru 0x03cb00 (0xfa28 bytes) 000127 1789024608.979988 punch from 0x033bb5 to 0x03cb00 (0x8f4c bytes) 000128 1789024608.998083 punch from 0x0349b7 to 0x03cb00 (0x814a bytes) 000129 1789024609.007029 mapread 0x0288f4 thru 0x03365a (0xad67 bytes) 000130 1789024609.042231 MIRROR_RESYNC 3 mirrors 000131 1789024610.746017 MIRROR_EXTEND to 4 mirrors 000133 1789024612.128034 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) 000134 1789024612.569461 mapwrite 0x01e84f thru 0x024675 (0x5e27 bytes) 000135 1789024612.715965 mapwrite 0x00aa87 thru 0x0133a7 (0x8921 bytes) 000137 1789024612.784051 MIRROR_RESYNC 3 mirrors 000138 1789024614.666929 read 0x023d58 thru 0x02a663 (0x690c bytes) 000139 1789024614.675930 read 0x02749f thru 0x02840f (0xf71 bytes) 000140 1789024614.676516 write 0x01a1d0 thru 0x0216d4 (0x7505 bytes) 000141 1789024614.776822 write 0x024237 thru 0x0265d3 (0x239d bytes) 000142 1789024614.781781 mapwrite 0x006d28 thru 0x00ba6e (0x4d47 bytes) 000143 1789024614.881518 read 0x0336a3 thru 0x03cb00 (0x945e bytes) 000144 1789024614.883335 mapread 0x01d213 thru 0x02cb7c (0xf96a bytes) 000145 1789024614.886858 mapwrite 0x02a18c thru 0x02fce0 (0x5b55 bytes) 000146 1789024614.965407 mapwrite 0x02ea41 thru 0x032ae1 (0x40a1 bytes) 000147 1789024615.032819 punch from 0x01674b to 0x026474 (0xfd2a bytes) 000149 1789024615.046798 read 0x02615d thru 0x029637 (0x34db bytes) 000151 1789024615.061922 mapwrite 0x000dd3 thru 0x00ecea (0xdf18 bytes) truncating to largest ever: 0x3e5e6 000152 1789024615.141003 trunc from 0x03cb01 to 0x03e5e5 (0x1ae5 bytes) 000153 1789024615.186401 read 0x0053d5 thru 0x00a629 (0x5255 bytes) 000154 1789024615.187216 write 0x0106ec thru 0x017fd5 (0x78ea bytes) 000155 1789024615.191851 write 0x0269d7 thru 0x034a16 (0xe040 bytes) 000156 1789024615.194943 mapread 0x03c392 thru 0x03e5e5 (0x2254 bytes) 000157 1789024615.213994 mapread 0x01fb87 thru 0x02ec9b (0xf115 bytes) 000159 1789024615.222903 write 0x000743 thru 0x00f087 (0xe945 bytes) 000160 1789024615.235264 MIRROR_RESYNC 3 mirrors 000161 1789024616.670823 read 0x02e07b thru 0x03af87 (0xcf0d bytes) 000163 1789024616.679456 read 0x03555a thru 0x03c9e4 (0x748b bytes) 000169 1789024616.690508 trunc from 0x03e5e6 to 0x0081a2 (0x36443 bytes) truncating to largest ever: 0x3f37a 000171 1789024616.757435 trunc from 0x0081a3 to 0x03f379 (0x371d7 bytes) 000172 1789024616.784061 read 0x02815b thru 0x0307d4 (0x867a bytes) 000174 1789024616.801886 MIRROR_RESYNC 3 mirrors 000175 1789024617.750523 mapread 0x03da94 thru 0x03f379 (0x18e6 bytes) 000176 1789024617.790436 mapread 0x016a0c thru 0x01a99c (0x3f91 bytes) 000177 1789024617.801955 punch from 0x01e57d to 0x02a600 (0xc084 bytes) 000179 1789024617.894994 write 0x02f5fd thru 0x02ffd4 (0x9d8 bytes) 000181 1789024617.902281 write 0x00ef47 thru 0x01ebe5 (0xfc9f bytes) 000182 1789024617.912642 read 0x00c0f0 thru 0x0175c2 (0xb4d3 bytes) 000183 1789024617.918199 mapwrite 0x0387b9 thru 0x03cdbc (0x4604 bytes) 000184 1789024617.993242 punch from 0x01f40f to 0x029c43 (0xa835 bytes) 000185 1789024618.009284 mapread 0x03bbf8 thru 0x03f379 (0x3782 bytes) 000186 1789024618.013360 punch from 0x037f04 to 0x03cb0f (0x4c0c bytes) 000187 1789024618.031387 MIRROR_RESYNC 3 mirrors 000188 1789024619.609926 punch from 0x00957d to 0x011bfc (0x8680 bytes) 000189 1789024619.684129 write 0x028537 thru 0x03288b (0xa355 bytes) 000190 1789024619.697028 punch from 0x02a397 to 0x02a598 (0x202 bytes) 000191 1789024619.714842 read 0x028d8e thru 0x02f668 (0x68db bytes) 000192 1789024619.720427 write 0x01f812 thru 0x0272b1 (0x7aa0 bytes) 000193 1789024619.736087 MIRROR_RESYNC 3 mirrors 000195 1789024620.828276 punch from 0x01db96 to 0x01e49b (0x906 bytes) 000196 1789024620.908006 trunc from 0x03f37a to 0x0354b1 (0x9ec8 bytes) 000197 1789024620.970906 punch from 0x015b2f to 0x01ea96 (0x8f68 bytes) 000198 1789024620.984470 read 0x000377 thru 0x00c9b3 (0xc63d bytes) 000200 1789024620.997897 punch from 0x01ac0d to 0x01ad53 (0x147 bytes) 000201 1789024621.009397 punch from 0x030433 to 0x0354b1 (0x507f bytes) 000203 1789024621.018841 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x354b2): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x354b2): Mirror 3: 0xbd1b1e63 (stale) Mirror 5: 0xbd1b1e63 (stale) CRC-32 checksum value for chunk [0, 0x354b2): Mirror 1: 0x1f8a59ff Mirror 6: 0x1f8a59ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x354b2: skipped 000204 1789024622.236294 read 0x0229da thru 0x0322d1 (0xf8f8 bytes) 000206 1789024622.260328 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x354b2): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x354b2): Mirror 3: 0xbd1b1e63 (stale) Mirror 5: 0xbd1b1e63 (stale) CRC-32 checksum value for chunk [0, 0x354b2): Mirror 1: 0x1f8a59ff Mirror 6: 0x1f8a59ff Mirror 7: 0x1f8a59ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x354b2: skipped 000210 1789024623.726545 write 0x03e23f thru 0x03ffff (0x1dc1 bytes) 000211 1789024623.893040 MIRROR_RESYNC 5 mirrors 000212 1789024626.384239 mapread 0x030631 thru 0x03de9f (0xd86f bytes) 000213 1789024626.449519 mapwrite 0x01d47a thru 0x028167 (0xacee bytes) 000214 1789024626.766689 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd1d28832 (stale) Mirror 6: 0xd1d28832 (stale) Mirror 7: 0xd1d28832 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd1d28832 (stale) Mirror 6: 0xd1d28832 (stale) Mirror 7: 0xd1d28832 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000215 1789024627.470911 punch from 0x033271 to 0x03ffff (0xcd8f bytes) 000216 1789024627.477501 read 0x02c05e thru 0x03172e (0x56d1 bytes) 000218 1789024627.488872 mapwrite 0x031b4a thru 0x03fce4 (0xe19b bytes) 000219 1789024627.627059 mapwrite 0x015b4d thru 0x01611f (0x5d3 bytes) 000220 1789024627.742744 MIRROR_RESYNC 4 mirrors 000221 1789024629.345308 punch from 0x019aad to 0x020b72 (0x70c6 bytes) 000222 1789024629.431352 mapwrite 0x0122cc thru 0x016123 (0x3e58 bytes) 000224 1789024629.574454 punch from 0x0176f7 to 0x0269e5 (0xf2ef bytes) 000225 1789024629.591179 mapwrite 0x02348e thru 0x028ddd (0x5950 bytes) 000226 1789024629.700954 read 0x01b247 thru 0x02909e (0xde58 bytes) 000228 1789024629.710937 mapwrite 0x01cb1c thru 0x027926 (0xae0b bytes) 000230 1789024629.818569 trunc from 0x040000 to 0x0174e1 (0x28b1e bytes) 000231 1789024629.865527 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x174e2): Mirror 3: 0x63d2e56e (stale) Mirror 7: 0x63d2e56e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x174e2): Mirror 3: 0x63d2e56e (stale) Mirror 7: 0x63d2e56e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x174e2: skipped 000233 1789024630.341620 mapwrite 0x03140a thru 0x03b8bf (0xa4b6 bytes) 000235 1789024630.508561 trunc from 0x03b8c0 to 0x00ab7b (0x30d44 bytes) 000236 1789024630.529052 read 0x007648 thru 0x00ab7b (0x3534 bytes) 000237 1789024630.543639 punch from 0x005bc1 to 0x008cf4 (0x3134 bytes) 000239 1789024630.559213 read 0x004d1e thru 0x008503 (0x37e6 bytes) 000240 1789024630.581766 mapread 0x007dc7 thru 0x00ab7b (0x2db5 bytes) 000241 1789024630.582988 trunc from 0x00ab7c to 0x0143e3 (0x9868 bytes) 000242 1789024630.612479 punch from 0x007266 to 0x0143e3 (0xd17e bytes) 000243 1789024630.655122 mapwrite 0x019774 thru 0x0269ac (0xd239 bytes) 000244 1789024630.888087 MIRROR_RESYNC 3 mirrors 000245 1789024632.306037 MIRROR_RESYNC 3 mirrors 000246 1789024632.775594 trunc from 0x0269ad to 0x011c8f (0x14d1d bytes) 000247 1789024632.901129 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x11c90): Mirror 3: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11c90): Mirror 3: 0x82c1edf3 (stale) Mirror 7: 0x82c1edf3 (stale) CRC-32 checksum value for chunk [0, 0x11c90): Mirror 1: 0x82c1edf3 Mirror 8: 0x82c1edf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11c90: skipped 000248 1789024634.352328 read 0x00c4f6 thru 0x0112f8 (0x4e03 bytes) 000250 1789024634.374109 read 0x0075b3 thru 0x0117d0 (0xa21e bytes) 000251 1789024634.393466 read 0x008271 thru 0x011916 (0x96a6 bytes) 000252 1789024634.403747 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11c90): Mirror 3: 0x82c1edf3 (stale) Mirror 7: 0x82c1edf3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11c90): Mirror 3: 0x82c1edf3 (stale) Mirror 7: 0x82c1edf3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11c90: skipped 000253 1789024634.781868 trunc from 0x011c90 to 0x00243f (0xf850 bytes) 000256 1789024634.809412 mapread 0x0017df thru 0x00243f (0xc61 bytes) 000258 1789024634.826376 trunc from 0x002440 to 0x022b65 (0x20726 bytes) 000259 1789024634.857757 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x22b66): Mirror 3: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22b66): Mirror 3: 0x922a66b7 (stale) Mirror 7: 0x922a66b7 (stale) CRC-32 checksum value for chunk [0, 0x22b66): Mirror 1: 0x76e71ad0 Mirror 8: 0x76e71ad0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22b66: skipped 000260 1789024636.086335 trunc from 0x022b66 to 0x006dd6 (0x1bd8f bytes) 000261 1789024636.245642 mapwrite 0x0113b6 thru 0x014ae5 (0x3730 bytes) 000262 1789024636.374354 punch from 0x013f03 to 0x014ae5 (0xbe3 bytes) 000264 1789024636.381205 trunc from 0x014ae6 to 0x00ae58 (0x9c8d bytes) 000266 1789024636.406369 trunc from 0x00ae59 to 0x0224c0 (0x17668 bytes) 000267 1789024636.438723 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x224c1): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x224c1): Mirror 3: 0x9408134c (stale) Mirror 7: 0x9408134c (stale) Mirror 8: 0xbd1f5362 (stale) CRC-32 checksum value for chunk [0, 0x224c1): Mirror 1: 0xbd1f5362 Mirror 9: 0xbd1f5362 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x224c1: skipped 000268 1789024637.727612 mapread 0x01c6a0 thru 0x021a05 (0x5366 bytes) 000269 1789024637.799766 trunc from 0x0224c1 to 0x00aec2 (0x175fe bytes) 000270 1789024637.975704 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xaec3): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xaec3): Mirror 3: 0x9fc936fd (stale) Mirror 7: 0x9fc936fd (stale) Mirror 8: 0x7eb60b49 (stale) Mirror 9: 0x7eb60b49 (stale) CRC-32 checksum value for chunk [0, 0xaec3): Mirror 1: 0x7eb60b49 Mirror 10: 0x7eb60b49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xaec3: skipped 000271 1789024639.321409 trunc from 0x00aec3 to 0x0314f7 (0x26635 bytes) 000272 1789024639.429456 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x314f8): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x314f8): Mirror 3: 0x61a4d8db (stale) Mirror 7: 0x61a4d8db (stale) Mirror 8: 0xb2318b34 (stale) Mirror 9: 0xb2318b34 (stale) Mirror 10: 0xb2318b34 (stale) CRC-32 checksum value for chunk [0, 0x314f8): Mirror 1: 0xb2318b34 Mirror 11: 0xb2318b34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x314f8: skipped 000273 1789024640.784748 read 0x00ae7e thru 0x00df50 (0x30d3 bytes) 000274 1789024640.793846 mapwrite 0x00378e thru 0x0070f9 (0x396c bytes) 000276 1789024641.018325 punch from 0x02e2bd to 0x0314f7 (0x323b bytes) 000277 1789024641.033035 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x314f8): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x314f8): Mirror 3: 0x61a4d8db (stale) Mirror 7: 0x61a4d8db (stale) Mirror 8: 0xb2318b34 (stale) Mirror 9: 0xb2318b34 (stale) Mirror 10: 0xb2318b34 (stale) Mirror 11: 0xb2318b34 (stale) CRC-32 checksum value for chunk [0, 0x314f8): Mirror 1: 0xd257284a Mirror 12: 0xd257284a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x314f8: skipped 000280 1789024642.724907 MIRROR_RESYNC 8 mirrors 000281 1789024644.399959 read 0x01902e thru 0x01e01a (0x4fed bytes) 000282 1789024644.411885 trunc from 0x0314f8 to 0x034161 (0x2c6a bytes) 000284 1789024644.568580 mapwrite 0x02ccb7 thru 0x0324d9 (0x5823 bytes) 000285 1789024644.670565 write 0x0185cc thru 0x027223 (0xec58 bytes) 000286 1789024644.679571 mapread 0x022542 thru 0x02cc63 (0xa722 bytes) 000288 1789024644.682660 mapwrite 0x028583 thru 0x034d6b (0xc7e9 bytes) 000289 1789024644.823312 read 0x025bad thru 0x027655 (0x1aa9 bytes) 000291 1789024644.834077 MIRROR_RESYNC 8 mirrors 000292 1789024647.285950 read 0x0335dd thru 0x034d6b (0x178f bytes) 000293 1789024647.292815 punch from 0x01bd84 to 0x02269c (0x6919 bytes) 000294 1789024647.431081 read 0x022d47 thru 0x02a554 (0x780e bytes) 000299 1789024647.456363 trunc from 0x034d6c to 0x017ba1 (0x1d1ca bytes) 000300 1789024647.484050 read 0x013fb0 thru 0x017ba1 (0x3bf2 bytes) 000301 1789024647.486384 read 0x012138 thru 0x017ba1 (0x5a6a bytes) 000302 1789024647.487199 mapwrite 0x005b04 thru 0x010b72 (0xb06f bytes) 000303 1789024647.546289 punch from 0x003b16 to 0x003e23 (0x30e bytes) 000304 1789024647.551124 trunc from 0x017ba2 to 0x0141d8 (0x39c9 bytes) 000305 1789024647.573665 mapread 0x00f7af thru 0x0141d8 (0x4a2a bytes) 000306 1789024647.575105 read 0x00da0f thru 0x012bf2 (0x51e4 bytes) 000307 1789024647.576246 trunc from 0x0141d9 to 0x000971 (0x13867 bytes) 000308 1789024647.605097 MIRROR_RESYNC 8 mirrors 000309 1789024649.147747 read 0x00096e thru 0x000971 (0x4 bytes) 000310 1789024649.157373 mapread 0x00077b thru 0x000971 (0x1f7 bytes) 000311 1789024649.157993 mapread 0x000732 thru 0x000971 (0x240 bytes) 000312 1789024649.163304 trunc from 0x000972 to 0x0328c9 (0x31f58 bytes) 000313 1789024649.295459 mapread 0x0227f7 thru 0x02d176 (0xa980 bytes) 000315 1789024649.347700 punch from 0x00f55e to 0x01ac1a (0xb6bd bytes) 000316 1789024649.358385 punch from 0x012b11 to 0x019f25 (0x7415 bytes) 000317 1789024649.364023 trunc from 0x0328ca to 0x011933 (0x20f96 bytes) 000318 1789024649.393977 write 0x0201e4 thru 0x026e0a (0x6c27 bytes) 000319 1789024649.396946 read 0x012c05 thru 0x01395c (0xd58 bytes) 000320 1789024649.405897 read 0x026a43 thru 0x026e0a (0x3c8 bytes) 000322 1789024649.407646 read 0x00fefd thru 0x014ce2 (0x4de6 bytes) 000323 1789024649.408380 write 0x035f0f thru 0x03ffff (0xa0f1 bytes) 000324 1789024649.410354 mapread 0x00ea5f thru 0x01b7ce (0xcd70 bytes) 000326 1789024649.412588 write 0x03513a thru 0x03ffff (0xaec6 bytes) 000327 1789024649.418093 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb10c30cc (stale) Mirror 7: 0xb10c30cc (stale) Mirror 8: 0xb10c30cc (stale) Mirror 9: 0xb10c30cc (stale) Mirror 10: 0xb10c30cc (stale) Mirror 11: 0xb10c30cc (stale) Mirror 12: 0xb10c30cc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf323407d Mirror 13: 0xf323407d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000329 1789024651.303879 punch from 0x025092 to 0x03429b (0xf20a bytes) 000330 1789024651.459235 write 0x0348e8 thru 0x03ffff (0xb718 bytes) 000331 1789024651.473738 punch from 0x03f9e6 to 0x03ffff (0x61a bytes) 000333 1789024651.491673 read 0x0338df thru 0x033b48 (0x26a bytes) 000334 1789024651.534022 mapread 0x03203e thru 0x03659b (0x455e bytes) 000335 1789024651.547655 mapwrite 0x00dc9c thru 0x010660 (0x29c5 bytes) 000337 1789024651.664051 mapread 0x01081d thru 0x01b7d6 (0xafba bytes) 000338 1789024651.689388 write 0x00db04 thru 0x01625a (0x8757 bytes) 000339 1789024651.691762 mapwrite 0x034d03 thru 0x0372ce (0x25cc bytes) 000340 1789024651.806029 mapwrite 0x021526 thru 0x0247b2 (0x328d bytes) 000342 1789024651.937959 punch from 0x00dfa9 to 0x01c1b7 (0xe20f bytes) 000343 1789024651.942913 read 0x03526b thru 0x03ffff (0xad95 bytes) 000345 1789024651.953231 read 0x032b4f thru 0x03f6bd (0xcb6f bytes) 000347 1789024651.957292 mapread 0x02f2bb thru 0x03b7a2 (0xc4e8 bytes) 000348 1789024651.960654 mapread 0x003356 thru 0x004025 (0xcd0 bytes) 000351 1789024651.965945 trunc from 0x040000 to 0x015891 (0x2a76e bytes) 000352 1789024652.003951 punch from 0x002922 to 0x00b36b (0x8a4a bytes) 000353 1789024652.014594 read 0x00b056 thru 0x015891 (0xa83c bytes) 000354 1789024652.030939 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x15892): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15892): Mirror 3: 0x5a80b47d (stale) Mirror 7: 0x5a80b47d (stale) Mirror 8: 0x5a80b47d (stale) Mirror 9: 0x5a80b47d (stale) Mirror 10: 0x5a80b47d (stale) Mirror 11: 0x5a80b47d (stale) Mirror 12: 0x5a80b47d (stale) Mirror 13: 0x5a80b47d (stale) CRC-32 checksum value for chunk [0, 0x15892): Mirror 1: 0xddb920db Mirror 14: 0xddb920db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15892: skipped 000356 1789024653.812978 MIRROR_RESYNC 10 mirrors 000357 1789024656.732697 write 0x00d99a thru 0x01bea8 (0xe50f bytes) 000359 1789024656.913527 mapwrite 0x005b30 thru 0x010497 (0xa968 bytes) 000360 1789024657.003813 write 0x03b59f thru 0x03ffff (0x4a61 bytes) 000361 1789024657.007724 mapread 0x01aa82 thru 0x01c00b (0x158a bytes) 000362 1789024657.017694 read 0x029685 thru 0x0318f9 (0x8275 bytes) 000363 1789024657.026516 punch from 0x00afd7 to 0x01552d (0xa557 bytes) 000364 1789024657.038660 punch from 0x00c7f7 to 0x01ad04 (0xe50e bytes) 000365 1789024657.043791 punch from 0x01500f to 0x0217a3 (0xc795 bytes) 000367 1789024657.048727 write 0x003d16 thru 0x01330b (0xf5f6 bytes) 000368 1789024657.064769 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4253e2cf (stale) Mirror 8: 0x4253e2cf (stale) Mirror 9: 0x4253e2cf (stale) Mirror 10: 0x4253e2cf (stale) Mirror 11: 0x4253e2cf (stale) Mirror 12: 0x4253e2cf (stale) Mirror 13: 0x4253e2cf (stale) Mirror 14: 0x4253e2cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4253e2cf (stale) Mirror 8: 0x4253e2cf (stale) Mirror 9: 0x4253e2cf (stale) Mirror 10: 0x4253e2cf (stale) Mirror 11: 0x4253e2cf (stale) Mirror 12: 0x4253e2cf (stale) Mirror 13: 0x4253e2cf (stale) Mirror 14: 0x4253e2cf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000369 1789024657.579678 write 0x0102ac thru 0x0126c3 (0x2418 bytes) 000372 1789024657.594923 read 0x0093ac thru 0x0098ff (0x554 bytes) 000373 1789024657.600702 trunc from 0x040000 to 0x005d02 (0x3a2fd bytes) 000374 1789024657.627463 MIRROR_RESYNC 9 mirrors 000377 1789024659.566389 read 0x0038f4 thru 0x003beb (0x2f8 bytes) 000378 1789024659.573030 mapread 0x0002fc thru 0x005d02 (0x5a07 bytes) 000379 1789024659.606042 trunc from 0x005d03 to 0x037832 (0x31b30 bytes) 000380 1789024659.751602 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37833): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37833): Mirror 3: 0xc2859fc8 (stale) Mirror 8: 0xc2859fc8 (stale) Mirror 9: 0xc2859fc8 (stale) Mirror 10: 0xc2859fc8 (stale) Mirror 11: 0xc2859fc8 (stale) Mirror 12: 0xc2859fc8 (stale) Mirror 13: 0xc2859fc8 (stale) Mirror 14: 0xc2859fc8 (stale) CRC-32 checksum value for chunk [0, 0x37833): Mirror 1: 0xc2859fc8 Mirror 15: 0xc2859fc8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37833: skipped 000381 1789024661.590988 punch from 0x0001bb to 0x0027f8 (0x263e bytes) 000382 1789024661.677684 mapread 0x0218bd thru 0x02ed43 (0xd487 bytes) 000383 1789024661.707993 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x37833): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37833): Mirror 3: 0xc2859fc8 (stale) Mirror 8: 0xc2859fc8 (stale) Mirror 9: 0xc2859fc8 (stale) Mirror 10: 0xc2859fc8 (stale) Mirror 11: 0xc2859fc8 (stale) Mirror 12: 0xc2859fc8 (stale) Mirror 13: 0xc2859fc8 (stale) Mirror 14: 0xc2859fc8 (stale) Mirror 15: 0xc2859fc8 (stale) CRC-32 checksum value for chunk [0, 0x37833): Mirror 1: 0xeef73eed Mirror 16: 0xeef73eed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37833: skipped 000385 1789024663.359609 read 0x004bac thru 0x005c0d (0x1062 bytes) 000389 1789024663.395476 mapread 0x00ccf0 thru 0x016944 (0x9c55 bytes) 000390 1789024663.436973 read 0x02c3d4 thru 0x037832 (0xb45f bytes) 000391 1789024663.458923 write 0x039fd7 thru 0x03b409 (0x1433 bytes) 000393 1789024663.577034 punch from 0x02e4fd to 0x03ae7b (0xc97f bytes) 000394 1789024663.631402 MIRROR_RESYNC 11 mirrors 000395 1789024666.700390 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) 000397 1789024667.490916 read 0x024f04 thru 0x026912 (0x1a0f bytes) 000399 1789024667.503533 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) 000402 1789024668.042559 write 0x03b511 thru 0x03ffff (0x4aef bytes) 000403 1789024668.176335 mapread 0x00baa2 thru 0x00e9f1 (0x2f50 bytes) 000404 1789024668.203470 punch from 0x002353 to 0x00fcea (0xd998 bytes) 000405 1789024668.240727 read 0x022dce thru 0x03109a (0xe2cd bytes) 000407 1789024668.268918 mapwrite 0x037411 thru 0x03ffff (0x8bef bytes) 000408 1789024668.445681 trunc from 0x040000 to 0x009f3b (0x360c4 bytes) 000410 1789024668.481969 read 0x003839 thru 0x007017 (0x37df bytes) 000411 1789024668.506907 mapread 0x001a54 thru 0x009f3b (0x84e8 bytes) 000412 1789024668.510025 punch from 0x001495 to 0x009f3b (0x8aa7 bytes) 000413 1789024668.524874 MIRROR_RESYNC 9 mirrors 000414 1789024671.221609 trunc from 0x009f3c to 0x03b085 (0x3114a bytes) 000415 1789024671.332290 write 0x01c618 thru 0x0275ee (0xafd7 bytes) 000416 1789024671.351707 trunc from 0x03b086 to 0x03757c (0x3b09 bytes) 000418 1789024671.377096 mapread 0x01d3ec thru 0x01e969 (0x157e bytes) 000419 1789024671.390793 MIRROR_RESYNC 9 mirrors 000420 1789024674.063335 mapread 0x003049 thru 0x00aa22 (0x79da bytes) 000423 1789024674.082520 mapread 0x003b65 thru 0x011c40 (0xe0dc bytes) 000424 1789024674.095857 MIRROR_EXTEND to 10 mirrors 000425 1789024675.376741 trunc from 0x03757d to 0x025e1d (0x1175f bytes) 000427 1789024675.485001 trunc from 0x025e1e to 0x025eb8 (0x9b bytes) 000429 1789024675.510717 mapread 0x018e93 thru 0x025eb8 (0xd026 bytes) 000430 1789024675.539799 MIRROR_RESYNC 10 mirrors 000432 1789024678.444403 read 0x010286 thru 0x01c16d (0xbee8 bytes) 000434 1789024678.464761 mapwrite 0x01a189 thru 0x01f2ba (0x5132 bytes) 000436 1789024678.658081 trunc from 0x025eb9 to 0x03d3c2 (0x1750a bytes) 000437 1789024678.679806 punch from 0x00d364 to 0x00f177 (0x1e14 bytes) 000439 1789024678.685743 write 0x01246f thru 0x01b559 (0x90eb bytes) 000440 1789024678.692852 mapwrite 0x03aef0 thru 0x03c32f (0x1440 bytes) 000441 1789024678.814105 punch from 0x01163b to 0x01fc51 (0xe617 bytes) 000442 1789024678.828989 read 0x024ab9 thru 0x02a778 (0x5cc0 bytes) 000443 1789024678.847354 punch from 0x030ad2 to 0x032748 (0x1c77 bytes) 000444 1789024678.865864 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d3c3): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3c3): Mirror 8: 0x29eab9e7 (stale) Mirror 10: 0x29eab9e7 (stale) Mirror 11: 0x29eab9e7 (stale) Mirror 12: 0x29eab9e7 (stale) Mirror 13: 0x29eab9e7 (stale) Mirror 14: 0x29eab9e7 (stale) Mirror 15: 0x29eab9e7 (stale) Mirror 16: 0x29eab9e7 (stale) Mirror 17: 0x29eab9e7 (stale) CRC-32 checksum value for chunk [0, 0x3d3c3): Mirror 1: 0x3d052d1c Mirror 18: 0x3d052d1c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3c3: skipped 000445 1789024680.500867 punch from 0x0239a7 to 0x02a362 (0x69bc bytes) 000447 1789024680.672752 mapwrite 0x03389b thru 0x035fed (0x2753 bytes) 000450 1789024680.739802 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d3c3): Mirror 10: 0x29eab9e7 (stale) Mirror 11: 0x29eab9e7 (stale) Mirror 12: 0x29eab9e7 (stale) Mirror 13: 0x29eab9e7 (stale) Mirror 14: 0x29eab9e7 (stale) Mirror 15: 0x29eab9e7 (stale) Mirror 16: 0x29eab9e7 (stale) Mirror 17: 0x29eab9e7 (stale) Mirror 18: 0x3d052d1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3c3): Mirror 10: 0x29eab9e7 (stale) Mirror 11: 0x29eab9e7 (stale) Mirror 12: 0x29eab9e7 (stale) Mirror 13: 0x29eab9e7 (stale) Mirror 14: 0x29eab9e7 (stale) Mirror 15: 0x29eab9e7 (stale) Mirror 16: 0x29eab9e7 (stale) Mirror 17: 0x29eab9e7 (stale) Mirror 18: 0x3d052d1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3c3: skipped 000451 1789024681.612217 punch from 0x029723 to 0x0327f1 (0x90cf bytes) 000452 1789024681.618063 mapread 0x002a8b thru 0x01130e (0xe884 bytes) 000453 1789024681.651279 write 0x005c61 thru 0x013c33 (0xdfd3 bytes) 000454 1789024681.652726 write 0x016e95 thru 0x025c2c (0xed98 bytes) 000455 1789024681.668906 read 0x02ab71 thru 0x0312c6 (0x6756 bytes) 000456 1789024681.676122 punch from 0x01dd1c to 0x02d2a7 (0xf58c bytes) 000457 1789024681.694664 trunc from 0x03d3c3 to 0x01b663 (0x21d5f bytes) 000458 1789024681.711744 mapread 0x00d3e7 thru 0x014f8f (0x7ba9 bytes) 000459 1789024681.717081 MIRROR_RESYNC 10 mirrors 000460 1789024683.357875 write 0x03f81b thru 0x03ffff (0x7e5 bytes) 000461 1789024683.554275 read 0x01a810 thru 0x01a849 (0x3a bytes) 000462 1789024683.567004 mapread 0x00aec0 thru 0x00c15f (0x12a0 bytes) 000463 1789024683.609396 punch from 0x026b33 to 0x02a57b (0x3a49 bytes) 000465 1789024683.640695 read 0x03cf98 thru 0x03f313 (0x237c bytes) 000466 1789024683.654502 punch from 0x00e09a to 0x0109be (0x2925 bytes) 000467 1789024683.663194 write 0x015ef9 thru 0x01ca2d (0x6b35 bytes) 000469 1789024683.665870 trunc from 0x040000 to 0x03c46a (0x3b95 bytes) 000472 1789024683.724419 mapread 0x039170 thru 0x03c46a (0x32fb bytes) 000474 1789024683.727802 mapwrite 0x035916 thru 0x03ef4b (0x9636 bytes) 000475 1789024683.845513 mapwrite 0x00eb06 thru 0x019080 (0xa57b bytes) 000477 1789024683.940961 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef4c): Mirror 10: 0x4519ccdd (stale) Mirror 11: 0x4519ccdd (stale) Mirror 12: 0x4519ccdd (stale) Mirror 13: 0x4519ccdd (stale) Mirror 14: 0x4519ccdd (stale) Mirror 15: 0x4519ccdd (stale) Mirror 17: 0x4519ccdd (stale) Mirror 18: 0x4519ccdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef4c): Mirror 10: 0x4519ccdd (stale) Mirror 11: 0x4519ccdd (stale) Mirror 12: 0x4519ccdd (stale) Mirror 13: 0x4519ccdd (stale) Mirror 14: 0x4519ccdd (stale) Mirror 15: 0x4519ccdd (stale) Mirror 17: 0x4519ccdd (stale) Mirror 18: 0x4519ccdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef4c: skipped 000478 1789024684.536891 mapread 0x00d37a thru 0x01384f (0x64d6 bytes) 000481 1789024684.562229 punch from 0x016ff8 to 0x026bbe (0xfbc7 bytes) 000482 1789024684.575862 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef4c): Mirror 10: 0x4519ccdd (stale) Mirror 12: 0x4519ccdd (stale) Mirror 13: 0x4519ccdd (stale) Mirror 14: 0x4519ccdd (stale) Mirror 15: 0x4519ccdd (stale) Mirror 17: 0x4519ccdd (stale) Mirror 18: 0x4519ccdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef4c): Mirror 10: 0x4519ccdd (stale) Mirror 12: 0x4519ccdd (stale) Mirror 13: 0x4519ccdd (stale) Mirror 14: 0x4519ccdd (stale) Mirror 15: 0x4519ccdd (stale) Mirror 17: 0x4519ccdd (stale) Mirror 18: 0x4519ccdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef4c: skipped 000483 1789024685.025645 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef4c): Mirror 10: 0x4519ccdd (stale) Mirror 12: 0x4519ccdd (stale) Mirror 14: 0x4519ccdd (stale) Mirror 15: 0x4519ccdd (stale) Mirror 17: 0x4519ccdd (stale) Mirror 18: 0x4519ccdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef4c): Mirror 10: 0x4519ccdd (stale) Mirror 12: 0x4519ccdd (stale) Mirror 14: 0x4519ccdd (stale) Mirror 15: 0x4519ccdd (stale) Mirror 17: 0x4519ccdd (stale) Mirror 18: 0x4519ccdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef4c: skipped 000484 1789024685.425582 mapwrite 0x019695 thru 0x023f4e (0xa8ba bytes) 000487 1789024685.496815 punch from 0x0295fa to 0x02c580 (0x2f87 bytes) 000489 1789024685.509870 read 0x029aeb thru 0x033476 (0x998c bytes) 000490 1789024685.517577 write 0x00eec4 thru 0x01e0b6 (0xf1f3 bytes) 000491 1789024685.525204 read 0x03b29b thru 0x03bd81 (0xae7 bytes) 000492 1789024685.536609 read 0x00ffe4 thru 0x017348 (0x7365 bytes) 000493 1789024685.537319 punch from 0x01b932 to 0x0241ab (0x887a bytes) 000494 1789024685.553089 mapwrite 0x03b76b thru 0x03e869 (0x30ff bytes) 000500 1789024685.637800 mapwrite 0x005237 thru 0x00c86b (0x7635 bytes) 000501 1789024685.701101 punch from 0x039f07 to 0x03e54d (0x4647 bytes) 000502 1789024685.711448 mapwrite 0x020af7 thru 0x027f8f (0x7499 bytes) 000506 1789024685.881849 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef4c): Mirror 10: 0x4519ccdd (stale) Mirror 12: 0x4519ccdd (stale) Mirror 14: 0x4519ccdd (stale) Mirror 15: 0x4519ccdd (stale) Mirror 17: 0x4519ccdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef4c): Mirror 10: 0x4519ccdd (stale) Mirror 12: 0x4519ccdd (stale) Mirror 14: 0x4519ccdd (stale) Mirror 15: 0x4519ccdd (stale) Mirror 17: 0x4519ccdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef4c: skipped 000507 1789024686.416253 write 0x00aa99 thru 0x01290c (0x7e74 bytes) 000509 1789024686.449857 trunc from 0x03ef4c to 0x039147 (0x5e04 bytes) 000511 1789024686.491059 mapread 0x00f0e7 thru 0x01b40a (0xc324 bytes) 000512 1789024686.528706 MIRROR_RESYNC 6 mirrors 000513 1789024688.844614 write 0x037bc1 thru 0x038b6c (0xfac bytes) 000515 1789024688.936206 trunc from 0x039148 to 0x003e56 (0x352f1 bytes) 000516 1789024688.972665 read 0x00140e thru 0x003e56 (0x2a49 bytes) 000517 1789024688.981837 mapread 0x003a58 thru 0x003e56 (0x3ff bytes) 000518 1789024688.985305 mapread 0x001a64 thru 0x003e56 (0x23f3 bytes) 000519 1789024688.986998 punch from 0x002c31 to 0x003e56 (0x1226 bytes) 000521 1789024688.998850 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e57): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e57): Mirror 10: 0x119d31b5 (stale) Mirror 12: 0x119d31b5 (stale) Mirror 14: 0x119d31b5 (stale) Mirror 15: 0x119d31b5 (stale) Mirror 17: 0x119d31b5 (stale) CRC-32 checksum value for chunk [0, 0x3e57): Mirror 1: 0x119d31b5 Mirror 18: 0x119d31b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e57: skipped 000522 1789024689.912981 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e57): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e57): Mirror 10: 0x119d31b5 (stale) Mirror 12: 0x119d31b5 (stale) Mirror 14: 0x119d31b5 (stale) Mirror 15: 0x119d31b5 (stale) Mirror 17: 0x119d31b5 (stale) CRC-32 checksum value for chunk [0, 0x3e57): Mirror 1: 0x119d31b5 Mirror 18: 0x119d31b5 Mirror 19: 0x119d31b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e57: skipped 000523 1789024690.944960 write 0x02ef40 thru 0x03e989 (0xfa4a bytes) 000524 1789024691.009857 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e98a): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e98a): Mirror 10: 0xaec8ee7f (stale) Mirror 12: 0xaec8ee7f (stale) Mirror 14: 0xaec8ee7f (stale) Mirror 15: 0xaec8ee7f (stale) Mirror 17: 0xaec8ee7f (stale) Mirror 18: 0x188fd275 (stale) Mirror 19: 0x188fd275 (stale) CRC-32 checksum value for chunk [0, 0x3e98a): Mirror 1: 0x4ce5d07e Mirror 20: 0x4ce5d07e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e98a: skipped 000525 1789024692.707432 punch from 0x033426 to 0x03e989 (0xb564 bytes) 000526 1789024692.793416 punch from 0x017e96 to 0x025ee0 (0xe04b bytes) 000528 1789024692.811761 punch from 0x00901c to 0x00ed6d (0x5d52 bytes) 000529 1789024692.821233 mapread 0x0149f6 thru 0x016b6d (0x2178 bytes) 000530 1789024692.883278 write 0x02dd6f thru 0x030f4e (0x31e0 bytes) 000533 1789024692.903763 read 0x03a240 thru 0x03e989 (0x474a bytes) 000534 1789024692.904977 read 0x033f0d thru 0x03bb37 (0x7c2b bytes) 000535 1789024692.914099 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e98a): Mirror 12: 0xaec8ee7f (stale) Mirror 14: 0xaec8ee7f (stale) Mirror 15: 0xaec8ee7f (stale) Mirror 17: 0xaec8ee7f (stale) Mirror 18: 0x188fd275 (stale) Mirror 19: 0x188fd275 (stale) Mirror 20: 0x4ce5d07e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e98a): Mirror 12: 0xaec8ee7f (stale) Mirror 14: 0xaec8ee7f (stale) Mirror 15: 0xaec8ee7f (stale) Mirror 17: 0xaec8ee7f (stale) Mirror 18: 0x188fd275 (stale) Mirror 19: 0x188fd275 (stale) Mirror 20: 0x4ce5d07e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e98a: skipped 000536 1789024693.425719 punch from 0x03b3c9 to 0x03e989 (0x35c1 bytes) 000537 1789024693.436543 MIRROR_RESYNC 8 mirrors 000538 1789024698.445949 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) 000539 1789024699.057624 MIRROR_EXTEND to 8 mirrors 000540 1789024700.601265 write 0x0080d2 thru 0x013634 (0xb563 bytes) 000542 1789024700.744415 MIRROR_RESYNC 8 mirrors 000543 1789024705.129525 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) 000544 1789024705.646737 write 0x02e2bd thru 0x03cd8d (0xead1 bytes) 000545 1789024705.743910 mapread 0x003658 thru 0x00b9da (0x8383 bytes) 000546 1789024705.778894 write 0x036ea0 thru 0x03ffff (0x9160 bytes) 000547 1789024705.781924 read 0x02b32c thru 0x0348ea (0x95bf bytes) 000549 1789024705.812297 trunc from 0x040000 to 0x01348e (0x2cb71 bytes) 000551 1789024705.879570 mapwrite 0x004c81 thru 0x008ce0 (0x4060 bytes) 000553 1789024706.051901 mapwrite 0x02925c thru 0x02fab7 (0x685c bytes) 000554 1789024706.144711 write 0x03cc92 thru 0x03ffff (0x336e bytes) 000556 1789024706.147257 trunc from 0x040000 to 0x001183 (0x3ee7c bytes) 000558 1789024706.174079 read 0x00027a thru 0x001183 (0xf0a bytes) 000561 1789024706.189820 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1184): Mirror 14: 0x5519df35 (stale) Mirror 15: 0x5519df35 (stale) Mirror 18: 0x5519df35 (stale) Mirror 19: 0x5519df35 (stale) Mirror 20: 0x5519df35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1184): Mirror 14: 0x5519df35 (stale) Mirror 15: 0x5519df35 (stale) Mirror 18: 0x5519df35 (stale) Mirror 19: 0x5519df35 (stale) Mirror 20: 0x5519df35 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1184: skipped 000562 1789024706.579415 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1184): Mirror 14: 0x5519df35 (stale) Mirror 15: 0x5519df35 (stale) Mirror 19: 0x5519df35 (stale) Mirror 20: 0x5519df35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1184): Mirror 14: 0x5519df35 (stale) Mirror 15: 0x5519df35 (stale) Mirror 19: 0x5519df35 (stale) Mirror 20: 0x5519df35 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1184: skipped 000563 1789024706.927110 read 0x000228 thru 0x001183 (0xf5c bytes) 000564 1789024706.936084 mapread 0x00033a thru 0x001183 (0xe4a bytes) 000566 1789024706.944464 write 0x005572 thru 0x008695 (0x3124 bytes) 000567 1789024706.945848 mapwrite 0x025f97 thru 0x026759 (0x7c3 bytes) 000569 1789024707.112989 trunc from 0x02675a to 0x036bab (0x10452 bytes) 000570 1789024707.149413 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x36bac): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36bac): Mirror 14: 0x34ebfdcd (stale) Mirror 15: 0x34ebfdcd (stale) Mirror 19: 0x34ebfdcd (stale) Mirror 20: 0x34ebfdcd (stale) CRC-32 checksum value for chunk [0, 0x36bac): Mirror 1: 0x213bb9c0 Mirror 21: 0x213bb9c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36bac: skipped 000571 1789024709.112799 punch from 0x02a9ed to 0x0349b9 (0x9fcd bytes) 000572 1789024709.263687 punch from 0x019573 to 0x01e824 (0x52b2 bytes) 000573 1789024709.278396 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36bac): Mirror 15: 0x34ebfdcd (stale) Mirror 19: 0x34ebfdcd (stale) Mirror 20: 0x34ebfdcd (stale) Mirror 21: 0x213bb9c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36bac): Mirror 15: 0x34ebfdcd (stale) Mirror 19: 0x34ebfdcd (stale) Mirror 20: 0x34ebfdcd (stale) Mirror 21: 0x213bb9c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36bac: skipped 000574 1789024709.770810 read 0x00a031 thru 0x00fb12 (0x5ae2 bytes) 000575 1789024709.787923 MIRROR_RESYNC 5 mirrors 000576 1789024711.969257 write 0x03ba6a thru 0x03ffff (0x4596 bytes) 000577 1789024712.041572 mapread 0x0088df thru 0x0150eb (0xc80d bytes) 000578 1789024712.078977 mapread 0x0199ba thru 0x021f20 (0x8567 bytes) 000579 1789024712.089415 mapwrite 0x01f6fd thru 0x023dd4 (0x46d8 bytes) 000580 1789024712.156202 write 0x01aeab thru 0x01d145 (0x229b bytes) 000581 1789024712.157329 punch from 0x0090de to 0x013529 (0xa44c bytes) 000583 1789024712.177367 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xd69e12ae (stale) Mirror 19: 0xd69e12ae (stale) Mirror 20: 0xd69e12ae (stale) Mirror 21: 0xd69e12ae (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x356d19c9 Mirror 22: 0x356d19c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000584 1789024713.639035 read 0x0014fb thru 0x0024ed (0xff3 bytes) 000585 1789024713.653924 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xd69e12ae (stale) Mirror 19: 0xd69e12ae (stale) Mirror 20: 0xd69e12ae (stale) Mirror 21: 0xd69e12ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xd69e12ae (stale) Mirror 19: 0xd69e12ae (stale) Mirror 20: 0xd69e12ae (stale) Mirror 21: 0xd69e12ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000590 1789024714.084824 write 0x01c52c thru 0x0299b3 (0xd488 bytes) 000591 1789024714.110647 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xd69e12ae (stale) Mirror 20: 0xd69e12ae (stale) Mirror 21: 0xd69e12ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xd69e12ae (stale) Mirror 20: 0xd69e12ae (stale) Mirror 21: 0xd69e12ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000593 1789024714.541277 mapread 0x032bb5 thru 0x03d238 (0xa684 bytes) 000594 1789024714.561754 mapread 0x01cc74 thru 0x026e0e (0xa19b bytes) 000595 1789024714.580216 trunc from 0x040000 to 0x020350 (0x1fcaf bytes) 000597 1789024714.597842 write 0x01f8ed thru 0x026d87 (0x749b bytes) 000599 1789024714.601806 mapwrite 0x00bb5c thru 0x00c5ea (0xa8f bytes) 000607 1789024714.657223 mapread 0x01e7b2 thru 0x023ec5 (0x5714 bytes) 000608 1789024714.662369 trunc from 0x026d88 to 0x0131c5 (0x13bc2 bytes) 000609 1789024714.732418 MIRROR_RESYNC 4 mirrors 000610 1789024715.964884 mapwrite 0x02f60c thru 0x03b79f (0xc194 bytes) 000611 1789024716.145763 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3b7a0): Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7a0): Mirror 15: 0x8d0a43d3 (stale) Mirror 20: 0x8d0a43d3 (stale) Mirror 21: 0x8d0a43d3 (stale) CRC-32 checksum value for chunk [0, 0x3b7a0): Mirror 1: 0x7246599c Mirror 22: 0x7246599c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7a0: skipped 000613 1789024717.162564 mapwrite 0x02bc68 thru 0x03b970 (0xfd09 bytes) 000614 1789024717.347107 mapwrite 0x022646 thru 0x022954 (0x30f bytes) 000615 1789024717.388660 write 0x036e3b thru 0x03cccd (0x5e93 bytes) 000617 1789024717.391820 read 0x02b73e thru 0x038355 (0xcc18 bytes) 000618 1789024717.395652 write 0x021678 thru 0x02f5a4 (0xdf2d bytes) 000619 1789024717.402839 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ccce): Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ccce): Mirror 15: 0x9c55c35c (stale) Mirror 20: 0x9c55c35c (stale) Mirror 21: 0x9c55c35c (stale) Mirror 22: 0x375fe00d (stale) CRC-32 checksum value for chunk [0, 0x3ccce): Mirror 1: 0x88bdc3ba Mirror 23: 0x88bdc3ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ccce: skipped 000620 1789024718.882759 write 0x01c597 thru 0x020489 (0x3ef3 bytes) 000621 1789024718.991103 mapread 0x016ef7 thru 0x0211d5 (0xa2df bytes) 000622 1789024719.025203 write 0x0363e9 thru 0x03900d (0x2c25 bytes) 000625 1789024719.043352 write 0x03a7e3 thru 0x03d7cd (0x2feb bytes) 000627 1789024719.046828 read 0x03d779 thru 0x03d7cd (0x55 bytes) 000628 1789024719.050225 write 0x001a89 thru 0x00eaa8 (0xd020 bytes) 000630 1789024719.066585 mapwrite 0x023e54 thru 0x0245f3 (0x7a0 bytes) 000631 1789024719.147366 mapread 0x007198 thru 0x008878 (0x16e1 bytes) 000632 1789024719.151251 trunc from 0x03d7ce to 0x01915f (0x2466e bytes) 000633 1789024719.181083 read 0x00af45 thru 0x013d4f (0x8e0b bytes) truncating to largest ever: 0x3fcfb 000634 1789024719.198381 trunc from 0x019160 to 0x03fcfa (0x26b9b bytes) 000635 1789024719.221553 trunc from 0x03fcfb to 0x01ed57 (0x20fa3 bytes) 000636 1789024719.264053 write 0x004f88 thru 0x013e11 (0xee8a bytes) 000637 1789024719.268617 mapwrite 0x02a15b thru 0x036728 (0xc5ce bytes) 000640 1789024719.416331 trunc from 0x036729 to 0x037b9d (0x1475 bytes) 000642 1789024719.439397 mapread 0x036d76 thru 0x037b9d (0xe28 bytes) 000644 1789024719.463457 mapwrite 0x03b66d thru 0x03ffff (0x4993 bytes) 000647 1789024719.595231 trunc from 0x040000 to 0x02d8a9 (0x12756 bytes) 000648 1789024719.648661 read 0x00dc1b thru 0x0155f9 (0x79df bytes) 000652 1789024719.653091 punch from 0x00bfe8 to 0x01a442 (0xe45b bytes) 000655 1789024719.660762 read 0x02496d thru 0x02d8a9 (0x8f3d bytes) 000656 1789024719.672494 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d8aa): Mirror 20: 0xf08453e8 (stale) Mirror 21: 0xf08453e8 (stale) Mirror 22: 0xf08453e8 (stale) Mirror 23: 0xff06bc7b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d8aa): Mirror 20: 0xf08453e8 (stale) Mirror 21: 0xf08453e8 (stale) Mirror 22: 0xf08453e8 (stale) Mirror 23: 0xff06bc7b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d8aa: skipped 000657 1789024720.138120 read 0x01fd60 thru 0x027967 (0x7c08 bytes) 000658 1789024720.148785 read 0x0123d4 thru 0x017e37 (0x5a64 bytes) 000659 1789024720.160749 punch from 0x00a6ef to 0x00c538 (0x1e4a bytes) 000661 1789024720.169414 write 0x0156e3 thru 0x0159ed (0x30b bytes) 000662 1789024720.171687 mapread 0x012cc6 thru 0x015061 (0x239c bytes) 000663 1789024720.172767 mapwrite 0x02a74c thru 0x02c6c8 (0x1f7d bytes) 000664 1789024720.262270 punch from 0x0271d9 to 0x028f3b (0x1d63 bytes) 000666 1789024720.280189 read 0x016668 thru 0x021dd5 (0xb76e bytes) 000667 1789024720.282868 mapwrite 0x004556 thru 0x00e936 (0xa3e1 bytes) 000668 1789024720.426028 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d8aa): Mirror 20: 0xf08453e8 (stale) Mirror 21: 0xf08453e8 (stale) Mirror 22: 0xf08453e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d8aa): Mirror 20: 0xf08453e8 (stale) Mirror 21: 0xf08453e8 (stale) Mirror 22: 0xf08453e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d8aa: skipped 000669 1789024720.703329 MIRROR_RESYNC 4 mirrors 000670 1789024722.408355 MIRROR_RESYNC 4 mirrors 000671 1789024722.831573 trunc from 0x02d8aa to 0x01eba4 (0xed05 bytes) 000672 1789024722.927780 mapread 0x00dee0 thru 0x012ecd (0x4fee bytes) 000673 1789024722.945486 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1eba5): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eba5): Mirror 20: 0x67f71b0f (stale) Mirror 21: 0x67f71b0f (stale) Mirror 22: 0x67f71b0f (stale) CRC-32 checksum value for chunk [0, 0x1eba5): Mirror 1: 0x67f71b0f Mirror 23: 0x67f71b0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eba5: skipped 000675 1789024724.419476 trunc from 0x01eba5 to 0x01ce40 (0x1d64 bytes) 000676 1789024724.484741 punch from 0x0146c6 to 0x01ce40 (0x877b bytes) 000678 1789024724.500006 mapread 0x002aec thru 0x00dc05 (0xb11a bytes) 000680 1789024724.557740 mapread 0x005277 thru 0x011f99 (0xcd23 bytes) 000682 1789024724.570795 mapread 0x0019a5 thru 0x009225 (0x7881 bytes) 000683 1789024724.571949 mapread 0x015fbe thru 0x01ce40 (0x6e83 bytes) 000684 1789024724.579199 mapread 0x015322 thru 0x01945a (0x4139 bytes) 000685 1789024724.580388 punch from 0x007574 to 0x011703 (0xa190 bytes) 000686 1789024724.586180 trunc from 0x01ce41 to 0x003674 (0x197cc bytes) 000687 1789024724.617257 read 0x001643 thru 0x003674 (0x2032 bytes) 000688 1789024724.618401 trunc from 0x003675 to 0x031103 (0x2da8f bytes) 000689 1789024724.634865 trunc from 0x031104 to 0x01c821 (0x148e2 bytes) 000690 1789024724.654064 punch from 0x01835d to 0x01a0ed (0x1d91 bytes) 000691 1789024724.658256 mapread 0x017882 thru 0x01c821 (0x4fa0 bytes) 000692 1789024724.669505 mapread 0x00fc3d thru 0x0171ee (0x75b2 bytes) 000693 1789024724.678495 punch from 0x00d66e to 0x01c821 (0xf1b4 bytes) 000694 1789024724.683754 write 0x01d69c thru 0x02312c (0x5a91 bytes) 000695 1789024724.709393 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2312d): Mirror 21: 0x5747470a (stale) Mirror 22: 0x5747470a (stale) Mirror 23: 0x5747470a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2312d): Mirror 21: 0x5747470a (stale) Mirror 22: 0x5747470a (stale) Mirror 23: 0x5747470a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2312d: skipped 000696 1789024725.286009 punch from 0x008bbc to 0x00ab69 (0x1fae bytes) 000698 1789024725.291082 mapwrite 0x035348 thru 0x03eae6 (0x979f bytes) 000699 1789024725.389914 trunc from 0x03eae7 to 0x0340c4 (0xaa22 bytes) 000700 1789024725.421233 trunc from 0x0340c5 to 0x0254fd (0xebc7 bytes) 000702 1789024725.454355 mapread 0x0178a9 thru 0x024654 (0xcdac bytes) 000704 1789024725.501376 trunc from 0x0254fe to 0x00aa4f (0x1aaae bytes) 000705 1789024725.537115 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xaa50): Mirror 21: 0x3cc65c2b (stale) Mirror 22: 0x3cc65c2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xaa50): Mirror 21: 0x3cc65c2b (stale) Mirror 22: 0x3cc65c2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xaa50: skipped 000707 1789024725.937201 write 0x03bf4f thru 0x03ffff (0x40b1 bytes) 000708 1789024725.938785 write 0x00aef7 thru 0x00d744 (0x284e bytes) 000709 1789024725.953725 mapwrite 0x039ad6 thru 0x03ffff (0x652a bytes) 000710 1789024726.059101 mapread 0x016eda thru 0x017858 (0x97f bytes) 000711 1789024726.072563 punch from 0x004e56 to 0x00971a (0x48c5 bytes) 000713 1789024726.085175 punch from 0x0078b7 to 0x00b87d (0x3fc7 bytes) 000714 1789024726.091283 mapread 0x017800 thru 0x024d83 (0xd584 bytes) 000716 1789024726.107116 mapread 0x01e7d0 thru 0x02ccca (0xe4fb bytes) 000717 1789024726.122224 write 0x02f7e8 thru 0x03e91a (0xf133 bytes) 000719 1789024726.125083 mapread 0x01a0e5 thru 0x01d609 (0x3525 bytes) 000720 1789024726.126806 write 0x01e62d thru 0x02158f (0x2f63 bytes) 000721 1789024726.128386 mapread 0x017959 thru 0x017b8c (0x234 bytes) 000722 1789024726.130604 read 0x03c289 thru 0x03ffff (0x3d77 bytes) 000723 1789024726.131831 trunc from 0x040000 to 0x02ef09 (0x110f6 bytes) 000724 1789024726.150764 trunc from 0x02ef0a to 0x01c570 (0x12999 bytes) 000726 1789024726.209954 mapread 0x008a7a thru 0x00f841 (0x6dc8 bytes) 000727 1789024726.241583 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1c571): Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c571): Mirror 21: 0x35d7db9c (stale) Mirror 22: 0x35d7db9c (stale) CRC-32 checksum value for chunk [0, 0x1c571): Mirror 1: 0x41737999 Mirror 23: 0x41737999 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c571: skipped 000730 1789024727.651998 write 0x039601 thru 0x03ffff (0x69ff bytes) 000731 1789024727.738694 write 0x008c9f thru 0x00b016 (0x2378 bytes) 000732 1789024727.755768 write 0x035880 thru 0x03bcdc (0x645d bytes) 000733 1789024727.764183 punch from 0x022e60 to 0x02c150 (0x92f1 bytes) 000734 1789024727.791561 mapwrite 0x01556f thru 0x01bc73 (0x6705 bytes) 000735 1789024727.862526 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x7ab42570 (stale) Mirror 23: 0x3f73f3f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x7ab42570 (stale) Mirror 23: 0x3f73f3f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000736 1789024728.263040 mapread 0x031963 thru 0x031b2f (0x1cd bytes) 000737 1789024728.280246 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0x3f73f3f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0x3f73f3f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000738 1789024728.687231 trunc from 0x040000 to 0x01ce65 (0x2319a bytes) 000739 1789024728.708932 mapwrite 0x030fad thru 0x039706 (0x875a bytes) 000740 1789024728.870783 mapread 0x036470 thru 0x0374b8 (0x1049 bytes) 000741 1789024728.872274 write 0x039bcb thru 0x03ffff (0x6435 bytes) 000745 1789024728.877363 trunc from 0x040000 to 0x01196d (0x2e692 bytes) 000747 1789024728.912000 mapread 0x010748 thru 0x01196d (0x1226 bytes) 000749 1789024728.963369 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1196e): Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1196e): Mirror 23: 0x9e57b28b (stale) CRC-32 checksum value for chunk [0, 0x1196e): Mirror 1: 0xfc726d99 Mirror 24: 0xfc726d99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1196e: skipped 000750 1789024730.387245 mapread 0x007d48 thru 0x01196d (0x9c26 bytes) 000751 1789024730.414570 mapwrite 0x0305ef thru 0x03abbe (0xa5d0 bytes) 000752 1789024730.770389 mapread 0x018af1 thru 0x01fd7d (0x728d bytes) 000754 1789024730.807742 trunc from 0x03abbf to 0x004572 (0x3664c bytes) 000755 1789024730.864948 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4573): Mirror 24: 0x33bb8620 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4573): Mirror 24: 0x33bb8620 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4573: skipped 000756 1789024731.228395 mapwrite 0x00cbd6 thru 0x00f2e9 (0x2714 bytes) 000757 1789024731.328765 punch from 0x005c4e to 0x00e451 (0x8804 bytes) 000758 1789024731.338304 mapwrite 0x01b7e8 thru 0x0207a5 (0x4fbe bytes) 000759 1789024731.442038 read 0x014415 thru 0x01fcad (0xb899 bytes) 000760 1789024731.442800 punch from 0x0019cf to 0x003289 (0x18bb bytes) 000761 1789024731.455447 punch from 0x01b461 to 0x01eb14 (0x36b4 bytes) 000763 1789024731.464843 punch from 0x00428b to 0x00ff5b (0xbcd1 bytes) 000764 1789024731.477412 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x207a6): Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x207a6): Mirror 24: 0x1326f7bf (stale) CRC-32 checksum value for chunk [0, 0x207a6): Mirror 1: 0x7c6adcb8 Mirror 25: 0x7c6adcb8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x207a6: skipped 000765 1789024733.129126 punch from 0x00785d to 0x01045a (0x8bfe bytes) 000766 1789024733.277068 write 0x03040f thru 0x030f47 (0xb39 bytes) 000767 1789024733.287930 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30f48): Mirror 25: 0xe3e04487 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30f48): Mirror 25: 0xe3e04487 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30f48: skipped 000768 1789024733.649692 mapwrite 0x029111 thru 0x02c6f6 (0x35e6 bytes) 000770 1789024733.735076 read 0x01e571 thru 0x0297fe (0xb28e bytes) 000772 1789024733.745298 read 0x0035a2 thru 0x00f07e (0xbadd bytes) 000775 1789024733.758534 write 0x00b003 thru 0x016eeb (0xbee9 bytes) 000776 1789024733.760200 punch from 0x01d688 to 0x025367 (0x7ce0 bytes) 000777 1789024733.772556 trunc from 0x030f48 to 0x01e29f (0x12ca8 bytes) 000778 1789024733.799490 trunc from 0x01e2a0 to 0x020a07 (0x2768 bytes) 000779 1789024733.816521 trunc from 0x020a08 to 0x02262a (0x1c23 bytes) 000780 1789024733.828319 write 0x00e2e5 thru 0x012f68 (0x4c84 bytes) 000782 1789024733.829937 punch from 0x00d348 to 0x01d179 (0xfe32 bytes) 000783 1789024733.842066 mapread 0x006cbd thru 0x012d9c (0xc0e0 bytes) 000784 1789024733.871093 punch from 0x01f165 to 0x02262a (0x34c6 bytes) 000785 1789024733.874667 punch from 0x002394 to 0x00ad65 (0x89d2 bytes) 000787 1789024733.880949 write 0x013d1c thru 0x01ec25 (0xaf0a bytes) 000788 1789024733.896884 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2262b): Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2262b): Mirror 25: 0x6f78c607 (stale) CRC-32 checksum value for chunk [0, 0x2262b): Mirror 1: 0xcd6598d0 Mirror 26: 0xcd6598d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2262b: skipped 000789 1789024734.886399 mapwrite 0x000f92 thru 0x005985 (0x49f4 bytes) 000792 1789024735.236738 mapwrite 0x035ac3 thru 0x03668a (0xbc8 bytes) 000793 1789024735.560701 punch from 0x031939 to 0x03668a (0x4d52 bytes) 000795 1789024735.567950 mapwrite 0x021fd1 thru 0x02c1b1 (0xa1e1 bytes) 000800 1789024735.740032 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3668b): Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3668b): Mirror 25: 0x9328ccc0 (stale) Mirror 26: 0xdaaae66b (stale) CRC-32 checksum value for chunk [0, 0x3668b): Mirror 1: 0x3c27e013 Mirror 27: 0x3c27e013 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3668b: skipped 000801 1789024737.230261 trunc from 0x03668b to 0x026a0a (0xfc80 bytes) 000802 1789024737.426518 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26a0b): Mirror 25: 0x946cb5d0 (stale) Mirror 26: 0x785b9ab6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26a0b): Mirror 25: 0x946cb5d0 (stale) Mirror 26: 0x785b9ab6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26a0b: skipped 000805 1789024737.796239 mapread 0x011ab0 thru 0x020b41 (0xf092 bytes) 000806 1789024737.872056 read 0x01b901 thru 0x0261b8 (0xa8b8 bytes) 000807 1789024737.891055 mapwrite 0x00e404 thru 0x00ed5b (0x958 bytes) 000808 1789024737.983301 punch from 0x0258b3 to 0x026a0a (0x1158 bytes) 000809 1789024738.006324 mapread 0x015199 thru 0x01c618 (0x7480 bytes) 000810 1789024738.011630 trunc from 0x026a0b to 0x006256 (0x207b4 bytes) 000813 1789024738.059044 mapwrite 0x03b5de thru 0x03ffff (0x4a22 bytes) 000815 1789024738.143860 MIRROR_RESYNC 3 mirrors 000817 1789024739.437018 punch from 0x03d370 to 0x03ffff (0x2c90 bytes) 000818 1789024739.651513 punch from 0x00cdab to 0x0193f2 (0xc648 bytes) 000820 1789024739.660682 read 0x03d44e thru 0x03ffff (0x2bb2 bytes) 000821 1789024739.668031 write 0x0003c8 thru 0x00dd45 (0xd97e bytes) 000824 1789024739.686869 trunc from 0x040000 to 0x01f347 (0x20cb8 bytes) 000826 1789024739.802751 mapread 0x01a3be thru 0x01f347 (0x4f8a bytes) 000827 1789024739.844843 punch from 0x01b364 to 0x01f347 (0x3fe4 bytes) 000828 1789024739.861426 trunc from 0x01f348 to 0x017c6c (0x76db bytes) 000829 1789024739.889207 write 0x013656 thru 0x01ef9e (0xb949 bytes) 000830 1789024739.896073 punch from 0x00bdd6 to 0x00fd46 (0x3f71 bytes) 000831 1789024739.911552 read 0x00df71 thru 0x01dd46 (0xfdd6 bytes) 000833 1789024739.940503 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ef9f): Mirror 26: 0x89ea8ce6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ef9f): Mirror 26: 0x89ea8ce6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ef9f: skipped 000834 1789024740.343490 mapwrite 0x032a78 thru 0x03c824 (0x9dad bytes) 000836 1789024740.430063 read 0x00f12d thru 0x0157b0 (0x6684 bytes) 000838 1789024740.436236 write 0x00ccfa thru 0x0191ed (0xc4f4 bytes) 000839 1789024740.445209 mapread 0x012f18 thru 0x014f46 (0x202f bytes) 000840 1789024740.446249 write 0x03ece0 thru 0x03ffff (0x1320 bytes) 000844 1789024740.448816 mapwrite 0x00058f thru 0x00ab78 (0xa5ea bytes) 000845 1789024740.518383 punch from 0x000179 to 0x0021d4 (0x205c bytes) 000846 1789024740.523599 trunc from 0x040000 to 0x025cf5 (0x1a30a bytes) 000847 1789024740.538174 mapwrite 0x02070b thru 0x02d195 (0xca8b bytes) 000848 1789024740.610519 write 0x02ae86 thru 0x03adbd (0xff38 bytes) 000849 1789024740.612097 mapread 0x02ae8a thru 0x03699b (0xbb12 bytes) 000850 1789024740.612981 mapwrite 0x039363 thru 0x03ffff (0x6c9d bytes) 000851 1789024740.731082 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 26: 0x68cab250 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2dd55bb1 Mirror 27: 0x2dd55bb1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000852 1789024741.670771 trunc from 0x040000 to 0x03353a (0xcac5 bytes) 000853 1789024741.786518 punch from 0x019100 to 0x0191d8 (0xd9 bytes) 000854 1789024741.794559 mapread 0x00a65f thru 0x01541e (0xadc0 bytes) 000856 1789024741.826685 punch from 0x023197 to 0x025d8a (0x2bf4 bytes) 000857 1789024741.832680 punch from 0x00b6d6 to 0x0105e1 (0x4f0c bytes) 000859 1789024741.838529 write 0x00272a thru 0x003dde (0x16b5 bytes) 000861 1789024741.862711 read 0x01c667 thru 0x01f811 (0x31ab bytes) 000864 1789024741.871756 punch from 0x013cd3 to 0x0192fc (0x562a bytes) 000866 1789024741.895331 MIRROR_RESYNC 3 mirrors 000868 1789024743.362656 MIRROR_EXTEND to 4 mirrors 000869 1789024744.855725 MIRROR_RESYNC 4 mirrors 000870 1789024745.283731 trunc from 0x03353b to 0x013378 (0x201c2 bytes) 000871 1789024745.363100 mapwrite 0x000ba5 thru 0x009c6a (0x90c6 bytes) 000873 1789024745.459018 mapread 0x00ce91 thru 0x013378 (0x64e8 bytes) 000874 1789024745.466190 mapwrite 0x009d1e thru 0x0105d4 (0x68b7 bytes) 000876 1789024745.510917 trunc from 0x013379 to 0x0138b6 (0x53e bytes) 000877 1789024745.530548 mapwrite 0x01ac5d thru 0x024c20 (0x9fc4 bytes) 000878 1789024745.609310 punch from 0x024591 to 0x024c20 (0x690 bytes) 000879 1789024745.615416 mapread 0x00021f thru 0x009a11 (0x97f3 bytes) 000880 1789024745.616484 punch from 0x001b24 to 0x010d33 (0xf210 bytes) 000881 1789024745.623202 punch from 0x0150f0 to 0x0249f4 (0xf905 bytes) 000882 1789024745.627642 write 0x00f8d2 thru 0x01bb11 (0xc240 bytes) 000884 1789024745.646955 mapread 0x011558 thru 0x015890 (0x4339 bytes) 000888 1789024745.650877 mapwrite 0x003033 thru 0x005f98 (0x2f66 bytes) 000889 1789024745.754319 mapwrite 0x02c4e1 thru 0x02e2e2 (0x1e02 bytes) 000891 1789024745.842688 mapread 0x01e4d3 thru 0x02b8eb (0xd419 bytes) 000892 1789024745.855642 write 0x03eb0b thru 0x03ffff (0x14f5 bytes) 000893 1789024745.861450 mapwrite 0x02e7b2 thru 0x035002 (0x6851 bytes) 000894 1789024745.920122 read 0x02a5e8 thru 0x02e7a3 (0x41bc bytes) 000895 1789024745.920908 trunc from 0x040000 to 0x006201 (0x39dfe bytes) 000896 1789024745.935937 read 0x0040b6 thru 0x006201 (0x214c bytes) 000897 1789024745.937482 mapwrite 0x029500 thru 0x02eceb (0x57ec bytes) 000899 1789024746.009965 write 0x035af8 thru 0x03ffff (0xa508 bytes) 000900 1789024746.011934 trunc from 0x040000 to 0x027de4 (0x1821b bytes) 000901 1789024746.048537 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27de5): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27de5): Mirror 26: 0x10a1cce (stale) Mirror 27: 0x10a1cce (stale) Mirror 28: 0x10a1cce (stale) CRC-32 checksum value for chunk [0, 0x27de5): Mirror 1: 0xdbf8c28e Mirror 29: 0xdbf8c28e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27de5: skipped 000903 1789024747.318983 write 0x03b58f thru 0x03ffff (0x4a71 bytes) 000904 1789024747.385460 punch from 0x00380d to 0x0091fa (0x59ee bytes) 000905 1789024747.397614 punch from 0x024e77 to 0x0310eb (0xc275 bytes) 000906 1789024747.402097 trunc from 0x040000 to 0x005e71 (0x3a18e bytes) 000907 1789024747.427812 read 0x001da2 thru 0x002ef7 (0x1156 bytes) 000908 1789024747.432732 mapread 0x0017cc thru 0x005e71 (0x46a6 bytes) 000909 1789024747.455193 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x5e72): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5e72): Mirror 26: 0x30185d6b (stale) Mirror 27: 0x30185d6b (stale) Mirror 28: 0x30185d6b (stale) Mirror 29: 0x25a4f05f (stale) CRC-32 checksum value for chunk [0, 0x5e72): Mirror 1: 0x7e6dab52 Mirror 30: 0x7e6dab52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5e72: skipped 000910 1789024748.440806 punch from 0x004490 to 0x005e71 (0x19e2 bytes) 000911 1789024748.572610 punch from 0x000046 to 0x0042cd (0x4288 bytes) 000912 1789024748.581657 mapwrite 0x025f89 thru 0x0338f3 (0xd96b bytes) 000913 1789024748.735252 mapread 0x0076ff thru 0x00ff08 (0x880a bytes) 000914 1789024748.748305 trunc from 0x0338f4 to 0x012142 (0x217b1 bytes) 000917 1789024748.779780 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12143): Mirror 26: 0xcf58f5e8 (stale) Mirror 27: 0xcf58f5e8 (stale) Mirror 28: 0xcf58f5e8 (stale) Mirror 29: 0xb007acc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12143): Mirror 26: 0xcf58f5e8 (stale) Mirror 27: 0xcf58f5e8 (stale) Mirror 28: 0xcf58f5e8 (stale) Mirror 29: 0xb007acc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12143: skipped 000918 1789024749.340112 MIRROR_RESYNC 5 mirrors 000919 1789024750.592922 write 0x036506 thru 0x03c5ee (0x60e9 bytes) 000920 1789024750.749197 mapread 0x02ea6f thru 0x031083 (0x2615 bytes) 000921 1789024750.774360 mapwrite 0x004f1b thru 0x008906 (0x39ec bytes) 000925 1789024750.843360 mapwrite 0x012815 thru 0x01bb09 (0x92f5 bytes) 000926 1789024750.902309 mapread 0x034e91 thru 0x037e6c (0x2fdc bytes) 000927 1789024750.903661 punch from 0x0130df to 0x017017 (0x3f39 bytes) 000929 1789024750.910171 write 0x0061e2 thru 0x007774 (0x1593 bytes) 000931 1789024750.912443 mapread 0x01ea4e thru 0x02e9d6 (0xff89 bytes) 000932 1789024750.920995 mapwrite 0x020413 thru 0x02c502 (0xc0f0 bytes) 000933 1789024750.977332 punch from 0x029d6b to 0x031035 (0x72cb bytes) 000934 1789024750.983917 punch from 0x007e6e to 0x015d62 (0xdef5 bytes) 000935 1789024750.992113 mapwrite 0x00258c thru 0x00e41a (0xbe8f bytes) 000936 1789024751.065562 mapread 0x02182b thru 0x024e4a (0x3620 bytes) 000938 1789024751.068518 read 0x001e7f thru 0x009865 (0x79e7 bytes) 000940 1789024751.072100 mapwrite 0x00549f thru 0x006a3d (0x159f bytes) 000941 1789024751.120198 read 0x02addf thru 0x037a10 (0xcc32 bytes) 000942 1789024751.140573 mapread 0x032395 thru 0x03c5ee (0xa25a bytes) 000943 1789024751.143347 mapread 0x011964 thru 0x0134d8 (0x1b75 bytes) 000944 1789024751.153881 MIRROR_RESYNC 5 mirrors 000946 1789024754.104194 trunc from 0x03c5ef to 0x010102 (0x2c4ec bytes) 000947 1789024754.282073 punch from 0x001afb to 0x00af18 (0x941e bytes) 000948 1789024754.288381 read 0x0071dc thru 0x00c870 (0x5695 bytes) 000949 1789024754.295617 read 0x005111 thru 0x010102 (0xaff2 bytes) 000950 1789024754.307564 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x10103): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10103): Mirror 26: 0xce8a81c5 (stale) Mirror 27: 0xce8a81c5 (stale) Mirror 28: 0xce8a81c5 (stale) Mirror 29: 0xce8a81c5 (stale) CRC-32 checksum value for chunk [0, 0x10103): Mirror 1: 0x14b2262c Mirror 30: 0x14b2262c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10103: skipped 000951 1789024756.142064 read 0x000333 thru 0x00b309 (0xafd7 bytes) 000953 1789024756.158040 punch from 0x0046ac to 0x00993b (0x5290 bytes) 000954 1789024756.253660 mapread 0x00d578 thru 0x00d780 (0x209 bytes) 000955 1789024756.270637 mapwrite 0x01f597 thru 0x0279a7 (0x8411 bytes) 000956 1789024756.461111 punch from 0x00b74c to 0x00f7b5 (0x406a bytes) 000957 1789024756.467662 punch from 0x0209d5 to 0x0279a7 (0x6fd3 bytes) 000959 1789024756.473709 write 0x038d60 thru 0x03eed0 (0x6171 bytes) 000962 1789024756.476961 trunc from 0x03eed1 to 0x01bb22 (0x233ae bytes) 000964 1789024756.503421 write 0x039b54 thru 0x03ffff (0x64ac bytes) 000966 1789024756.507604 punch from 0x0138e2 to 0x01bee5 (0x8604 bytes) 000968 1789024756.520823 mapread 0x03318e thru 0x03a376 (0x71e9 bytes) 000969 1789024756.530353 mapread 0x01de5e thru 0x020973 (0x2b16 bytes) 000971 1789024756.546602 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 26: 0x2dce92ee (stale) Mirror 27: 0x2dce92ee (stale) Mirror 28: 0x2dce92ee (stale) Mirror 29: 0x2dce92ee (stale) Mirror 30: 0x4df7be88 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb1e69163 Mirror 31: 0xb1e69163 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000972 1789024757.799391 read 0x00769d thru 0x00aa57 (0x33bb bytes) 000973 1789024757.805372 mapread 0x035f2c thru 0x03ffff (0xa0d4 bytes) 000974 1789024757.836173 mapwrite 0x00ab69 thru 0x01196e (0x6e06 bytes) 000975 1789024758.014422 punch from 0x01b015 to 0x020ea9 (0x5e95 bytes) 000976 1789024758.019467 read 0x020598 thru 0x02aed8 (0xa941 bytes) 000978 1789024758.039321 punch from 0x01df5c to 0x02c12e (0xe1d3 bytes) 000980 1789024758.046115 read 0x019789 thru 0x01f55c (0x5dd4 bytes) 000983 1789024758.059565 MIRROR_RESYNC 7 mirrors 000985 1789024760.603284 trunc from 0x040000 to 0x03125b (0xeda4 bytes) 000986 1789024760.678881 read 0x00a6a6 thru 0x018850 (0xe1ab bytes) 000987 1789024760.697773 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3125c): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3125c): Mirror 26: 0xb183b365 (stale) Mirror 27: 0xb183b365 (stale) Mirror 28: 0xb183b365 (stale) Mirror 29: 0xb183b365 (stale) Mirror 30: 0xb183b365 (stale) Mirror 31: 0xb183b365 (stale) CRC-32 checksum value for chunk [0, 0x3125c): Mirror 1: 0xb183b365 Mirror 32: 0xb183b365 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3125c: skipped 000988 1789024761.993988 read 0x02a31b thru 0x03125b (0x6f41 bytes) 000989 1789024762.020236 read 0x013fc8 thru 0x019040 (0x5079 bytes) 000991 1789024762.070105 mapwrite 0x0246c9 thru 0x029348 (0x4c80 bytes) 000992 1789024762.312406 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3125c): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3125c): Mirror 26: 0xb183b365 (stale) Mirror 27: 0xb183b365 (stale) Mirror 28: 0xb183b365 (stale) Mirror 29: 0xb183b365 (stale) Mirror 30: 0xb183b365 (stale) Mirror 31: 0xb183b365 (stale) Mirror 32: 0xb183b365 (stale) CRC-32 checksum value for chunk [0, 0x3125c): Mirror 1: 0x5ed17696 Mirror 33: 0x5ed17696 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3125c: skipped 000993 1789024763.790763 mapread 0x0098be thru 0x00dd7f (0x44c2 bytes) 000995 1789024763.830638 trunc from 0x03125c to 0x02cfe7 (0x4274 bytes) 000996 1789024763.920452 MIRROR_RESYNC 9 mirrors 000997 1789024768.119917 read 0x016ea2 thru 0x019840 (0x299f bytes) 000998 1789024768.130407 mapwrite 0x02889c thru 0x030dc7 (0x852c bytes) 000999 1789024768.471034 mapwrite 0x02ae7d thru 0x035df3 (0xaf77 bytes) 001000 1789024768.606825 mapwrite 0x01c8ed thru 0x02b64a (0xed5e bytes) All operations completed A-OK!