== sanity-flr test 70a: flr mode fsx test ================ 11:43:05 (1788882185) Seed set to 2185 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero length punch hole 000003 1788882185.646584 mapwrite 0x029ff5 thru 0x02cda4 (0x2db0 bytes) 000005 1788882185.674840 read 0x02611a thru 0x02ae79 (0x4d60 bytes) 000006 1788882185.676743 MIRROR_EXTEND to 2 mirrors 000007 1788882185.851497 write 0x00eeec thru 0x00f600 (0x715 bytes) 000008 1788882185.871550 punch from 0x003aea to 0x01380f (0xfd26 bytes) 000009 1788882185.874453 punch from 0x00e8ee to 0x011592 (0x2ca5 bytes) 000010 1788882185.875841 mapread 0x01f60c thru 0x020f21 (0x1916 bytes) 000012 1788882185.880435 MIRROR_RESYNC 2 mirrors 000013 1788882186.050513 write 0x00f724 thru 0x012a5e (0x333b bytes) 000014 1788882186.070455 mapwrite 0x03a441 thru 0x03ffff (0x5bbf bytes) 000015 1788882186.099638 read 0x00c6be thru 0x0164cc (0x9e0f bytes) 000016 1788882186.102453 write 0x039121 thru 0x03ffff (0x6edf bytes) 000017 1788882186.103232 write 0x02bd34 thru 0x0320a2 (0x636f bytes) 000019 1788882186.107050 write 0x008417 thru 0x014deb (0xc9d5 bytes) 000020 1788882186.109327 read 0x030ca8 thru 0x03e867 (0xdbc0 bytes) truncating to largest ever: 0x225da 000021 1788882186.112693 trunc from 0x040000 to 0x0225d9 (0x1da26 bytes) 000022 1788882186.118838 MIRROR_RESYNC 2 mirrors 000023 1788882186.305459 mapwrite 0x00bffc thru 0x0172fd (0xb302 bytes) 000024 1788882186.357487 punch from 0x019224 to 0x01ea6f (0x584c bytes) truncating to largest ever: 0x2b7d1 000025 1788882186.359410 trunc from 0x0225da to 0x02b7d0 (0x91f7 bytes) 000026 1788882186.369255 trunc from 0x02b7d1 to 0x029e93 (0x193d bytes) 000028 1788882186.373670 punch from 0x00f800 to 0x0192ad (0x9aae bytes) 000029 1788882186.375664 write 0x03b5b9 thru 0x03de60 (0x28a8 bytes) 000031 1788882186.376625 punch from 0x02e3e5 to 0x02e70a (0x326 bytes) 000032 1788882186.379326 write 0x03cb96 thru 0x03ffff (0x346a bytes) 000033 1788882186.380175 mapwrite 0x038df9 thru 0x03ffff (0x7207 bytes) 000034 1788882186.395351 mapread 0x035a4c thru 0x03ffff (0xa5b4 bytes) 000035 1788882186.395932 write 0x03c8f1 thru 0x03ffff (0x370f bytes) 000036 1788882186.396581 mapwrite 0x0282e6 thru 0x02b190 (0x2eab bytes) 000038 1788882186.413345 MIRROR_RESYNC 2 mirrors 000039 1788882186.626882 mapread 0x030e21 thru 0x03cab0 (0xbc90 bytes) 000041 1788882186.634676 trunc from 0x040000 to 0x0281b2 (0x17e4d bytes) 000042 1788882186.659572 trunc from 0x0281b3 to 0x01b0af (0xd103 bytes) 000043 1788882186.664961 write 0x026630 thru 0x03259f (0xbf70 bytes) 000044 1788882186.666296 punch from 0x02c5a6 to 0x02ea26 (0x2481 bytes) 000045 1788882186.670106 write 0x022012 thru 0x03144a (0xf439 bytes) 000047 1788882186.674463 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x325a0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x325a0): Mirror 2: 0xf1e4f4e1 (stale) CRC-32 checksum value for chunk [0, 0x325a0): Mirror 1: 0x9ac277cb Mirror 3: 0x9ac277cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x325a0: skipped 000048 1788882186.948119 mapwrite 0x02cae2 thru 0x038cb0 (0xc1cf bytes) 000049 1788882187.002760 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38cb1): Mirror 3: 0xcd07fc04 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cb1): Mirror 3: 0xcd07fc04 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cb1: skipped 000050 1788882187.091912 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38cb1): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cb1): Mirror 3: 0xcd07fc04 (stale) CRC-32 checksum value for chunk [0, 0x38cb1): Mirror 1: 0x2aba3ac2 Mirror 4: 0x2aba3ac2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cb1: skipped 000051 1788882187.369627 write 0x0001ec thru 0x00ff1b (0xfd30 bytes) 000052 1788882187.401258 write 0x034ce3 thru 0x038d70 (0x408e bytes) 000053 1788882187.404816 read 0x02acf8 thru 0x02c480 (0x1789 bytes) 000054 1788882187.407087 mapwrite 0x024d22 thru 0x032124 (0xd403 bytes) 000059 1788882187.442567 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38d71): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38d71): Mirror 3: 0xdb376f52 (stale) Mirror 4: 0x42b2f722 (stale) CRC-32 checksum value for chunk [0, 0x38d71): Mirror 1: 0x1ae58412 Mirror 5: 0x1ae58412 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38d71: skipped 000060 1788882187.682901 mapwrite 0x033c57 thru 0x0388a4 (0x4c4e bytes) 000061 1788882187.737801 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38d71): Mirror 3: 0xdb376f52 (stale) Mirror 5: 0x1ae58412 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38d71): Mirror 3: 0xdb376f52 (stale) Mirror 5: 0x1ae58412 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38d71: skipped 000062 1788882187.828017 punch from 0x02a993 to 0x035c53 (0xb2c1 bytes) 000063 1788882187.829929 read 0x024c49 thru 0x02924c (0x4604 bytes) 000064 1788882187.833788 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38d71): Mirror 3: 0xdb376f52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38d71): Mirror 3: 0xdb376f52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38d71: skipped 000065 1788882187.906257 write 0x027537 thru 0x032576 (0xb040 bytes) truncating to largest ever: 0x2e717 000066 1788882187.909284 trunc from 0x038d71 to 0x02e716 (0xa65a bytes) 000068 1788882187.917597 trunc from 0x02e717 to 0x01a92e (0x13de8 bytes) 000069 1788882187.921775 mapread 0x00621d thru 0x0102a6 (0xa08a bytes) 000070 1788882187.927057 read 0x00e318 thru 0x01a92e (0xc617 bytes) 000071 1788882187.931293 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) 000072 1788882187.968283 mapwrite 0x0320e5 thru 0x03c611 (0xa52d bytes) 000073 1788882187.993063 mapread 0x0099fc thru 0x0172b8 (0xd8bd bytes) 000075 1788882188.000034 MIRROR_EXTEND to 2 mirrors 000076 1788882188.196634 MIRROR_EXTEND to 3 mirrors 000078 1788882188.406244 write 0x019748 thru 0x01f6b8 (0x5f71 bytes) 000080 1788882188.429598 trunc from 0x03c612 to 0x01ba57 (0x20bba bytes) 000081 1788882188.435367 punch from 0x0081dc to 0x0112fd (0x9122 bytes) 000082 1788882188.438432 punch from 0x0043dc to 0x005435 (0x105a bytes) 000083 1788882188.440241 punch from 0x003a1d to 0x00763f (0x3c23 bytes) 000084 1788882188.441899 punch from 0x0056b1 to 0x0079e4 (0x2334 bytes) 000085 1788882188.443404 punch from 0x007f56 to 0x015528 (0xd5d3 bytes) 000086 1788882188.445020 punch from 0x000de9 to 0x00a3ed (0x9605 bytes) 000089 1788882188.447491 mapwrite 0x03fca4 thru 0x03ffff (0x35c bytes) 000092 1788882188.472239 punch from 0x02c075 to 0x0349eb (0x8977 bytes) 000093 1788882188.474431 mapwrite 0x034a80 thru 0x036964 (0x1ee5 bytes) truncating to largest ever: 0x2f5c2 000094 1788882188.492913 trunc from 0x040000 to 0x02f5c1 (0x10a3e bytes) 000095 1788882188.498351 mapread 0x01ac62 thru 0x02740a (0xc7a9 bytes) 000097 1788882188.504432 mapwrite 0x033db8 thru 0x036ffe (0x3247 bytes) 000098 1788882188.527392 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36fff): Mirror 2: 0x3fb751dd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36fff): Mirror 2: 0x3fb751dd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36fff: skipped 000100 1788882188.625252 trunc from 0x036fff to 0x0002a5 (0x36d59 bytes) 000101 1788882188.629877 read 0x0000b0 thru 0x0002a5 (0x1f6 bytes) 000103 1788882188.632279 mapwrite 0x028b45 thru 0x037f3c (0xf3f8 bytes) 000105 1788882188.671781 mapwrite 0x026ae8 thru 0x028d0c (0x2225 bytes) 000106 1788882188.690076 punch from 0x0270e4 to 0x02fe28 (0x8d45 bytes) 000107 1788882188.694454 MIRROR_RESYNC 2 mirrors 000108 1788882188.922247 trunc from 0x037f3d to 0x004033 (0x33f09 bytes) 000109 1788882188.946118 punch from 0x0039ab to 0x004033 (0x689 bytes) 000110 1788882188.947855 punch from 0x0035e8 to 0x004033 (0xa4c bytes) 000112 1788882188.949786 mapwrite 0x01701f thru 0x020c79 (0x9c5b bytes) 000113 1788882188.977344 mapwrite 0x012366 thru 0x017f22 (0x5bbd bytes) 000114 1788882188.992867 mapwrite 0x01117b thru 0x020b72 (0xf9f8 bytes) 000115 1788882189.012770 punch from 0x01091c to 0x01a466 (0x9b4b bytes) 000116 1788882189.014785 mapwrite 0x01e8cc thru 0x01ff9a (0x16cf bytes) 000118 1788882189.028136 read 0x00a201 thru 0x0111f5 (0x6ff5 bytes) 000119 1788882189.030583 write 0x01b426 thru 0x01d198 (0x1d73 bytes) 000121 1788882189.031605 write 0x01ce18 thru 0x024064 (0x724d bytes) 000123 1788882189.032597 mapread 0x008271 thru 0x00e597 (0x6327 bytes) 000124 1788882189.036199 punch from 0x005f3c to 0x011f9b (0xc060 bytes) 000125 1788882189.040702 punch from 0x0092a9 to 0x016c2d (0xd985 bytes) 000126 1788882189.042520 write 0x02b6ab thru 0x039e4f (0xe7a5 bytes) 000127 1788882189.043513 write 0x011b2e thru 0x0196ba (0x7b8d bytes) 000128 1788882189.047253 mapread 0x025c67 thru 0x03167c (0xba16 bytes) 000130 1788882189.050706 read 0x00c7b3 thru 0x01ba0c (0xf25a bytes) 000132 1788882189.054423 mapread 0x017b82 thru 0x01f61d (0x7a9c bytes) 000133 1788882189.055319 punch from 0x013cd3 to 0x02088c (0xcbba bytes) 000134 1788882189.059908 trunc from 0x039e50 to 0x00134a (0x38b05 bytes) 000135 1788882189.064493 trunc from 0x00134b to 0x016430 (0x150e6 bytes) 000136 1788882189.069085 write 0x028604 thru 0x02a65f (0x205c bytes) 000137 1788882189.071589 MIRROR_RESYNC 2 mirrors 000138 1788882189.253763 mapread 0x01fedd thru 0x02540e (0x5532 bytes) 000144 1788882189.263189 punch from 0x010317 to 0x01b767 (0xb451 bytes) 000145 1788882189.283000 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2a660): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a660): Mirror 2: 0x8dc00495 (stale) CRC-32 checksum value for chunk [0, 0x2a660): Mirror 1: 0x8dc00495 Mirror 3: 0x8dc00495 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a660: skipped 000146 1788882189.537360 write 0x01c692 thru 0x0211ba (0x4b29 bytes) 000147 1788882189.560759 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a660): Mirror 3: 0x8dc00495 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a660): Mirror 3: 0x8dc00495 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a660: skipped 000148 1788882189.641441 mapwrite 0x024251 thru 0x02d1fb (0x8fab bytes) 000150 1788882189.670404 write 0x03e063 thru 0x03ffff (0x1f9d bytes) 000151 1788882189.671091 punch from 0x001ef8 to 0x00cb40 (0xac49 bytes) 000154 1788882189.675103 write 0x021f1a thru 0x02a655 (0x873c bytes) 000155 1788882189.675831 write 0x03ef62 thru 0x03ffff (0x109e bytes) 000157 1788882189.676919 mapread 0x030efd thru 0x03cb69 (0xbc6d bytes) 000159 1788882189.684433 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) truncating to largest ever: 0x3f8c5 000160 1788882189.727089 trunc from 0x040000 to 0x03f8c4 (0x73b bytes) 000164 1788882189.732534 punch from 0x01ac76 to 0x01c379 (0x1704 bytes) 000165 1788882189.734283 read 0x01dc76 thru 0x02404e (0x63d9 bytes) 000166 1788882189.736769 mapread 0x02cfd6 thru 0x0364b7 (0x94e2 bytes) 000167 1788882189.742437 mapread 0x0042d7 thru 0x0123c3 (0xe0ed bytes) 000168 1788882189.747908 write 0x025d40 thru 0x02a247 (0x4508 bytes) 000169 1788882189.749800 mapread 0x00554e thru 0x00a602 (0x50b5 bytes) 000171 1788882189.750831 mapread 0x01186e thru 0x01557b (0x3d0e bytes) 000173 1788882189.751743 write 0x015480 thru 0x023ac2 (0xe643 bytes) 000174 1788882189.752623 mapread 0x02d359 thru 0x03a3b9 (0xd061 bytes) 000175 1788882189.755790 mapread 0x01936d thru 0x028dd4 (0xfa68 bytes) 000176 1788882189.756364 mapwrite 0x03023c thru 0x0320fb (0x1ec0 bytes) 000177 1788882189.770479 mapread 0x01898d thru 0x02067a (0x7cee bytes) 000178 1788882189.771286 mapwrite 0x00c373 thru 0x00f50a (0x3198 bytes) 000179 1788882189.783288 trunc from 0x03f8c5 to 0x02a6eb (0x151d9 bytes) 000180 1788882189.790103 MIRROR_EXTEND to 2 mirrors 000182 1788882190.003395 trunc from 0x02a6ec to 0x00a366 (0x20385 bytes) 000183 1788882190.027468 trunc from 0x00a367 to 0x038910 (0x2e5aa bytes) 000184 1788882190.032670 mapwrite 0x009a3b thru 0x00fcc6 (0x628c bytes) 000186 1788882190.058656 MIRROR_RESYNC 2 mirrors 000188 1788882190.256337 mapread 0x024b48 thru 0x030eb9 (0xc372 bytes) 000190 1788882190.265121 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) 000191 1788882190.303013 mapread 0x036444 thru 0x038910 (0x24cd bytes) 000193 1788882190.308724 trunc from 0x038911 to 0x008c36 (0x2fcda bytes) 000195 1788882190.319503 trunc from 0x008c37 to 0x0241ab (0x1b575 bytes) 000197 1788882190.323805 trunc from 0x0241ac to 0x001a3c (0x2276f bytes) 000200 1788882190.329045 read 0x0005d4 thru 0x000e38 (0x865 bytes) 000201 1788882190.331314 read 0x000e9d thru 0x001a3c (0xba0 bytes) 000206 1788882190.335436 read 0x00162d thru 0x001a3c (0x410 bytes) 000209 1788882190.336993 mapread 0x000c18 thru 0x001a3c (0xe25 bytes) 000210 1788882190.337703 write 0x00efff thru 0x011ac7 (0x2ac9 bytes) 000211 1788882190.338611 mapread 0x001050 thru 0x008d4f (0x7d00 bytes) 000212 1788882190.341936 mapread 0x00fa0b thru 0x011ac7 (0x20bd bytes) 000213 1788882190.342636 punch from 0x00db1a to 0x011ac7 (0x3fae bytes) 000219 1788882190.347872 punch from 0x00f920 to 0x010ce8 (0x13c9 bytes) 000220 1788882190.350241 punch from 0x002c3c to 0x008aa1 (0x5e66 bytes) 000222 1788882190.352638 punch from 0x00ee0a to 0x00f846 (0xa3d bytes) 000223 1788882190.354648 mapwrite 0x01759c thru 0x019828 (0x228d bytes) 000226 1788882190.378572 read 0x000087 thru 0x00bc3c (0xbbb6 bytes) 000227 1788882190.382646 mapread 0x00d6e7 thru 0x013dce (0x66e8 bytes) 000228 1788882190.383330 mapread 0x00b0d9 thru 0x01872c (0xd654 bytes) 000229 1788882190.383955 mapread 0x0131f6 thru 0x019828 (0x6633 bytes) 000230 1788882190.386192 MIRROR_EXTEND to 2 mirrors 000231 1788882190.589395 write 0x01abba thru 0x022c05 (0x804c bytes) 000233 1788882190.608592 read 0x00d09a thru 0x011104 (0x406b bytes) 000234 1788882190.611361 mapwrite 0x01e56f thru 0x01fb4b (0x15dd bytes) 000237 1788882190.626564 trunc from 0x022c06 to 0x0397c3 (0x16bbe bytes) 000239 1788882190.638714 punch from 0x024326 to 0x0336b9 (0xf394 bytes) 000240 1788882190.642735 read 0x00a6ad thru 0x00e69b (0x3fef bytes) 000242 1788882190.647623 read 0x01ccf4 thru 0x025a89 (0x8d96 bytes) 000243 1788882190.648200 write 0x02f3ff thru 0x02fe3b (0xa3d bytes) 000244 1788882190.649004 punch from 0x02de4d to 0x036e83 (0x9037 bytes) 000245 1788882190.653020 trunc from 0x0397c4 to 0x01bbdb (0x1dbe8 bytes) 000246 1788882190.658649 trunc from 0x01bbdc to 0x030cbd (0x150e2 bytes) 000247 1788882190.663930 mapread 0x00ecc7 thru 0x017a12 (0x8d4c bytes) 000248 1788882190.666933 MIRROR_RESYNC 2 mirrors 000251 1788882190.889278 mapwrite 0x00c3c6 thru 0x01a4fb (0xe136 bytes) 000252 1788882190.947493 write 0x02fb4e thru 0x0331ea (0x369d bytes) 000254 1788882190.950075 write 0x02278f thru 0x029fbd (0x782f bytes) 000255 1788882190.953752 mapwrite 0x019a8b thru 0x01fa6d (0x5fe3 bytes) 000256 1788882190.970893 punch from 0x00257b to 0x00b721 (0x91a7 bytes) 000257 1788882190.973030 trunc from 0x0331eb to 0x037979 (0x478f bytes) 000258 1788882190.985571 write 0x016f7b thru 0x0172cd (0x353 bytes) 000259 1788882190.986429 mapwrite 0x01d151 thru 0x01e7b3 (0x1663 bytes) 000261 1788882191.000863 read 0x006bd8 thru 0x00cfe2 (0x640b bytes) 000262 1788882191.004049 write 0x005549 thru 0x01031b (0xadd3 bytes) 000264 1788882191.006899 write 0x03e55a thru 0x03ffff (0x1aa6 bytes) 000265 1788882191.007570 write 0x01b74d thru 0x020b47 (0x53fb bytes) 000266 1788882191.008290 trunc from 0x040000 to 0x00181c (0x3e7e3 bytes) 000267 1788882191.013993 write 0x028cfc thru 0x034dae (0xc0b3 bytes) 000269 1788882191.015306 punch from 0x02cf82 to 0x034dae (0x7e2d bytes) 000270 1788882191.019062 write 0x017356 thru 0x023e9b (0xcb46 bytes) 000271 1788882191.022579 mapread 0x0187f1 thru 0x01ca4d (0x425d bytes) 000272 1788882191.023296 trunc from 0x034daf to 0x00134f (0x33a5f bytes) 000274 1788882191.029131 read 0x00028b thru 0x00134f (0x10c5 bytes) 000275 1788882191.031265 punch from 0x000975 to 0x00134f (0x9db bytes) 000276 1788882191.032881 mapread 0x000fa2 thru 0x00134f (0x3ae bytes) 000277 1788882191.037687 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) 000278 1788882191.075378 read 0x000e3b thru 0x00134f (0x515 bytes) 000279 1788882191.077646 read 0x0002e4 thru 0x00134f (0x106c bytes) 000280 1788882191.078005 punch from 0x000c87 to 0x00134f (0x6c9 bytes) 000283 1788882191.080790 read 0x000737 thru 0x00134f (0xc19 bytes) 000284 1788882191.083063 read 0x000ca7 thru 0x00134f (0x6a9 bytes) 000287 1788882191.084399 punch from 0x00000b to 0x00134f (0x1345 bytes) 000289 1788882191.086503 mapread 0x0009a3 thru 0x00134f (0x9ad bytes) 000292 1788882191.089451 mapwrite 0x014e7a thru 0x01a5aa (0x5731 bytes) 000297 1788882191.113817 trunc from 0x01a5ab to 0x011ff0 (0x85ba bytes) 000298 1788882191.120746 MIRROR_EXTEND to 2 mirrors 000299 1788882191.347640 trunc from 0x011ff1 to 0x01acd0 (0x8ce0 bytes) 000300 1788882191.372374 mapread 0x00bec0 thru 0x01893f (0xca80 bytes) 000301 1788882191.381247 trunc from 0x01acd1 to 0x035f8f (0x1b2bf bytes) 000302 1788882191.386739 trunc from 0x035f90 to 0x025c57 (0x10338 bytes) 000303 1788882191.391122 punch from 0x019068 to 0x01e0d2 (0x506b bytes) 000304 1788882191.392884 read 0x00bcfd thru 0x017860 (0xbb64 bytes) 000305 1788882191.394683 MIRROR_RESYNC 2 mirrors 000308 1788882191.572126 trunc from 0x025c58 to 0x03a1dd (0x14586 bytes) 000309 1788882191.597806 punch from 0x035e38 to 0x03a1dd (0x43a6 bytes) 000313 1788882191.600330 trunc from 0x03a1de to 0x00e2da (0x2bf03 bytes) 000314 1788882191.605703 trunc from 0x00e2db to 0x034ef2 (0x26c18 bytes) 000315 1788882191.609691 trunc from 0x034ef3 to 0x00fc1c (0x252d6 bytes) 000316 1788882191.614364 punch from 0x002cd5 to 0x00aa79 (0x7da5 bytes) 000319 1788882191.616708 write 0x037dd0 thru 0x039815 (0x1a46 bytes) 000320 1788882191.617400 punch from 0x028b90 to 0x02c225 (0x3696 bytes) 000321 1788882191.620189 write 0x00eff0 thru 0x0140e3 (0x50f4 bytes) 000322 1788882191.623245 trunc from 0x039816 to 0x01c532 (0x1d2e3 bytes) 000323 1788882191.627583 mapwrite 0x018985 thru 0x01b38b (0x2a07 bytes) 000325 1788882191.645429 mapread 0x00c325 thru 0x010497 (0x4173 bytes) 000326 1788882191.648576 punch from 0x013638 to 0x01c532 (0x8efb bytes) 000327 1788882191.650328 read 0x01bcf8 thru 0x01c532 (0x83b bytes) 000328 1788882191.652410 mapwrite 0x02976b thru 0x03838b (0xec21 bytes) 000329 1788882191.677403 read 0x001550 thru 0x00aba6 (0x9657 bytes) 000330 1788882191.680723 mapwrite 0x0356a0 thru 0x03ffff (0xa960 bytes) 000333 1788882191.704871 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) 000334 1788882191.743625 trunc from 0x040000 to 0x037890 (0x876f bytes) 000336 1788882191.748637 write 0x0065f7 thru 0x0129da (0xc3e4 bytes) 000339 1788882191.752572 mapread 0x0303ea thru 0x037890 (0x74a7 bytes) 000341 1788882191.758084 write 0x03a71f thru 0x03dc3f (0x3521 bytes) 000343 1788882191.759328 write 0x028eba thru 0x0293c8 (0x50f bytes) 000344 1788882191.762479 trunc from 0x03dc40 to 0x034a0b (0x9234 bytes) 000345 1788882191.767254 write 0x00837c thru 0x012d76 (0xa9fb bytes) 000347 1788882191.768770 punch from 0x01a3a3 to 0x02261a (0x8278 bytes) 000349 1788882191.776232 MIRROR_EXTEND to 2 mirrors 000350 1788882192.003716 read 0x0344b8 thru 0x034a0b (0x554 bytes) 000351 1788882192.007443 write 0x0167f4 thru 0x021efa (0xb707 bytes) 000353 1788882192.029845 MIRROR_RESYNC 2 mirrors 000354 1788882192.284650 punch from 0x010bb8 to 0x01eb26 (0xdf6f bytes) 000355 1788882192.299657 mapwrite 0x039a16 thru 0x03ffff (0x65ea bytes) 000358 1788882192.324444 mapread 0x00e315 thru 0x019ee9 (0xbbd5 bytes) 000359 1788882192.331122 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) 000360 1788882192.372407 mapread 0x011fb6 thru 0x01d0ea (0xb135 bytes) 000361 1788882192.379905 mapwrite 0x03ec1f thru 0x03ffff (0x13e1 bytes) 000362 1788882192.393605 mapwrite 0x01ecad thru 0x01fcab (0xfff bytes) 000363 1788882192.405482 write 0x023f32 thru 0x02effc (0xb0cb bytes) 000366 1788882192.408829 mapread 0x022be4 thru 0x032985 (0xfda2 bytes) 000367 1788882192.411722 mapread 0x000f9e thru 0x00929c (0x82ff bytes) 000370 1788882192.415355 punch from 0x001118 to 0x008948 (0x7831 bytes) 000371 1788882192.419804 read 0x0316dc thru 0x03e07e (0xc9a3 bytes) 000372 1788882192.420332 punch from 0x029996 to 0x035fd8 (0xc643 bytes) 000373 1788882192.422282 read 0x033488 thru 0x03d8ec (0xa465 bytes) 000374 1788882192.425395 mapwrite 0x003907 thru 0x013078 (0xf772 bytes) 000375 1788882192.441788 write 0x0310d7 thru 0x0383b9 (0x72e3 bytes) 000376 1788882192.442875 write 0x037f5b thru 0x03ffff (0x80a5 bytes) 000377 1788882192.443862 punch from 0x00a7c5 to 0x013619 (0x8e55 bytes) 000378 1788882192.448967 mapwrite 0x013542 thru 0x013f4e (0xa0d bytes) 000379 1788882192.463713 trunc from 0x040000 to 0x01a956 (0x256a9 bytes) 000380 1788882192.468773 mapread 0x0002d2 thru 0x003c3f (0x396e bytes) 000382 1788882192.469699 mapwrite 0x032f4d thru 0x033b6d (0xc21 bytes) 000383 1788882192.490316 write 0x01253b thru 0x02102d (0xeaf3 bytes) 000386 1788882192.494647 punch from 0x01a779 to 0x0217f9 (0x7081 bytes) 000387 1788882192.498853 read 0x02c0fe thru 0x033b6d (0x7a70 bytes) 000388 1788882192.502666 trunc from 0x033b6e to 0x0003ab (0x337c2 bytes) 000389 1788882192.507449 punch from 0x00027b to 0x0003ab (0x131 bytes) 000392 1788882192.509965 punch from 0x00025c to 0x0003ab (0x150 bytes) 000393 1788882192.511661 mapread 0x00020a thru 0x0003ab (0x1a2 bytes) 000395 1788882192.514384 write 0x0148a4 thru 0x01520a (0x967 bytes) 000396 1788882192.515264 trunc from 0x01520b to 0x018709 (0x34ff bytes) 000397 1788882192.520511 trunc from 0x01870a to 0x032a1b (0x1a312 bytes) 000398 1788882192.525031 mapread 0x021da0 thru 0x02c93d (0xab9e bytes) 000399 1788882192.540847 punch from 0x010834 to 0x01b052 (0xa81f bytes) 000400 1788882192.543589 write 0x00366c thru 0x00a621 (0x6fb6 bytes) 000401 1788882192.546680 punch from 0x0184df to 0x021cfe (0x9820 bytes) 000402 1788882192.550265 write 0x017026 thru 0x01fa27 (0x8a02 bytes) 000404 1788882192.553423 punch from 0x020d01 to 0x0290ad (0x83ad bytes) 000405 1788882192.557446 punch from 0x02ade2 to 0x0300c2 (0x52e1 bytes) 000406 1788882192.558960 read 0x00edb7 thru 0x01d63a (0xe884 bytes) 000408 1788882192.562536 trunc from 0x032a1c to 0x01dd62 (0x14cb9 bytes) 000409 1788882192.566956 mapread 0x00b564 thru 0x015f31 (0xa9ce bytes) 000410 1788882192.567650 read 0x00149d thru 0x0078e1 (0x6445 bytes) 000411 1788882192.568243 punch from 0x0188fa to 0x01a6ef (0x1df6 bytes) 000412 1788882192.569759 read 0x00fd7d thru 0x01ada2 (0xb026 bytes) 000413 1788882192.571475 read 0x010d4d thru 0x011c9b (0xf4f bytes) 000414 1788882192.571781 read 0x0116ac thru 0x01dd62 (0xc6b7 bytes) 000416 1788882192.572372 punch from 0x015a20 to 0x01dd62 (0x8343 bytes) 000418 1788882192.574397 punch from 0x017583 to 0x01dd62 (0x67e0 bytes) 000420 1788882192.576298 punch from 0x009097 to 0x018632 (0xf59c bytes) 000422 1788882192.578624 write 0x032b6a thru 0x038961 (0x5df8 bytes) 000423 1788882192.579502 punch from 0x003866 to 0x009dcf (0x656a bytes) 000426 1788882192.583809 mapwrite 0x03bce4 thru 0x03ffff (0x431c bytes) 000427 1788882192.605092 mapread 0x01aaf3 thru 0x01ceb6 (0x23c4 bytes) 000432 1788882192.606979 mapwrite 0x014801 thru 0x017f9e (0x379e bytes) 000433 1788882192.623548 mapwrite 0x00432f thru 0x00517f (0xe51 bytes) 000435 1788882192.636140 mapread 0x01bac8 thru 0x0227cb (0x6d04 bytes) 000436 1788882192.636737 mapwrite 0x0182c4 thru 0x02749b (0xf1d8 bytes) 000437 1788882192.652999 trunc from 0x040000 to 0x0036de (0x3c921 bytes) 000440 1788882192.659026 read 0x0031c0 thru 0x0036de (0x51f bytes) 000441 1788882192.659585 read 0x0011a4 thru 0x0036de (0x253b bytes) 000442 1788882192.659969 trunc from 0x0036df to 0x015adb (0x123fd bytes) 000444 1788882192.664659 write 0x023e55 thru 0x024677 (0x823 bytes) 000445 1788882192.665516 trunc from 0x024678 to 0x03ee4b (0x1a7d4 bytes) 000446 1788882192.669455 write 0x023317 thru 0x02a266 (0x6f50 bytes) 000447 1788882192.674409 MIRROR_EXTEND to 2 mirrors 000448 1788882192.922460 write 0x01509b thru 0x01530e (0x274 bytes) 000449 1788882192.942440 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) 000450 1788882192.979072 trunc from 0x03ee4c to 0x003884 (0x3b5c7 bytes) 000451 1788882192.988065 trunc from 0x003885 to 0x03e174 (0x3a8f0 bytes) 000452 1788882192.993138 read 0x024541 thru 0x02d1ef (0x8caf bytes) 000454 1788882192.996781 mapread 0x00674d thru 0x013860 (0xd114 bytes) 000455 1788882193.005804 mapread 0x016b3f thru 0x01f83b (0x8cfd bytes) 000457 1788882193.009331 mapwrite 0x00220c thru 0x002958 (0x74d bytes) 000459 1788882193.021890 punch from 0x02b7f1 to 0x03ad8c (0xf59c bytes) 000462 1788882193.024896 mapread 0x0273c1 thru 0x02e204 (0x6e44 bytes) 000464 1788882193.028686 write 0x010c81 thru 0x01d041 (0xc3c1 bytes) 000466 1788882193.030260 punch from 0x00c316 to 0x01665c (0xa347 bytes) 000467 1788882193.034589 read 0x026223 thru 0x02a6e3 (0x44c1 bytes) 000468 1788882193.035057 mapread 0x016562 thru 0x017116 (0xbb5 bytes) 000469 1788882193.038392 mapwrite 0x035473 thru 0x03d9ad (0x853b bytes) 000470 1788882193.053483 read 0x02f2f5 thru 0x03b39e (0xc0aa bytes) 000473 1788882193.055004 mapwrite 0x03452a thru 0x03d5d3 (0x90aa bytes) 000475 1788882193.071494 mapread 0x028d61 thru 0x036191 (0xd431 bytes) 000476 1788882193.072312 trunc from 0x03e175 to 0x000ba9 (0x3d5cb bytes) 000477 1788882193.077742 mapwrite 0x0296a9 thru 0x030ef0 (0x7848 bytes) 000478 1788882193.097820 write 0x031c70 thru 0x033af9 (0x1e8a bytes) 000479 1788882193.098676 punch from 0x02ee82 to 0x033af9 (0x4c78 bytes) 000480 1788882193.101747 read 0x02c66b thru 0x02fa6a (0x3400 bytes) 000482 1788882193.104605 write 0x01ef7e thru 0x023845 (0x48c8 bytes) 000483 1788882193.105524 trunc from 0x033afa to 0x03742f (0x3936 bytes) 000484 1788882193.110337 trunc from 0x037430 to 0x02bd52 (0xb6dd bytes) 000485 1788882193.114787 punch from 0x0126cb to 0x02186d (0xf1a3 bytes) 000486 1788882193.118808 read 0x002cf8 thru 0x00399e (0xca7 bytes) 000489 1788882193.120291 mapwrite 0x000e79 thru 0x010818 (0xf9a0 bytes) 000491 1788882193.137347 read 0x02095d thru 0x028f27 (0x85cb bytes) 000492 1788882193.140846 trunc from 0x02bd53 to 0x002387 (0x299cb bytes) 000494 1788882193.147989 read 0x000de8 thru 0x002387 (0x15a0 bytes) 000495 1788882193.148535 read 0x002055 thru 0x002387 (0x333 bytes) 000496 1788882193.148887 mapwrite 0x02ddee thru 0x031c0f (0x3e22 bytes) 000498 1788882193.172053 mapread 0x00a1ea thru 0x01a11b (0xff32 bytes) 000499 1788882193.172731 mapwrite 0x03ded0 thru 0x03ffff (0x2130 bytes) 000500 1788882193.193428 mapread 0x013dd9 thru 0x015a06 (0x1c2e bytes) 000503 1788882193.195133 read 0x006130 thru 0x013009 (0xceda bytes) 000505 1788882193.196049 punch from 0x03fc17 to 0x03ffff (0x3e9 bytes) 000506 1788882193.198189 mapwrite 0x034fd9 thru 0x03ffff (0xb027 bytes) 000509 1788882193.215643 mapread 0x015367 thru 0x0194ff (0x4199 bytes) 000510 1788882193.216271 write 0x01813c thru 0x0251e6 (0xd0ab bytes) 000511 1788882193.217140 trunc from 0x040000 to 0x02ea49 (0x115b6 bytes) 000512 1788882193.222067 write 0x0123c7 thru 0x020535 (0xe16f bytes) 000513 1788882193.223177 write 0x00b35d thru 0x015d83 (0xaa27 bytes) 000514 1788882193.225706 MIRROR_EXTEND to 2 mirrors 000516 1788882193.479668 write 0x005611 thru 0x00f353 (0x9d43 bytes) truncating to largest ever: 0x3fd0a 000517 1788882193.502794 trunc from 0x02ea4a to 0x03fd09 (0x112c0 bytes) 000518 1788882193.513796 read 0x00fc20 thru 0x01cb0e (0xceef bytes) 000519 1788882193.517266 mapwrite 0x022327 thru 0x0279ef (0x56c9 bytes) 000520 1788882193.537418 write 0x00ce46 thru 0x01c071 (0xf22c bytes) 000521 1788882193.538361 trunc from 0x03fd0a to 0x0287f6 (0x17513 bytes) 000522 1788882193.543622 trunc from 0x0287f7 to 0x032ba6 (0xa3b0 bytes) 000523 1788882193.549600 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x32ba7): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32ba7): Mirror 2: 0x76c8e5b4 (stale) CRC-32 checksum value for chunk [0, 0x32ba7): Mirror 1: 0xd4882880 Mirror 3: 0xd4882880 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32ba7: skipped 000524 1788882193.834086 read 0x0148c6 thru 0x01e5b7 (0x9cf2 bytes) 000525 1788882193.837310 trunc from 0x032ba7 to 0x018783 (0x1a423 bytes) 000526 1788882193.863475 mapwrite 0x021fe2 thru 0x025cdf (0x3cfe bytes) 000527 1788882193.885141 trunc from 0x025ce0 to 0x032864 (0xcb85 bytes) 000528 1788882193.889517 write 0x03b52c thru 0x03ffff (0x4ad4 bytes) 000529 1788882193.890363 read 0x00a547 thru 0x019f9d (0xfa57 bytes) 000530 1788882193.895374 MIRROR_RESYNC 3 mirrors 000531 1788882194.230270 punch from 0x0058cd to 0x00ffa6 (0xa6da bytes) 000533 1788882194.247753 read 0x01ec1e thru 0x01f406 (0x7e9 bytes) 000534 1788882194.250131 punch from 0x00c678 to 0x010781 (0x410a bytes) 000538 1788882194.252975 mapwrite 0x002be1 thru 0x007e06 (0x5226 bytes) 000539 1788882194.274232 punch from 0x01fa18 to 0x0278ca (0x7eb3 bytes) 000540 1788882194.276486 mapread 0x03e1d4 thru 0x03ffff (0x1e2c bytes) 000541 1788882194.279731 punch from 0x01f544 to 0x02a7b9 (0xb276 bytes) 000542 1788882194.281466 trunc from 0x040000 to 0x03629b (0x9d64 bytes) 000543 1788882194.288341 mapread 0x02b77c thru 0x02e9b6 (0x323b bytes) 000545 1788882194.292370 trunc from 0x03629c to 0x021789 (0x14b12 bytes) 000546 1788882194.298554 trunc from 0x02178a to 0x029ebd (0x8734 bytes) 000547 1788882194.305190 mapread 0x007bd7 thru 0x015eb7 (0xe2e1 bytes) 000548 1788882194.310229 MIRROR_RESYNC 3 mirrors 000549 1788882194.668418 read 0x013c99 thru 0x020f86 (0xd2ee bytes) 000551 1788882194.671677 punch from 0x0149c8 to 0x01d279 (0x88b2 bytes) 000553 1788882194.690963 write 0x00b913 thru 0x01330c (0x79fa bytes) 000555 1788882194.694960 mapwrite 0x02e541 thru 0x03c907 (0xe3c7 bytes) 000556 1788882194.728953 mapread 0x02312c thru 0x023ad7 (0x9ac bytes) 000557 1788882194.732077 punch from 0x025606 to 0x027776 (0x2171 bytes) 000558 1788882194.733707 mapread 0x02f19a thru 0x0325aa (0x3411 bytes) 000559 1788882194.735687 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c908): Mirror 3: 0xe5953bbd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c908): Mirror 3: 0xe5953bbd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c908: skipped 000560 1788882194.819487 punch from 0x03b58e to 0x03c907 (0x137a bytes) 000562 1788882194.821788 mapread 0x008274 thru 0x017976 (0xf703 bytes) 000566 1788882194.831400 punch from 0x030871 to 0x03354e (0x2cde bytes) 000568 1788882194.833949 punch from 0x0335c7 to 0x03c907 (0x9341 bytes) 000569 1788882194.836114 mapread 0x004ee2 thru 0x0067eb (0x190a bytes) 000571 1788882194.837108 read 0x0013d2 thru 0x0099a6 (0x85d5 bytes) 000572 1788882194.839546 mapwrite 0x005cbe thru 0x008721 (0x2a64 bytes) 000573 1788882194.857259 read 0x02e78b thru 0x03bd6b (0xd5e1 bytes) 000574 1788882194.861766 punch from 0x016245 to 0x0217c3 (0xb57f bytes) 000575 1788882194.863841 mapread 0x016027 thru 0x01ada3 (0x4d7d bytes) 000577 1788882194.872282 read 0x000e74 thru 0x00d9f1 (0xcb7e bytes) 000578 1788882194.872740 mapwrite 0x023b1a thru 0x0333ca (0xf8b1 bytes) 000579 1788882194.891569 punch from 0x02721d to 0x031ebf (0xaca3 bytes) 000580 1788882194.893744 trunc from 0x03c908 to 0x02d662 (0xf2a5 bytes) 000582 1788882194.899338 punch from 0x000d98 to 0x00e5d9 (0xd842 bytes) 000583 1788882194.901835 punch from 0x0103c1 to 0x0161e1 (0x5e21 bytes) 000584 1788882194.904015 trunc from 0x02d663 to 0x03e62a (0x10fc8 bytes) 000586 1788882194.910029 read 0x01a050 thru 0x0245f7 (0xa5a8 bytes) 000587 1788882194.916255 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) 000589 1788882194.962063 mapread 0x00eb81 thru 0x00fb55 (0xfd5 bytes) 000590 1788882194.967210 mapwrite 0x039dbe thru 0x03c901 (0x2b44 bytes) 000591 1788882194.983112 mapread 0x00c54d thru 0x01530c (0x8dc0 bytes) 000593 1788882194.991564 write 0x026c2a thru 0x0279f3 (0xdca bytes) 000596 1788882194.995541 punch from 0x032e30 to 0x034435 (0x1606 bytes) 000597 1788882194.998640 read 0x019353 thru 0x01eb7f (0x582d bytes) 000598 1788882195.000749 trunc from 0x03e62b to 0x027369 (0x172c1 bytes) 000599 1788882195.005515 punch from 0x01bcda to 0x027369 (0xb690 bytes) 000602 1788882195.008339 mapread 0x0219aa thru 0x027369 (0x59c0 bytes) 000603 1788882195.011609 trunc from 0x02736a to 0x03c664 (0x152fb bytes) 000604 1788882195.016397 read 0x027395 thru 0x0300f0 (0x8d5c bytes) 000605 1788882195.019788 read 0x0181ba thru 0x018d76 (0xbbd bytes) 000606 1788882195.020229 punch from 0x030305 to 0x038daf (0x8aab bytes) 000607 1788882195.022202 mapwrite 0x03c7eb thru 0x03ffff (0x3815 bytes) 000610 1788882195.045487 mapread 0x014cba thru 0x01d37b (0x86c2 bytes) 000612 1788882195.046533 mapwrite 0x02d9e2 thru 0x02e416 (0xa35 bytes) 000613 1788882195.064979 trunc from 0x040000 to 0x02663c (0x199c3 bytes) 000615 1788882195.073028 write 0x02f882 thru 0x03c4c1 (0xcc40 bytes) 000617 1788882195.074459 mapread 0x01d99a thru 0x02c2a2 (0xe909 bytes) 000619 1788882195.083633 mapwrite 0x026ff2 thru 0x02ea73 (0x7a82 bytes) 000621 1788882195.105574 mapread 0x01e931 thru 0x02d3fe (0xeace bytes) 000623 1788882195.106744 punch from 0x0309fc to 0x03989c (0x8ea1 bytes) 000626 1788882195.110169 write 0x02dd76 thru 0x03a13d (0xc3c8 bytes) 000628 1788882195.111871 punch from 0x02b889 to 0x03907d (0xd7f5 bytes) 000629 1788882195.117374 write 0x011f12 thru 0x013a17 (0x1b06 bytes) 000630 1788882195.119125 mapread 0x013844 thru 0x01b376 (0x7b33 bytes) 000631 1788882195.119785 mapwrite 0x02b030 thru 0x030dc8 (0x5d99 bytes) 000634 1788882195.145878 write 0x01cac6 thru 0x02aa72 (0xdfad bytes) 000636 1788882195.146941 mapwrite 0x010ec4 thru 0x01c422 (0xb55f bytes) 000637 1788882195.161964 mapread 0x02d8d4 thru 0x037c68 (0xa395 bytes) 000639 1788882195.172697 trunc from 0x03c4c2 to 0x00ddd7 (0x2e6ea bytes) 000643 1788882195.179711 write 0x011970 thru 0x018d38 (0x73c9 bytes) 000644 1788882195.180606 mapwrite 0x01a757 thru 0x01d422 (0x2ccc bytes) 000645 1788882195.205490 punch from 0x002769 to 0x00a351 (0x7be9 bytes) 000646 1788882195.208073 write 0x0180db thru 0x01da98 (0x59be bytes) 000647 1788882195.209029 trunc from 0x01da99 to 0x01d2ea (0x7ae bytes) 000648 1788882195.214601 read 0x0002df thru 0x008373 (0x8095 bytes) 000651 1788882195.218600 read 0x011107 thru 0x01d2ea (0xc1e4 bytes) 000654 1788882195.219989 mapwrite 0x0111b9 thru 0x01c872 (0xb6ba bytes) 000655 1788882195.236421 read 0x014691 thru 0x01d2ea (0x8c5a bytes) 000656 1788882195.237013 trunc from 0x01d2eb to 0x0210a4 (0x3dba bytes) 000659 1788882195.244074 mapwrite 0x02f13d thru 0x037148 (0x800c bytes) 000660 1788882195.268050 punch from 0x000caf to 0x00d680 (0xc9d2 bytes) 000661 1788882195.270050 write 0x0381ed thru 0x03ffff (0x7e13 bytes) 000662 1788882195.271020 mapwrite 0x03fdb3 thru 0x03ffff (0x24d bytes) 000663 1788882195.283702 mapread 0x024943 thru 0x02e104 (0x97c2 bytes) 000664 1788882195.285943 MIRROR_EXTEND to 2 mirrors 000665 1788882195.552538 write 0x02a144 thru 0x038d09 (0xebc6 bytes) 000667 1788882195.574949 write 0x02fb37 thru 0x0397ec (0x9cb6 bytes) 000668 1788882195.577445 mapread 0x02e2c0 thru 0x033dad (0x5aee bytes) 000669 1788882195.578123 read 0x02af71 thru 0x0307ff (0x588f bytes) 000670 1788882195.578677 read 0x030e1f thru 0x03ffff (0xf1e1 bytes) 000672 1788882195.582542 write 0x03a6bc thru 0x03ffff (0x5944 bytes) 000673 1788882195.583214 trunc from 0x040000 to 0x00ddd2 (0x3222d bytes) 000674 1788882195.595361 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) 000676 1788882195.641621 punch from 0x0024a9 to 0x004121 (0x1c79 bytes) 000677 1788882195.644733 write 0x008cee thru 0x016e17 (0xe12a bytes) 000678 1788882195.647974 write 0x02330b thru 0x02923d (0x5f33 bytes) 000679 1788882195.648991 write 0x024cb2 thru 0x02848e (0x37dd bytes) 000681 1788882195.650302 read 0x022a51 thru 0x02923d (0x67ed bytes) 000683 1788882195.653717 mapread 0x020cc8 thru 0x023dc5 (0x30fe bytes) 000684 1788882195.658042 mapread 0x01880e thru 0x0193a8 (0xb9b bytes) 000685 1788882195.661861 mapwrite 0x02f5fd thru 0x030c9a (0x169e bytes) 000686 1788882195.710079 read 0x000829 thru 0x00989f (0x9077 bytes) 000687 1788882195.714050 punch from 0x02ba6e to 0x030c9a (0x522d bytes) 000688 1788882195.720998 read 0x005152 thru 0x011fe0 (0xce8f bytes) 000689 1788882195.721665 mapread 0x0072cc thru 0x0121b6 (0xaeeb bytes) 000691 1788882195.724642 MIRROR_EXTEND to 2 mirrors 000692 1788882195.994862 trunc from 0x030c9b to 0x019c34 (0x17066 bytes) 000693 1788882196.032012 trunc from 0x019c35 to 0x0035e4 (0x16650 bytes) 000694 1788882196.041759 mapwrite 0x00aab0 thru 0x0194d6 (0xea27 bytes) 000695 1788882196.082850 punch from 0x012b63 to 0x0194d6 (0x6974 bytes) 000698 1788882196.086027 read 0x009f3e thru 0x00c355 (0x2418 bytes) 000699 1788882196.086448 punch from 0x012136 to 0x01521a (0x30e5 bytes) 000701 1788882196.089005 write 0x02a995 thru 0x037e3a (0xd4a6 bytes) 000702 1788882196.090503 trunc from 0x037e3b to 0x01c303 (0x1bb37 bytes) 000703 1788882196.096268 trunc from 0x01c304 to 0x0021cf (0x1a134 bytes) 000704 1788882196.107785 write 0x03464b thru 0x034670 (0x26 bytes) 000705 1788882196.108751 trunc from 0x034671 to 0x01f164 (0x1550c bytes) 000708 1788882196.118098 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1f165): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f165): Mirror 2: 0x9cae21b9 (stale) CRC-32 checksum value for chunk [0, 0x1f165): Mirror 1: 0x2fc6d76f Mirror 3: 0x2fc6d76f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f165: skipped 000709 1788882196.429728 punch from 0x00c461 to 0x017bf1 (0xb791 bytes) 000710 1788882196.454502 trunc from 0x01f165 to 0x003590 (0x1bbd4 bytes) 000711 1788882196.462362 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3591): Mirror 3: 0x1c36f5d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3591): Mirror 3: 0x1c36f5d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3591: skipped 000714 1788882196.542872 mapwrite 0x0249d9 thru 0x029264 (0x488c bytes) 000715 1788882196.571113 read 0x00863e thru 0x0108c5 (0x8288 bytes) 000716 1788882196.574522 punch from 0x015e98 to 0x0212d7 (0xb440 bytes) 000717 1788882196.577648 trunc from 0x029265 to 0x01c513 (0xcd51 bytes) 000718 1788882196.583329 mapread 0x014ae7 thru 0x01c513 (0x7a2d bytes) 000719 1788882196.587137 read 0x003871 thru 0x008a47 (0x51d7 bytes) 000720 1788882196.591957 MIRROR_RESYNC 2 mirrors 000722 1788882196.784100 punch from 0x003d6c to 0x00d61d (0x98b2 bytes) 000723 1788882196.804989 MIRROR_RESYNC 2 mirrors 000724 1788882196.990529 mapwrite 0x006474 thru 0x007dfc (0x1989 bytes) 000725 1788882197.038863 trunc from 0x01c514 to 0x021b4b (0x5638 bytes) 000726 1788882197.051050 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x21b4c): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21b4c): Mirror 3: 0xd579cf0a (stale) CRC-32 checksum value for chunk [0, 0x21b4c): Mirror 1: 0x9c40c7f6 Mirror 4: 0x9c40c7f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21b4c: skipped 000727 1788882197.351408 read 0x01afb6 thru 0x021b4b (0x6b96 bytes) 000728 1788882197.354484 write 0x0106df thru 0x01b7e3 (0xb105 bytes) 000729 1788882197.381389 mapwrite 0x01eaac thru 0x02392f (0x4e84 bytes) 000730 1788882197.407410 mapwrite 0x0059f3 thru 0x014f2f (0xf53d bytes) 000731 1788882197.424883 read 0x0115c4 thru 0x019f26 (0x8963 bytes) 000733 1788882197.427139 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23930): Mirror 4: 0x2860152a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23930): Mirror 4: 0x2860152a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23930: skipped 000734 1788882197.511328 read 0x01c621 thru 0x02392f (0x730f bytes) 000735 1788882197.514339 mapwrite 0x02c451 thru 0x02f1ed (0x2d9d bytes) 000737 1788882197.535633 mapread 0x026f2f thru 0x02f1ed (0x82bf bytes) 000738 1788882197.538189 write 0x0214ae thru 0x021c01 (0x754 bytes) 000739 1788882197.538966 mapread 0x02443c thru 0x028e4f (0x4a14 bytes) 000740 1788882197.539742 read 0x020a4b thru 0x023f4b (0x3501 bytes) 000741 1788882197.540283 trunc from 0x02f1ee to 0x0054ba (0x29d33 bytes) 000742 1788882197.545041 trunc from 0x0054bb to 0x0144a5 (0xefeb bytes) 000743 1788882197.549111 mapwrite 0x001c2a thru 0x011b4d (0xff24 bytes) 000744 1788882197.567468 trunc from 0x0144a6 to 0x02f7cd (0x1b328 bytes) 000745 1788882197.573670 punch from 0x02ee2f to 0x02f7cd (0x99f bytes) 000746 1788882197.575596 read 0x024a40 thru 0x02cb85 (0x8146 bytes) 000747 1788882197.579451 write 0x009171 thru 0x00eefb (0x5d8b bytes) 000748 1788882197.580441 read 0x020305 thru 0x027937 (0x7633 bytes) 000749 1788882197.580860 trunc from 0x02f7ce to 0x00240f (0x2d3be bytes) 000750 1788882197.586488 punch from 0x001e1c to 0x00240f (0x5f4 bytes) 000752 1788882197.588953 trunc from 0x002410 to 0x03b8c1 (0x394b2 bytes) 000753 1788882197.598207 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b8c2): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8c2): Mirror 4: 0xb33372d4 (stale) CRC-32 checksum value for chunk [0, 0x3b8c2): Mirror 1: 0x2a35d6b7 Mirror 5: 0x2a35d6b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8c2: skipped 000754 1788882197.875512 write 0x01a020 thru 0x02392f (0x9910 bytes) 000755 1788882197.902323 punch from 0x02b59b to 0x037d28 (0xc78e bytes) 000756 1788882197.908269 write 0x03b5a0 thru 0x03ffff (0x4a60 bytes) 000758 1788882197.913112 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x9580a324 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x9580a324 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000761 1788882198.012577 MIRROR_RESYNC 2 mirrors 000763 1788882198.245764 read 0x03c55c thru 0x03ffff (0x3aa4 bytes) 000764 1788882198.247751 mapwrite 0x0140c6 thru 0x02091b (0xc856 bytes) 000766 1788882198.303112 mapread 0x01132f thru 0x017acc (0x679e bytes) 000767 1788882198.303902 trunc from 0x040000 to 0x02846f (0x17b90 bytes) 000770 1788882198.310796 punch from 0x003e4d to 0x011054 (0xd208 bytes) 000771 1788882198.312725 write 0x027948 thru 0x030b37 (0x91f0 bytes) 000772 1788882198.314964 read 0x013e84 thru 0x022cc6 (0xee43 bytes) 000774 1788882198.315764 trunc from 0x030b38 to 0x030255 (0x8e2 bytes) 000775 1788882198.320967 write 0x029f8a thru 0x03823a (0xe2b1 bytes) 000776 1788882198.322339 punch from 0x031165 to 0x031818 (0x6b4 bytes) 000778 1788882198.327195 write 0x008e21 thru 0x016bb1 (0xdd91 bytes) 000779 1788882198.331258 mapwrite 0x0087e1 thru 0x0094cf (0xcef bytes) 000781 1788882198.345675 mapread 0x032149 thru 0x036569 (0x4421 bytes) 000782 1788882198.346775 read 0x002bf5 thru 0x00802a (0x5436 bytes) 000785 1788882198.347732 read 0x029a79 thru 0x02aa3f (0xfc7 bytes) 000786 1788882198.348257 read 0x004a29 thru 0x00cb09 (0x80e1 bytes) 000787 1788882198.348769 punch from 0x03456c to 0x03769f (0x3134 bytes) 000788 1788882198.351039 trunc from 0x03823b to 0x01dfe2 (0x1a258 bytes) 000789 1788882198.356288 trunc from 0x01dfe3 to 0x022812 (0x4830 bytes) 000791 1788882198.361187 read 0x006e20 thru 0x010489 (0x966a bytes) 000792 1788882198.361635 mapread 0x00e8b4 thru 0x010d1e (0x246b bytes) 000793 1788882198.362340 read 0x01b67d thru 0x01e730 (0x30b4 bytes) 000794 1788882198.366984 MIRROR_RESYNC 2 mirrors 000795 1788882198.559358 mapwrite 0x03138b thru 0x0353df (0x4055 bytes) 000796 1788882198.603928 trunc from 0x0353e0 to 0x036493 (0x10b4 bytes) 000797 1788882198.610261 read 0x03287f thru 0x035d22 (0x34a4 bytes) 000799 1788882198.611144 trunc from 0x036494 to 0x031f0b (0x4588 bytes) 000800 1788882198.615754 write 0x01c578 thru 0x02c1cf (0xfc58 bytes) 000803 1788882198.619038 mapwrite 0x0181ca thru 0x01d58e (0x53c5 bytes) 000804 1788882198.637082 mapwrite 0x01da77 thru 0x02460c (0x6b96 bytes) 000805 1788882198.651323 read 0x02f00b thru 0x031f0b (0x2f01 bytes) 000806 1788882198.651885 read 0x0227cd thru 0x02b870 (0x90a4 bytes) 000807 1788882198.652327 mapwrite 0x01ef6b thru 0x02b291 (0xc327 bytes) 000808 1788882198.666936 read 0x019d94 thru 0x01e23e (0x44ab bytes) 000809 1788882198.667350 punch from 0x009b92 to 0x00fa70 (0x5edf bytes) 000810 1788882198.669417 read 0x01e5a7 thru 0x02c2fa (0xdd54 bytes) 000811 1788882198.670007 mapread 0x021ffe thru 0x023c88 (0x1c8b bytes) 000812 1788882198.670800 read 0x00a7c7 thru 0x0102e5 (0x5b1f bytes) 000813 1788882198.675126 MIRROR_RESYNC 2 mirrors 000814 1788882198.890290 read 0x01d8d3 thru 0x0218b2 (0x3fe0 bytes) 000815 1788882198.892507 trunc from 0x031f0c to 0x000908 (0x31603 bytes) 000816 1788882198.920457 punch from 0x0006af to 0x000908 (0x25a bytes) 000817 1788882198.922320 write 0x00b976 thru 0x016190 (0xa81b bytes) 000818 1788882198.923359 punch from 0x014a28 to 0x014a92 (0x6b bytes) 000820 1788882198.927848 read 0x00940a thru 0x009e58 (0xa4f bytes) 000821 1788882198.930689 trunc from 0x016191 to 0x002b00 (0x13690 bytes) 000822 1788882198.936488 punch from 0x000f17 to 0x002b00 (0x1bea bytes) 000823 1788882198.938085 punch from 0x0002d3 to 0x002b00 (0x282e bytes) 000825 1788882198.940175 trunc from 0x002b01 to 0x01fe1a (0x1d31a bytes) 000826 1788882198.944857 trunc from 0x01fe1b to 0x016af2 (0x9328 bytes) 000827 1788882198.950458 MIRROR_RESYNC 2 mirrors 000828 1788882199.138286 punch from 0x00f21c to 0x016af2 (0x78d7 bytes) 000829 1788882199.156698 MIRROR_RESYNC 2 mirrors 000830 1788882199.353212 read 0x004105 thru 0x006646 (0x2542 bytes) 000832 1788882199.355729 write 0x00c84f thru 0x016760 (0x9f12 bytes) 000833 1788882199.375624 trunc from 0x016af3 to 0x0177f7 (0xd05 bytes) 000834 1788882199.381494 mapread 0x014fb1 thru 0x01651e (0x156e bytes) 000837 1788882199.382851 mapwrite 0x0015ad thru 0x00f625 (0xe079 bytes) 000838 1788882199.404393 read 0x015ed4 thru 0x0177f7 (0x1924 bytes) 000841 1788882199.407736 trunc from 0x0177f8 to 0x030f33 (0x1973c bytes) 000842 1788882199.412565 mapread 0x029662 thru 0x030f33 (0x78d2 bytes) 000844 1788882199.416356 mapwrite 0x00da92 thru 0x00eeb1 (0x1420 bytes) 000845 1788882199.427933 read 0x029545 thru 0x02adc5 (0x1881 bytes) 000846 1788882199.428371 mapwrite 0x016cd8 thru 0x01dd2e (0x7057 bytes) 000847 1788882199.442355 read 0x00ff26 thru 0x01897b (0x8a56 bytes) 000848 1788882199.442806 mapread 0x01449b thru 0x016336 (0x1e9c bytes) 000849 1788882199.445341 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x30f34): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30f34): Mirror 5: 0x48bf9c04 (stale) CRC-32 checksum value for chunk [0, 0x30f34): Mirror 1: 0x4e350457 Mirror 6: 0x4e350457 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30f34: skipped 000850 1788882199.687447 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30f34): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30f34): Mirror 5: 0x48bf9c04 (stale) CRC-32 checksum value for chunk [0, 0x30f34): Mirror 1: 0x4e350457 Mirror 6: 0x4e350457 Mirror 7: 0x4e350457 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30f34: skipped 000851 1788882199.951068 read 0x004c49 thru 0x009eee (0x52a6 bytes) 000852 1788882199.956369 read 0x01045d thru 0x018c42 (0x87e6 bytes) 000854 1788882199.963887 trunc from 0x030f34 to 0x0358c3 (0x4990 bytes) 000857 1788882199.990917 MIRROR_RESYNC 4 mirrors 000858 1788882200.252377 mapwrite 0x00f2aa thru 0x010d81 (0x1ad8 bytes) 000859 1788882200.298139 trunc from 0x0358c4 to 0x00beef (0x299d4 bytes) 000860 1788882200.303762 write 0x03e047 thru 0x03ffff (0x1fb9 bytes) 000861 1788882200.304677 mapread 0x00b89e thru 0x018705 (0xce68 bytes) 000863 1788882200.310116 read 0x00cfab thru 0x016a6e (0x9ac4 bytes) 000864 1788882200.310689 mapread 0x023163 thru 0x02ca4b (0x98e9 bytes) 000865 1788882200.316241 mapwrite 0x00331a thru 0x006e6e (0x3b55 bytes) 000866 1788882200.334432 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe5789bd4 (stale) Mirror 6: 0xe5789bd4 (stale) Mirror 7: 0xe5789bd4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe6b31cb7 Mirror 8: 0xe6b31cb7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000867 1788882200.601942 read 0x0125cc thru 0x01a0c2 (0x7af7 bytes) 000868 1788882200.605018 mapread 0x017c38 thru 0x0188b8 (0xc81 bytes) 000870 1788882200.605724 read 0x01bb5d thru 0x025968 (0x9e0c bytes) 000871 1788882200.610661 mapwrite 0x028512 thru 0x0344b1 (0xbfa0 bytes) 000872 1788882200.675307 write 0x00fcaf thru 0x010232 (0x584 bytes) 000874 1788882200.678805 mapwrite 0x03a707 thru 0x03ffff (0x58f9 bytes) 000875 1788882200.699510 mapwrite 0x032560 thru 0x033f3e (0x19df bytes) 000877 1788882200.712103 trunc from 0x040000 to 0x00e88f (0x31770 bytes) 000879 1788882200.725401 punch from 0x00e3ca to 0x00e88f (0x4c6 bytes) 000881 1788882200.727560 trunc from 0x00e890 to 0x03e2af (0x2fa20 bytes) 000885 1788882200.735584 MIRROR_RESYNC 5 mirrors 000886 1788882201.018635 read 0x0191a4 thru 0x0236ba (0xa517 bytes) 000888 1788882201.022493 MIRROR_RESYNC 5 mirrors 000889 1788882201.146360 trunc from 0x03e2b0 to 0x03721d (0x7092 bytes) 000891 1788882201.170407 trunc from 0x03721e to 0x00660c (0x30c11 bytes) 000892 1788882201.176600 mapread 0x001baa thru 0x00660c (0x4a63 bytes) 000893 1788882201.182080 read 0x002d2b thru 0x00660c (0x38e2 bytes) 000896 1788882201.184995 MIRROR_RESYNC 5 mirrors 000897 1788882201.417965 mapread 0x003ac0 thru 0x00660c (0x2b4d bytes) 000899 1788882201.422917 punch from 0x000333 to 0x00660c (0x62da bytes) 000900 1788882201.440031 write 0x03a2fa thru 0x03ffff (0x5d06 bytes) 000901 1788882201.440989 punch from 0x038086 to 0x038230 (0x1ab bytes) 000902 1788882201.444188 punch from 0x02bbba to 0x02be52 (0x299 bytes) 000905 1788882201.446525 punch from 0x0329f4 to 0x034aac (0x20b9 bytes) 000906 1788882201.448265 punch from 0x006b30 to 0x010ff3 (0xa4c4 bytes) 000913 1788882201.451877 read 0x011c1a thru 0x01adee (0x91d5 bytes) 000915 1788882201.456892 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x513b270e (stale) Mirror 7: 0x513b270e (stale) Mirror 8: 0x513b270e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x513b270e (stale) Mirror 7: 0x513b270e (stale) Mirror 8: 0x513b270e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000916 1788882201.558959 punch from 0x022b82 to 0x02a502 (0x7981 bytes) 000917 1788882201.560734 read 0x0205d4 thru 0x02cb41 (0xc56e bytes) 000919 1788882201.564358 mapread 0x016f5e thru 0x01ad1c (0x3dbf bytes) 000922 1788882201.571377 mapread 0x009ec5 thru 0x00d920 (0x3a5c bytes) 000923 1788882201.575128 mapread 0x028031 thru 0x02cf3f (0x4f0f bytes) 000924 1788882201.575908 punch from 0x01971d to 0x01b9d7 (0x22bb bytes) 000926 1788882201.578479 punch from 0x03c63f to 0x03dce5 (0x16a7 bytes) 000927 1788882201.580328 punch from 0x009a78 to 0x00f4fc (0x5a85 bytes) 000929 1788882201.582573 write 0x0378c6 thru 0x03ffff (0x873a bytes) 000930 1788882201.585215 mapwrite 0x00e538 thru 0x017ef2 (0x99bb bytes) 000931 1788882201.603971 punch from 0x02a511 to 0x02f238 (0x4d28 bytes) 000932 1788882201.607644 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x513b270e (stale) Mirror 7: 0x513b270e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x513b270e (stale) Mirror 7: 0x513b270e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000934 1788882201.692536 trunc from 0x040000 to 0x00a6c9 (0x35936 bytes) 000935 1788882201.701463 trunc from 0x00a6ca to 0x000f6d (0x975c bytes) 000936 1788882201.706104 punch from 0x000641 to 0x000f6d (0x92d bytes) 000938 1788882201.708542 trunc from 0x000f6e to 0x009c5f (0x8cf2 bytes) 000942 1788882201.715467 MIRROR_RESYNC 3 mirrors 000943 1788882201.928298 write 0x02e8c4 thru 0x0313eb (0x2b28 bytes) 000944 1788882201.945310 punch from 0x01af26 to 0x01c6d8 (0x17b3 bytes) 000945 1788882201.948549 read 0x010a57 thru 0x01e25a (0xd804 bytes) 000947 1788882201.952021 trunc from 0x0313ec to 0x038ec9 (0x7ade bytes) 000949 1788882201.962421 mapwrite 0x002a04 thru 0x00838c (0x5989 bytes) 000950 1788882201.982946 read 0x01f6c1 thru 0x029164 (0x9aa4 bytes) 000951 1788882201.986267 write 0x01e3c0 thru 0x01fdee (0x1a2f bytes) 000952 1788882201.986901 punch from 0x017bb6 to 0x023871 (0xbcbc bytes) 000953 1788882201.990168 mapread 0x02b6c5 thru 0x030074 (0x49b0 bytes) 000954 1788882201.990765 mapread 0x02a178 thru 0x02d043 (0x2ecc bytes) 000955 1788882201.991220 read 0x01ba3c thru 0x026435 (0xa9fa bytes) 000956 1788882201.994095 punch from 0x02501f to 0x02ae0e (0x5df0 bytes) 000958 1788882201.996342 punch from 0x027154 to 0x036b7e (0xfa2b bytes) 000960 1788882201.998701 write 0x024291 thru 0x0299ac (0x571c bytes) 000961 1788882202.000826 read 0x016b65 thru 0x0192a8 (0x2744 bytes) 000963 1788882202.003219 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x61e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38eca): Mirror 7: 0xdefffb30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38eca): Mirror 7: 0xdefffb30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38eca: skipped 000967 1788882202.084271 mapread 0x00c149 thru 0x010e97 (0x4d4f bytes) 000968 1788882202.090397 trunc from 0x038eca to 0x0244df (0x149ea bytes) 000971 1788882202.096064 read 0x024144 thru 0x0244df (0x39c bytes) 000972 1788882202.098095 read 0x01588a thru 0x0215c2 (0xbd39 bytes) 000973 1788882202.101126 trunc from 0x0244e0 to 0x009ec5 (0x1a61a bytes) 000974 1788882202.105863 punch from 0x008afd to 0x009ec5 (0x13c9 bytes) 000976 1788882202.108018 mapwrite 0x03b45d thru 0x03e8d6 (0x347a bytes) 000978 1788882202.128469 punch from 0x021447 to 0x02e514 (0xd0ce bytes) 000979 1788882202.130447 trunc from 0x03e8d7 to 0x00257d (0x3c359 bytes) 000980 1788882202.135226 read 0x001f3f thru 0x00257d (0x63f bytes) 000981 1788882202.135627 write 0x01d485 thru 0x024828 (0x73a4 bytes) 000982 1788882202.136478 mapread 0x021487 thru 0x024828 (0x33a2 bytes) 000984 1788882202.137619 write 0x01e1d6 thru 0x024611 (0x643c bytes) 000985 1788882202.138370 mapwrite 0x0154b0 thru 0x023cfc (0xe84d bytes) 000986 1788882202.158243 punch from 0x003088 to 0x00d87f (0xa7f8 bytes) 000987 1788882202.160313 mapread 0x00bbbb thru 0x01a7b8 (0xebfe bytes) 000989 1788882202.165739 read 0x0068f6 thru 0x00be8c (0x5597 bytes) 000990 1788882202.168463 mapread 0x01de77 thru 0x023264 (0x53ee bytes) 000992 1788882202.169396 punch from 0x0019ec to 0x0119b3 (0xffc8 bytes) 000993 1788882202.171478 punch from 0x0135c1 to 0x01ef10 (0xb950 bytes) 000997 1788882202.174753 write 0x03463a thru 0x03daed (0x94b4 bytes) 000998 1788882202.176114 trunc from 0x03daee to 0x035060 (0x8a8d bytes) 000999 1788882202.182167 mapwrite 0x00309d thru 0x00cf31 (0x9e95 bytes) 001000 1788882202.210651 mapwrite 0x010001 thru 0x01aaa3 (0xaaa3 bytes) All operations completed A-OK!