== sanity-flr test 70a: flr mode fsx test ================ 12:38:22 (1789317502) Seed set to 7503 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1789317503.962024 write 0x0015e1 thru 0x00cf0f (0xb92f bytes) 000003 1789317503.970007 read 0x000836 thru 0x00a1e3 (0x99ae bytes) 000004 1789317503.974454 write 0x0315eb thru 0x036290 (0x4ca6 bytes) 000006 1789317503.976138 write 0x00ad64 thru 0x00d1d6 (0x2473 bytes) 000007 1789317503.980564 write 0x0294e7 thru 0x0378e4 (0xe3fe bytes) 000009 1789317503.985388 write 0x02e8fd thru 0x02fffd (0x1701 bytes) 000010 1789317503.986065 write 0x03d822 thru 0x03ffff (0x27de bytes) 000011 1789317503.986887 write 0x01ffe3 thru 0x0224be (0x24dc bytes) 000013 1789317503.995773 mapwrite 0x023421 thru 0x024e8b (0x1a6b bytes) 000014 1789317504.053758 read 0x009b88 thru 0x012664 (0x8add bytes) 000015 1789317504.069844 punch from 0x01fc84 to 0x02a61c (0xa999 bytes) 000016 1789317504.075476 write 0x0061c9 thru 0x0136a6 (0xd4de bytes) 000018 1789317504.077307 write 0x00e243 thru 0x01dbf1 (0xf9af bytes) truncating to largest ever: 0x36ef 000021 1789317504.080220 trunc from 0x040000 to 0x0036ee (0x3c911 bytes) truncating to largest ever: 0x1b2f8 000022 1789317504.092593 trunc from 0x0036ef to 0x01b2f7 (0x17c09 bytes) 000024 1789317504.103557 write 0x01affc thru 0x02213b (0x7140 bytes) truncating to largest ever: 0x33486 000025 1789317504.109234 trunc from 0x02213c to 0x033485 (0x1134a bytes) 000026 1789317504.115066 punch from 0x00ed6e to 0x01ccb3 (0xdf46 bytes) 000027 1789317504.121799 punch from 0x027652 to 0x02f4f9 (0x7ea8 bytes) 000028 1789317504.125083 read 0x01cb63 thru 0x0209cc (0x3e6a bytes) 000029 1789317504.131894 read 0x01a492 thru 0x02315c (0x8ccb bytes) 000031 1789317504.133002 read 0x02e0b5 thru 0x033485 (0x53d1 bytes) 000033 1789317504.133770 trunc from 0x033486 to 0x01027e (0x23207 bytes) 000034 1789317504.145621 mapwrite 0x014723 thru 0x01c2b3 (0x7b91 bytes) 000035 1789317504.213752 read 0x0184a5 thru 0x01c2b3 (0x3e0f bytes) 000036 1789317504.214340 write 0x0243bd thru 0x02caf9 (0x873d bytes) 000037 1789317504.215667 mapwrite 0x00e1ff thru 0x010acd (0x28cf bytes) 000038 1789317504.257731 trunc from 0x02cafa to 0x006b29 (0x25fd0 bytes) 000039 1789317504.266531 mapwrite 0x03e37d thru 0x03ffff (0x1c83 bytes) 000040 1789317504.303056 write 0x01e037 thru 0x02cc11 (0xebdb bytes) 000041 1789317504.304196 punch from 0x024b8d to 0x02529b (0x70f bytes) 000043 1789317504.314226 punch from 0x03f188 to 0x03ffff (0xe78 bytes) 000048 1789317504.321770 write 0x03e7c8 thru 0x03ffff (0x1838 bytes) 000049 1789317504.322613 punch from 0x02dcaa to 0x0313db (0x3732 bytes) 000050 1789317504.329854 write 0x00f817 thru 0x01737a (0x7b64 bytes) 000051 1789317504.331110 punch from 0x00929c to 0x013e4a (0xabaf bytes) 000053 1789317504.345890 read 0x032083 thru 0x03cfe4 (0xaf62 bytes) 000054 1789317504.346528 mapwrite 0x03cbb9 thru 0x03ffff (0x3447 bytes) 000056 1789317504.374854 write 0x00c00c thru 0x0163fe (0xa3f3 bytes) 000057 1789317504.380039 punch from 0x01f64e to 0x025964 (0x6317 bytes) truncating to largest ever: 0x3971d 000058 1789317504.397454 trunc from 0x040000 to 0x03971c (0x68e3 bytes) 000061 1789317504.408134 mapread 0x02fdcd thru 0x03971c (0x9950 bytes) 000062 1789317504.409148 trunc from 0x03971d to 0x0141b9 (0x25563 bytes) 000063 1789317504.417556 mapwrite 0x01c017 thru 0x01c416 (0x400 bytes) 000065 1789317504.454994 mapread 0x004dc5 thru 0x014753 (0xf98f bytes) 000067 1789317504.457459 punch from 0x00ff8f to 0x012d32 (0x2da4 bytes) 000068 1789317504.460956 mapwrite 0x02bc6c thru 0x032b12 (0x6ea7 bytes) 000069 1789317504.514742 trunc from 0x032b13 to 0x021a97 (0x1107b bytes) 000070 1789317504.523061 trunc from 0x021a98 to 0x029b88 (0x80f1 bytes) 000071 1789317504.531334 mapwrite 0x0328ef thru 0x0358c8 (0x2fda bytes) 000073 1789317504.560655 mapwrite 0x026c9a thru 0x029524 (0x288b bytes) 000074 1789317504.586949 read 0x012d3e thru 0x01ef69 (0xc22c bytes) 000075 1789317504.594922 punch from 0x00ee31 to 0x0149c3 (0x5b93 bytes) 000077 1789317504.598685 trunc from 0x0358c9 to 0x02d7e1 (0x80e7 bytes) 000079 1789317504.608049 trunc from 0x02d7e2 to 0x0313a9 (0x3bc8 bytes) 000082 1789317504.620294 write 0x0037d6 thru 0x01219d (0xe9c8 bytes) 000083 1789317504.623889 read 0x003678 thru 0x006c76 (0x35ff bytes) 000084 1789317504.624709 write 0x02787d thru 0x02dea9 (0x662d bytes) 000085 1789317504.625853 trunc from 0x0313aa to 0x029be4 (0x77c5 bytes) 000087 1789317504.635339 mapread 0x00d7d4 thru 0x0172e2 (0x9b0f bytes) 000088 1789317504.638943 mapwrite 0x0038aa thru 0x009f3d (0x6694 bytes) 000089 1789317504.665707 write 0x0254ed thru 0x02658c (0x10a0 bytes) 000090 1789317504.666643 read 0x0211bd thru 0x029be4 (0x8a28 bytes) 000091 1789317504.667078 punch from 0x01d9a4 to 0x022be8 (0x5245 bytes) 000092 1789317504.675233 punch from 0x015b27 to 0x01ec43 (0x911d bytes) 000096 1789317504.680504 trunc from 0x029be5 to 0x020424 (0x97c0 bytes) 000097 1789317504.693964 mapwrite 0x03bfe9 thru 0x03ffff (0x4017 bytes) 000098 1789317504.736563 trunc from 0x040000 to 0x02705d (0x18fa2 bytes) 000100 1789317504.747240 trunc from 0x02705e to 0x02e15a (0x70fd bytes) 000102 1789317504.756053 mapwrite 0x039fcc thru 0x03f4e4 (0x5519 bytes) 000104 1789317504.802097 mapwrite 0x0254c9 thru 0x02a14c (0x4c84 bytes) 000105 1789317504.864558 trunc from 0x03f4e5 to 0x01ff58 (0x1f58c bytes) 000106 1789317504.885942 MIRROR_EXTEND to 2 mirrors 000108 1789317505.270728 write 0x0357e2 thru 0x03c2b4 (0x6ad3 bytes) 000109 1789317505.305243 MIRROR_RESYNC 2 mirrors 000110 1789317505.721603 write 0x00597d thru 0x00d3e6 (0x7a6a bytes) 000111 1789317505.746748 write 0x02e24d thru 0x03b127 (0xcedb bytes) 000112 1789317505.755599 mapread 0x00608b thru 0x00703d (0xfb3 bytes) 000113 1789317505.756543 mapread 0x01b1a5 thru 0x020efc (0x5d58 bytes) 000117 1789317505.774245 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000118 1789317505.885802 MIRROR_EXTEND to 2 mirrors 000121 1789317506.244870 MIRROR_RESYNC 2 mirrors 000122 1789317506.418225 mapread 0x020775 thru 0x021280 (0xb0c bytes) 000123 1789317506.433004 MIRROR_EXTEND to 3 mirrors 000124 1789317506.790238 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000125 1789317506.996864 mapread 0x01bff0 thru 0x023b17 (0x7b28 bytes) 000126 1789317507.011400 write 0x001491 thru 0x0029fc (0x156c bytes) 000130 1789317507.049533 mapwrite 0x014b1e thru 0x01709f (0x2582 bytes) 000131 1789317507.088607 mapwrite 0x01b87c thru 0x024da9 (0x952e bytes) 000132 1789317507.126166 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000133 1789317507.205846 mapread 0x01d43e thru 0x029adf (0xc6a2 bytes) 000135 1789317507.231220 write 0x0055a6 thru 0x009da2 (0x47fd bytes) 000136 1789317507.239807 punch from 0x0318ce to 0x0353d0 (0x3b03 bytes) 000138 1789317507.249212 write 0x03be42 thru 0x03ffff (0x41be bytes) 000140 1789317507.254662 read 0x00056d thru 0x00a158 (0x9bec bytes) 000141 1789317507.263147 mapwrite 0x00cbc1 thru 0x0192d9 (0xc719 bytes) 000142 1789317507.300422 mapread 0x005f21 thru 0x014f5e (0xf03e bytes) 000143 1789317507.301343 read 0x00304f thru 0x009ed7 (0x6e89 bytes) 000144 1789317507.301887 mapwrite 0x02318f thru 0x02d7fe (0xa670 bytes) 000145 1789317507.328197 read 0x01fc2c thru 0x0283e5 (0x87ba bytes) 000146 1789317507.328969 trunc from 0x040000 to 0x003217 (0x3cde8 bytes) 000147 1789317507.338103 mapwrite 0x02b84e thru 0x033f12 (0x86c5 bytes) 000149 1789317507.398164 trunc from 0x033f13 to 0x029823 (0xa6ef bytes) 000151 1789317507.409240 mapwrite 0x03e134 thru 0x03ffff (0x1ecc bytes) 000152 1789317507.450947 mapwrite 0x039026 thru 0x03ffff (0x6fda bytes) 000156 1789317507.480936 punch from 0x010fb8 to 0x01306c (0x20b5 bytes) 000157 1789317507.484524 trunc from 0x040000 to 0x03381b (0xc7e4 bytes) 000158 1789317507.493633 read 0x004f43 thru 0x0071e8 (0x22a6 bytes) 000159 1789317507.494399 mapwrite 0x038b6f thru 0x03e61a (0x5aac bytes) 000161 1789317507.522939 mapread 0x024dc9 thru 0x03299c (0xdbd4 bytes) 000163 1789317507.524300 read 0x02382e thru 0x025059 (0x182c bytes) 000164 1789317507.528344 mapwrite 0x026117 thru 0x02d06f (0x6f59 bytes) 000165 1789317507.555509 punch from 0x0391aa to 0x03e61a (0x5471 bytes) 000166 1789317507.559124 mapwrite 0x02cc5a thru 0x03ac71 (0xe018 bytes) 000167 1789317507.589183 write 0x000423 thru 0x009d0a (0x98e8 bytes) 000170 1789317507.591491 mapread 0x0326a3 thru 0x037443 (0x4da1 bytes) 000171 1789317507.592419 mapread 0x011ef1 thru 0x01a48a (0x859a bytes) 000174 1789317507.594462 mapwrite 0x007af5 thru 0x011864 (0x9d70 bytes) 000175 1789317507.621615 read 0x03a5b6 thru 0x03aa6f (0x4ba bytes) 000177 1789317507.626506 mapwrite 0x0140f6 thru 0x01882a (0x4735 bytes) 000178 1789317507.645016 trunc from 0x03e61b to 0x003746 (0x3aed4 bytes) 000179 1789317507.659875 punch from 0x002c1f to 0x003746 (0xb28 bytes) 000180 1789317507.663213 write 0x024b1a thru 0x02bd39 (0x7220 bytes) 000181 1789317507.664450 mapwrite 0x032392 thru 0x036163 (0x3dd2 bytes) 000182 1789317507.705678 mapwrite 0x03fd42 thru 0x03ffff (0x2be bytes) 000183 1789317507.728959 punch from 0x01ff60 to 0x021ece (0x1f6f bytes) 000185 1789317507.732639 mapread 0x038ec7 thru 0x03ffff (0x7139 bytes) 000186 1789317507.733173 write 0x0215cb thru 0x02acc7 (0x96fd bytes) 000187 1789317507.736586 trunc from 0x040000 to 0x0375c2 (0x8a3d bytes) 000188 1789317507.742504 mapread 0x012ec9 thru 0x017c02 (0x4d3a bytes) 000190 1789317507.743808 punch from 0x00e108 to 0x0145ef (0x64e8 bytes) 000191 1789317507.749727 mapread 0x031138 thru 0x0375c2 (0x648b bytes) 000192 1789317507.750321 mapwrite 0x01d3af thru 0x0255e7 (0x8239 bytes) 000193 1789317507.782899 mapread 0x00b964 thru 0x01b64e (0xfceb bytes) 000194 1789317507.806442 MIRROR_EXTEND to 2 mirrors 000195 1789317508.161767 trunc from 0x0375c3 to 0x012f68 (0x2465a bytes) 000196 1789317508.214874 punch from 0x00f718 to 0x012f68 (0x3851 bytes) 000197 1789317508.216800 mapwrite 0x0343a3 thru 0x03db45 (0x97a3 bytes) 000198 1789317508.263058 mapwrite 0x030cbd thru 0x03d7ee (0xcb32 bytes) 000200 1789317508.281185 read 0x038738 thru 0x03db45 (0x540e bytes) 000201 1789317508.281579 read 0x00bb93 thru 0x01b220 (0xf68e bytes) 000203 1789317508.288448 punch from 0x00bfa0 to 0x01690e (0xa96f bytes) 000205 1789317508.290826 mapwrite 0x004804 thru 0x01171f (0xcf1c bytes) 000206 1789317508.338852 punch from 0x03d953 to 0x03db45 (0x1f3 bytes) 000208 1789317508.350641 MIRROR_RESYNC 2 mirrors 000209 1789317508.726389 trunc from 0x03db46 to 0x00751f (0x36626 bytes) 000210 1789317508.775795 mapwrite 0x035da0 thru 0x03ffff (0xa260 bytes) 000211 1789317508.811909 write 0x0075c2 thru 0x00800b (0xa4a bytes) 000214 1789317508.817047 read 0x02397b thru 0x023e25 (0x4ab bytes) 000215 1789317508.822667 mapread 0x03ed88 thru 0x03ffff (0x1278 bytes) 000217 1789317508.823849 trunc from 0x040000 to 0x034ed6 (0xb129 bytes) 000218 1789317508.839553 mapwrite 0x03aa22 thru 0x03ffff (0x55de bytes) 000219 1789317508.891273 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf421a21f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf4512f25 Mirror 3: 0xf4512f25 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000220 1789317509.464129 read 0x000f6f thru 0x007182 (0x6214 bytes) 000221 1789317509.469137 write 0x0243fa thru 0x026ba0 (0x27a7 bytes) 000222 1789317509.495274 punch from 0x012cfe to 0x015be4 (0x2ee7 bytes) 000223 1789317509.501090 read 0x0348e5 thru 0x03ffff (0xb71b bytes) 000224 1789317509.507089 trunc from 0x040000 to 0x00f721 (0x308de bytes) 000226 1789317509.532682 mapread 0x0033a2 thru 0x00690a (0x3569 bytes) 000228 1789317509.538050 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xf722): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf722): Mirror 2: 0x1d283d39 (stale) Mirror 3: 0xb357d3f8 (stale) CRC-32 checksum value for chunk [0, 0xf722): Mirror 1: 0xb357d3f8 Mirror 4: 0xb357d3f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf722: skipped 000230 1789317510.034293 trunc from 0x00f722 to 0x03945b (0x29d3a bytes) 000231 1789317510.108293 trunc from 0x03945c to 0x014776 (0x24ce5 bytes) truncating to largest ever: 0x3cad7 000232 1789317510.129273 trunc from 0x014777 to 0x03cad6 (0x28360 bytes) 000234 1789317510.141920 punch from 0x03196f to 0x0368b0 (0x4f42 bytes) 000235 1789317510.144792 punch from 0x02a151 to 0x02b842 (0x16f2 bytes) 000237 1789317510.150077 mapread 0x0312df thru 0x03cad6 (0xb7f8 bytes) 000238 1789317510.173978 punch from 0x017011 to 0x0180ad (0x109d bytes) 000240 1789317510.183825 MIRROR_RESYNC 4 mirrors 000241 1789317510.725075 trunc from 0x03cad7 to 0x02d8aa (0xf22c bytes) 000243 1789317510.794790 mapread 0x007f1b thru 0x01538d (0xd473 bytes) 000244 1789317510.811455 mapwrite 0x00fe81 thru 0x010325 (0x4a5 bytes) 000246 1789317510.843834 write 0x00c41f thru 0x00cc38 (0x81a bytes) 000247 1789317510.844536 mapwrite 0x033cf5 thru 0x03a0c6 (0x63d2 bytes) 000248 1789317510.897379 punch from 0x01c280 to 0x0255aa (0x932b bytes) 000250 1789317510.901796 write 0x018c69 thru 0x0276a4 (0xea3c bytes) 000251 1789317510.908149 read 0x0059d9 thru 0x005a44 (0x6c bytes) 000252 1789317510.908815 mapread 0x008171 thru 0x0084c2 (0x352 bytes) 000253 1789317510.910073 read 0x028e2d thru 0x02d1da (0x43ae bytes) 000254 1789317510.919948 MIRROR_RESYNC 4 mirrors 000255 1789317511.412810 write 0x01a4be thru 0x026219 (0xbd5c bytes) 000256 1789317511.444789 mapwrite 0x03f8f2 thru 0x03ffff (0x70e bytes) 000257 1789317511.482283 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1385116a (stale) Mirror 4: 0x1385116a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1385116a (stale) Mirror 4: 0x1385116a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000258 1789317511.628949 mapread 0x00b41a thru 0x011783 (0x636a bytes) 000259 1789317511.642772 punch from 0x03a651 to 0x03c4f8 (0x1ea8 bytes) 000262 1789317511.646220 trunc from 0x040000 to 0x0358f7 (0xa708 bytes) 000264 1789317511.663505 MIRROR_RESYNC 3 mirrors 000265 1789317512.020708 punch from 0x025679 to 0x0274c8 (0x1e50 bytes) 000266 1789317512.064457 punch from 0x019bf8 to 0x01ee84 (0x528d bytes) 000267 1789317512.068102 write 0x015e51 thru 0x022369 (0xc519 bytes) 000268 1789317512.080748 punch from 0x01f4d3 to 0x02adbe (0xb8ec bytes) 000269 1789317512.098452 punch from 0x00de69 to 0x00e4ef (0x687 bytes) 000270 1789317512.109213 MIRROR_RESYNC 3 mirrors 000272 1789317512.369501 read 0x01bd85 thru 0x026c34 (0xaeb0 bytes) 000274 1789317512.373441 mapread 0x01a8df thru 0x02567c (0xad9e bytes) 000278 1789317512.378219 punch from 0x00ce86 to 0x01a68b (0xd806 bytes) 000279 1789317512.406000 punch from 0x007fea to 0x017bc7 (0xfbde bytes) 000280 1789317512.410147 write 0x02877f thru 0x02942a (0xcac bytes) 000281 1789317512.423528 MIRROR_RESYNC 3 mirrors 000282 1789317512.748905 punch from 0x01eda0 to 0x0249ea (0x5c4b bytes) 000285 1789317512.770676 punch from 0x02b6ca to 0x03086c (0x51a3 bytes) 000286 1789317512.775913 trunc from 0x0358f8 to 0x01501b (0x208dc bytes) 000288 1789317512.787522 mapread 0x006573 thru 0x00a827 (0x42b5 bytes) 000289 1789317512.794550 MIRROR_RESYNC 3 mirrors 000290 1789317513.048019 mapread 0x0089c7 thru 0x01501b (0xc655 bytes) 000292 1789317513.061871 mapwrite 0x03f770 thru 0x03ffff (0x890 bytes) 000293 1789317513.141090 punch from 0x012272 to 0x017347 (0x50d6 bytes) 000295 1789317513.143877 mapwrite 0x02dc08 thru 0x02e770 (0xb69 bytes) 000296 1789317513.162892 write 0x02bc55 thru 0x031533 (0x58df bytes) 000297 1789317513.163932 trunc from 0x040000 to 0x010109 (0x2fef6 bytes) 000298 1789317513.172788 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1010a): Mirror 4: 0xd474013b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1010a): Mirror 4: 0xd474013b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1010a: skipped 000299 1789317513.321786 mapread 0x008bf4 thru 0x010109 (0x7516 bytes) 000301 1789317513.336982 punch from 0x00b9ea to 0x00ee4c (0x3463 bytes) 000302 1789317513.340024 write 0x00afea thru 0x0139be (0x89d5 bytes) 000303 1789317513.342468 mapread 0x006f29 thru 0x0127fc (0xb8d4 bytes) 000304 1789317513.343325 trunc from 0x0139bf to 0x01d5f2 (0x9c34 bytes) 000305 1789317513.358290 punch from 0x0125c3 to 0x01d5f2 (0xb030 bytes) 000306 1789317513.374078 mapread 0x007f12 thru 0x01429b (0xc38a bytes) 000307 1789317513.380769 mapwrite 0x018365 thru 0x026d65 (0xea01 bytes) 000309 1789317513.438754 trunc from 0x026d66 to 0x02c073 (0x530e bytes) 000312 1789317513.453632 mapwrite 0x0086b1 thru 0x00f562 (0x6eb2 bytes) 000313 1789317513.477826 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2c074): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c074): Mirror 4: 0xd25d9c56 (stale) CRC-32 checksum value for chunk [0, 0x2c074): Mirror 1: 0xb97e29b5 Mirror 5: 0xb97e29b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c074: skipped 000314 1789317513.764683 read 0x015866 thru 0x01cee8 (0x7683 bytes) 000315 1789317513.767673 mapwrite 0x01bbf8 thru 0x01f9ec (0x3df5 bytes) 000316 1789317513.851711 read 0x008642 thru 0x0160b9 (0xda78 bytes) 000317 1789317513.857357 punch from 0x0075d7 to 0x00e635 (0x705f bytes) 000318 1789317513.860088 mapread 0x01e579 thru 0x025541 (0x6fc9 bytes) 000320 1789317513.861541 trunc from 0x02c074 to 0x02a191 (0x1ee2 bytes) 000321 1789317513.887772 punch from 0x0260a9 to 0x029a34 (0x398c bytes) 000322 1789317513.893031 mapwrite 0x01efd3 thru 0x023dfa (0x4e28 bytes) 000323 1789317513.926003 mapwrite 0x039b90 thru 0x03ffff (0x6470 bytes) 000324 1789317513.953453 mapwrite 0x01b3c1 thru 0x021745 (0x6385 bytes) 000325 1789317513.980712 read 0x03476b thru 0x03b458 (0x6cee bytes) truncating to largest ever: 0x3eec6 000326 1789317513.982608 trunc from 0x040000 to 0x03eec5 (0x113a bytes) 000327 1789317513.997569 mapwrite 0x01837f thru 0x026c6a (0xe8ec bytes) 000328 1789317514.028075 punch from 0x013d5e to 0x021cd1 (0xdf74 bytes) 000329 1789317514.033472 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eec6): Mirror 4: 0x118e0a31 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eec6): Mirror 4: 0x118e0a31 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eec6: skipped 000330 1789317514.169055 trunc from 0x03eec6 to 0x0118f3 (0x2d5d2 bytes) 000331 1789317514.180287 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000332 1789317514.243963 write 0x001a60 thru 0x00c1dc (0xa77d bytes) 000336 1789317514.250776 mapread 0x000cf4 thru 0x00e0ff (0xd40c bytes) 000337 1789317514.262029 trunc from 0x0118f4 to 0x02e492 (0x1cb9f bytes) 000340 1789317514.279104 mapread 0x01005c thru 0x01261f (0x25c4 bytes) 000341 1789317514.285762 mapwrite 0x0312f3 thru 0x039218 (0x7f26 bytes) 000342 1789317514.357231 mapwrite 0x0218c2 thru 0x02af5f (0x969e bytes) 000344 1789317514.401780 mapread 0x028b66 thru 0x02ca23 (0x3ebe bytes) 000345 1789317514.403307 trunc from 0x039219 to 0x0033d8 (0x35e40 bytes) 000347 1789317514.422887 read 0x001e28 thru 0x0033d8 (0x15b1 bytes) 000348 1789317514.424690 mapread 0x002c36 thru 0x0033d8 (0x7a3 bytes) 000350 1789317514.426275 mapwrite 0x008604 thru 0x017f85 (0xf982 bytes) 000352 1789317514.479862 mapwrite 0x024fec thru 0x025baa (0xbbf bytes) 000354 1789317514.527930 write 0x005d00 thru 0x011082 (0xb383 bytes) 000355 1789317514.528724 read 0x00b946 thru 0x016b68 (0xb223 bytes) 000357 1789317514.530189 trunc from 0x025bab to 0x018d63 (0xce47 bytes) 000358 1789317514.537748 trunc from 0x018d64 to 0x019d13 (0xfb0 bytes) 000359 1789317514.545844 write 0x001e0e thru 0x003126 (0x1319 bytes) 000361 1789317514.547726 punch from 0x015cb3 to 0x019d13 (0x4061 bytes) 000363 1789317514.556607 trunc from 0x019d14 to 0x00ca09 (0xd30a bytes) 000364 1789317514.566001 punch from 0x00b1f4 to 0x00ca09 (0x1816 bytes) 000366 1789317514.569514 read 0x009978 thru 0x00c855 (0x2ede bytes) 000367 1789317514.574503 mapwrite 0x007cbd thru 0x00b918 (0x3c5c bytes) 000368 1789317514.604749 trunc from 0x00ca0a to 0x00bd9e (0xc6b bytes) 000369 1789317514.614617 mapread 0x0011b1 thru 0x00b1e5 (0xa035 bytes) 000371 1789317514.615816 mapwrite 0x03877b thru 0x03ffff (0x7885 bytes) 000373 1789317514.673858 trunc from 0x040000 to 0x0077f6 (0x38809 bytes) 000375 1789317514.686826 read 0x00096f thru 0x0077f6 (0x6e88 bytes) 000377 1789317514.687790 write 0x00d5e0 thru 0x019c12 (0xc633 bytes) 000378 1789317514.688762 punch from 0x018c0b to 0x019c12 (0x1008 bytes) 000379 1789317514.699657 punch from 0x0134cd to 0x01486e (0x13a2 bytes) 000380 1789317514.702825 write 0x023fd5 thru 0x03376e (0xf79a bytes) 000381 1789317514.704349 trunc from 0x03376f to 0x03b909 (0x819b bytes) 000382 1789317514.718514 mapwrite 0x009431 thru 0x01828b (0xee5b bytes) 000383 1789317514.763275 write 0x026de3 thru 0x02ed63 (0x7f81 bytes) 000384 1789317514.764345 punch from 0x03236e to 0x038194 (0x5e27 bytes) 000385 1789317514.775091 mapread 0x02ffb4 thru 0x03b909 (0xb956 bytes) 000386 1789317514.786115 mapwrite 0x003759 thru 0x010263 (0xcb0b bytes) 000388 1789317514.808514 trunc from 0x03b90a to 0x0239bd (0x17f4c bytes) 000390 1789317514.820594 punch from 0x005a7a to 0x00af6f (0x54f6 bytes) 000394 1789317514.826718 trunc from 0x0239be to 0x01af51 (0x8a6c bytes) 000395 1789317514.836179 MIRROR_EXTEND to 2 mirrors 000397 1789317515.169796 punch from 0x00ba07 to 0x00c286 (0x880 bytes) 000398 1789317515.195684 write 0x021b0e thru 0x0284ec (0x69df bytes) 000399 1789317515.196918 read 0x01a036 thru 0x020cae (0x6c79 bytes) 000400 1789317515.200905 trunc from 0x0284ed to 0x0023f8 (0x260f4 bytes) 000401 1789317515.214888 trunc from 0x0023f9 to 0x012c58 (0x10860 bytes) 000402 1789317515.230604 mapread 0x00b125 thru 0x00b9fa (0x8d6 bytes) 000403 1789317515.237563 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x12c59): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12c59): Mirror 2: 0x88407369 (stale) CRC-32 checksum value for chunk [0, 0x12c59): Mirror 1: 0xefbf0f7b Mirror 3: 0xefbf0f7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12c59: skipped 000404 1789317515.694652 write 0x02789a thru 0x036139 (0xe8a0 bytes) truncating to largest ever: 0x3f585 000405 1789317515.725281 trunc from 0x03613a to 0x03f584 (0x944b bytes) 000406 1789317515.741730 mapwrite 0x01d806 thru 0x01edf5 (0x15f0 bytes) 000407 1789317515.768657 write 0x010b44 thru 0x013f65 (0x3422 bytes) 000409 1789317515.774311 mapwrite 0x029d30 thru 0x034346 (0xa617 bytes) 000410 1789317515.796351 MIRROR_RESYNC 3 mirrors 000411 1789317516.061386 trunc from 0x03f585 to 0x0007a8 (0x3eddc bytes) 000412 1789317516.102416 trunc from 0x0007a9 to 0x03d1cf (0x3ca27 bytes) 000413 1789317516.108995 read 0x00a167 thru 0x019baa (0xfa44 bytes) 000414 1789317516.114770 mapread 0x026faf thru 0x02ef0c (0x7f5e bytes) 000415 1789317516.124600 mapread 0x005b9b thru 0x0111c0 (0xb626 bytes) 000416 1789317516.131910 trunc from 0x03d1d0 to 0x012e61 (0x2a36e bytes) 000419 1789317516.145067 punch from 0x011699 to 0x012e61 (0x17c9 bytes) 000421 1789317516.148458 write 0x019a86 thru 0x025884 (0xbdff bytes) 000424 1789317516.152000 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25885): Mirror 3: 0x7d07a5d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25885): Mirror 3: 0x7d07a5d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25885: skipped 000426 1789317516.319840 trunc from 0x025885 to 0x019b4e (0xbd36 bytes) 000427 1789317516.325812 write 0x03e7a8 thru 0x03ffff (0x1858 bytes) 000428 1789317516.326613 mapread 0x02a388 thru 0x0314cf (0x7148 bytes) 000430 1789317516.334591 trunc from 0x040000 to 0x00a5ad (0x35a52 bytes) 000431 1789317516.344690 punch from 0x003ec3 to 0x009367 (0x54a5 bytes) 000434 1789317516.350934 trunc from 0x00a5ae to 0x033429 (0x28e7c bytes) 000435 1789317516.361961 trunc from 0x03342a to 0x01e8a0 (0x14b89 bytes) 000437 1789317516.371051 trunc from 0x01e8a1 to 0x0149f6 (0x9eaa bytes) 000438 1789317516.379606 mapwrite 0x029881 thru 0x0300c3 (0x6843 bytes) 000439 1789317516.426192 mapwrite 0x039ba8 thru 0x03ff98 (0x63f1 bytes) 000440 1789317516.469720 read 0x00884f thru 0x018461 (0xfc13 bytes) 000441 1789317516.474533 read 0x030313 thru 0x03bb7c (0xb86a bytes) 000442 1789317516.479409 trunc from 0x03ff99 to 0x0123d9 (0x2dbbf bytes) 000443 1789317516.486530 mapwrite 0x03387b thru 0x036258 (0x29de bytes) 000444 1789317516.526627 mapread 0x01d3f9 thru 0x01fa2c (0x2634 bytes) 000446 1789317516.542896 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000447 1789317516.606947 punch from 0x001981 to 0x0052f4 (0x3974 bytes) 000449 1789317516.609406 trunc from 0x036259 to 0x010314 (0x25f44 bytes) 000450 1789317516.619228 punch from 0x00491a to 0x010314 (0xb9fb bytes) 000452 1789317516.622967 trunc from 0x010315 to 0x029f46 (0x19c32 bytes) 000453 1789317516.629195 mapread 0x022544 thru 0x029f46 (0x7a03 bytes) 000454 1789317516.635585 mapread 0x013f17 thru 0x01a6b1 (0x679b bytes) 000455 1789317516.638914 mapread 0x021b72 thru 0x029f46 (0x83d5 bytes) 000456 1789317516.639648 punch from 0x007397 to 0x016e6c (0xfad6 bytes) 000457 1789317516.643304 MIRROR_EXTEND to 2 mirrors 000458 1789317516.912349 trunc from 0x029f47 to 0x003ef1 (0x26055 bytes) 000459 1789317516.936310 mapwrite 0x0365c2 thru 0x0369b2 (0x3f1 bytes) 000460 1789317516.954924 mapread 0x016c0a thru 0x019a9d (0x2e94 bytes) 000463 1789317516.961385 write 0x025a1a thru 0x02b17a (0x5761 bytes) 000465 1789317516.965744 punch from 0x023e89 to 0x02b759 (0x78d1 bytes) 000466 1789317516.970441 read 0x00e64f thru 0x016d65 (0x8717 bytes) 000472 1789317516.974148 punch from 0x029b44 to 0x02d761 (0x3c1e bytes) 000473 1789317516.976187 mapwrite 0x03b285 thru 0x03ffff (0x4d7b bytes) 000475 1789317517.001463 punch from 0x03f212 to 0x03ffff (0xdee bytes) 000476 1789317517.009584 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000477 1789317517.055628 trunc from 0x040000 to 0x01e881 (0x2177e bytes) 000478 1789317517.059881 punch from 0x01354f to 0x01e881 (0xb333 bytes) 000480 1789317517.062309 punch from 0x007b13 to 0x017ad2 (0xffc0 bytes) 000482 1789317517.064502 trunc from 0x01e882 to 0x03ad36 (0x1c4b5 bytes) 000483 1789317517.068893 write 0x00035d thru 0x00cda6 (0xca4a bytes) 000488 1789317517.075007 mapwrite 0x02f602 thru 0x035ba7 (0x65a6 bytes) 000490 1789317517.114504 write 0x03d4b0 thru 0x03ffff (0x2b50 bytes) 000491 1789317517.115492 write 0x00f08e thru 0x01402d (0x4fa0 bytes) 000492 1789317517.124683 mapread 0x016b43 thru 0x018210 (0x16ce bytes) 000494 1789317517.131789 mapwrite 0x01a734 thru 0x025c6a (0xb537 bytes) 000495 1789317517.168854 write 0x00cc33 thru 0x01a707 (0xdad5 bytes) 000497 1789317517.170588 mapwrite 0x01bb5c thru 0x020a44 (0x4ee9 bytes) 000498 1789317517.212139 punch from 0x0268ed to 0x033849 (0xcf5d bytes) 000499 1789317517.225736 MIRROR_EXTEND to 2 mirrors 000500 1789317517.554503 mapread 0x038715 thru 0x03ffff (0x78eb bytes) 000501 1789317517.578197 mapwrite 0x008971 thru 0x018911 (0xffa1 bytes) 000502 1789317517.688943 mapwrite 0x011b61 thru 0x01438c (0x282c bytes) 000503 1789317517.721614 write 0x016a9b thru 0x02522a (0xe790 bytes) 000504 1789317517.728261 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000506 1789317517.785055 punch from 0x00eea9 to 0x01dacc (0xec24 bytes) 000507 1789317517.786922 mapwrite 0x01a492 thru 0x02277c (0x82eb bytes) 000508 1789317517.820482 mapread 0x02c70d thru 0x036270 (0x9b64 bytes) 000509 1789317517.829118 trunc from 0x040000 to 0x035c6c (0xa393 bytes) 000510 1789317517.849387 MIRROR_EXTEND to 2 mirrors 000512 1789317518.089212 read 0x011198 thru 0x01587e (0x46e7 bytes) 000513 1789317518.093855 mapwrite 0x032701 thru 0x03ffff (0xd8ff bytes) 000514 1789317518.179637 mapread 0x02fa41 thru 0x0306f3 (0xcb3 bytes) 000518 1789317518.181983 write 0x00f4dd thru 0x019dbd (0xa8e1 bytes) 000519 1789317518.186813 trunc from 0x040000 to 0x029513 (0x16aec bytes) 000520 1789317518.194585 write 0x02afe0 thru 0x035c76 (0xac97 bytes) 000522 1789317518.199280 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35c77): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c77): Mirror 2: 0x377a8482 (stale) CRC-32 checksum value for chunk [0, 0x35c77): Mirror 1: 0xebf3e445 Mirror 3: 0xebf3e445 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c77: skipped 000523 1789317518.606149 punch from 0x0326bb to 0x035c76 (0x35bc bytes) 000524 1789317518.636864 MIRROR_RESYNC 3 mirrors 000525 1789317518.953631 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000526 1789317519.088742 mapwrite 0x00fdd3 thru 0x017ed6 (0x8104 bytes) 000528 1789317519.185804 mapread 0x02c488 thru 0x034fc2 (0x8b3b bytes) 000529 1789317519.199718 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35c77): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c77): Mirror 3: 0xa884a01b (stale) CRC-32 checksum value for chunk [0, 0x35c77): Mirror 1: 0xffe89ad7 Mirror 4: 0xffe89ad7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c77: skipped 000533 1789317519.630307 write 0x03d587 thru 0x03ffff (0x2a79 bytes) 000536 1789317519.669516 mapread 0x030450 thru 0x03dd06 (0xd8b7 bytes) 000538 1789317519.691148 trunc from 0x040000 to 0x038009 (0x7ff6 bytes) 000540 1789317519.716449 mapwrite 0x00aed5 thru 0x00eccb (0x3df7 bytes) 000541 1789317519.761043 read 0x0088e1 thru 0x00afe1 (0x2701 bytes) 000542 1789317519.761774 punch from 0x01bbb2 to 0x021bf6 (0x6045 bytes) 000543 1789317519.765238 mapwrite 0x027fea thru 0x028bee (0xc05 bytes) 000544 1789317519.799662 read 0x000b98 thru 0x008c83 (0x80ec bytes) 000546 1789317519.809328 mapread 0x021893 thru 0x02276e (0xedc bytes) 000548 1789317519.814129 MIRROR_RESYNC 3 mirrors 000549 1789317520.249078 punch from 0x022616 to 0x027bb1 (0x559c bytes) 000550 1789317520.286138 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3800a): Mirror 4: 0x1420936e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3800a): Mirror 4: 0x1420936e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3800a: skipped 000551 1789317520.442278 mapread 0x0080a1 thru 0x00c6d6 (0x4636 bytes) 000552 1789317520.453893 punch from 0x01d385 to 0x02a453 (0xd0cf bytes) 000553 1789317520.462860 MIRROR_RESYNC 2 mirrors 000554 1789317520.862324 mapwrite 0x02df6e thru 0x034d71 (0x6e04 bytes) 000555 1789317520.935874 punch from 0x001b60 to 0x0029bc (0xe5d bytes) 000556 1789317520.938014 mapread 0x013f8d thru 0x01a4ed (0x6561 bytes) 000558 1789317520.943967 MIRROR_RESYNC 2 mirrors 000559 1789317521.258429 write 0x005a5d thru 0x01022e (0xa7d2 bytes) 000560 1789317521.285905 MIRROR_RESYNC 2 mirrors 000561 1789317521.594566 mapread 0x022874 thru 0x0243a5 (0x1b32 bytes) 000565 1789317521.604134 read 0x022e3f thru 0x02a079 (0x723b bytes) 000566 1789317521.604495 read 0x032237 thru 0x038009 (0x5dd3 bytes) 000567 1789317521.610287 trunc from 0x03800a to 0x0162d8 (0x21d31 bytes) 000568 1789317521.657228 punch from 0x007025 to 0x00de15 (0x6df1 bytes) 000569 1789317521.663702 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000570 1789317521.742612 trunc from 0x0162d9 to 0x0008d2 (0x15a06 bytes) 000571 1789317521.760685 punch from 0x00003d to 0x0008d2 (0x896 bytes) 000572 1789317521.764219 punch from 0x000206 to 0x0008d2 (0x6cd bytes) 000573 1789317521.767286 mapread 0x00062e thru 0x0008d2 (0x2a5 bytes) 000574 1789317521.771680 mapwrite 0x0214c7 thru 0x03097e (0xf4b8 bytes) 000575 1789317521.828466 punch from 0x01e8d3 to 0x0214e5 (0x2c13 bytes) 000576 1789317521.831259 trunc from 0x03097f to 0x03d3d7 (0xca59 bytes) 000578 1789317521.842329 write 0x007730 thru 0x00ab54 (0x3425 bytes) 000580 1789317521.848339 mapread 0x006e3c thru 0x00fb3e (0x8d03 bytes) 000581 1789317521.854106 MIRROR_EXTEND to 2 mirrors 000583 1789317522.227869 write 0x002365 thru 0x00b8d4 (0x9570 bytes) 000585 1789317522.273904 mapwrite 0x038619 thru 0x03ffff (0x79e7 bytes) 000586 1789317522.332785 MIRROR_RESYNC 2 mirrors 000587 1789317522.807821 write 0x005f00 thru 0x0124cd (0xc5ce bytes) 000588 1789317522.848679 mapread 0x019c5e thru 0x02025a (0x65fd bytes) 000589 1789317522.864483 write 0x00f9e7 thru 0x016fbd (0x75d7 bytes) 000590 1789317522.865880 mapread 0x014dad thru 0x01dc76 (0x8eca bytes) 000592 1789317522.867484 mapread 0x03cef0 thru 0x03ffff (0x3110 bytes) 000593 1789317522.877604 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa2df26f1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6f0ff037 Mirror 3: 0x6f0ff037 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000594 1789317523.407409 mapwrite 0x00e594 thru 0x0181b9 (0x9c26 bytes) 000595 1789317523.526735 mapread 0x031a8a thru 0x03e8d1 (0xce48 bytes) 000596 1789317523.541663 mapwrite 0x025b77 thru 0x0356f5 (0xfb7f bytes) 000598 1789317523.576520 write 0x00808a thru 0x00c4e3 (0x445a bytes) truncating to largest ever: 0x3fff0 000599 1789317523.578081 trunc from 0x040000 to 0x03ffef (0x10 bytes) 000600 1789317523.591825 trunc from 0x03fff0 to 0x0167ab (0x29844 bytes) 000602 1789317523.605326 mapread 0x012118 thru 0x015632 (0x351b bytes) 000604 1789317523.607164 mapwrite 0x03f541 thru 0x03ffff (0xabf bytes) 000605 1789317523.668112 write 0x000377 thru 0x004359 (0x3fe3 bytes) 000606 1789317523.678020 read 0x01a24b thru 0x02a072 (0xfe28 bytes) 000607 1789317523.689215 write 0x027bf7 thru 0x032321 (0xa72b bytes) 000608 1789317523.693437 write 0x031d0b thru 0x03ffff (0xe2f5 bytes) 000611 1789317523.695737 trunc from 0x040000 to 0x017d8a (0x28275 bytes) 000613 1789317523.707640 write 0x020381 thru 0x02ff13 (0xfb93 bytes) 000615 1789317523.709554 read 0x013103 thru 0x01ab57 (0x7a55 bytes) 000616 1789317523.714844 trunc from 0x02ff14 to 0x02cbf5 (0x331e bytes) 000617 1789317523.729137 punch from 0x000e4f to 0x00a5fc (0x97ae bytes) 000620 1789317523.740277 punch from 0x001a0b to 0x00a38b (0x8981 bytes) 000621 1789317523.746174 punch from 0x0271cd to 0x02cbf5 (0x5a29 bytes) 000622 1789317523.748765 mapwrite 0x005d3b thru 0x0143bc (0xe682 bytes) 000624 1789317523.797056 punch from 0x017bb3 to 0x022432 (0xa880 bytes) 000625 1789317523.801402 punch from 0x011758 to 0x0206bb (0xef64 bytes) 000626 1789317523.811136 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cbf6): Mirror 3: 0x772a2854 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cbf6): Mirror 3: 0x772a2854 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cbf6: skipped 000627 1789317524.030435 mapwrite 0x039394 thru 0x03ffff (0x6c6c bytes) 000628 1789317524.092083 mapwrite 0x022a20 thru 0x030ecd (0xe4ae bytes) 000629 1789317524.138262 mapwrite 0x038379 thru 0x03ffff (0x7c87 bytes) 000630 1789317524.164620 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6f0ff037 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xde1f209f Mirror 4: 0xde1f209f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000631 1789317524.581821 mapwrite 0x03da54 thru 0x03ffff (0x25ac bytes) 000632 1789317524.709806 write 0x01c8e6 thru 0x021cfd (0x5418 bytes) 000633 1789317524.722440 write 0x01e832 thru 0x0223b5 (0x3b84 bytes) 000636 1789317524.728009 write 0x026240 thru 0x034542 (0xe303 bytes) 000638 1789317524.734822 mapwrite 0x02d171 thru 0x033a30 (0x68c0 bytes) 000639 1789317524.761535 read 0x007a92 thru 0x0093cb (0x193a bytes) 000641 1789317524.766082 mapread 0x03944a thru 0x03f420 (0x5fd7 bytes) 000642 1789317524.769890 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6f0ff037 (stale) Mirror 4: 0xde1f209f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x97cc9eaa Mirror 5: 0x97cc9eaa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000643 1789317525.364418 trunc from 0x040000 to 0x03060a (0xf9f5 bytes) 000644 1789317525.442926 read 0x012d14 thru 0x014690 (0x197d bytes) 000645 1789317525.451043 mapwrite 0x0322d5 thru 0x035136 (0x2e62 bytes) 000646 1789317525.533813 write 0x03a803 thru 0x03ffff (0x57fd bytes) 000647 1789317525.534669 mapwrite 0x0290ef thru 0x02ddd8 (0x4cea bytes) 000648 1789317525.579012 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xde1f209f (stale) Mirror 5: 0x97cc9eaa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xde1f209f (stale) Mirror 5: 0x97cc9eaa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000651 1789317525.790926 trunc from 0x040000 to 0x01e239 (0x21dc6 bytes) 000652 1789317525.806891 mapread 0x009fb5 thru 0x018030 (0xe07c bytes) 000653 1789317525.831445 mapwrite 0x031bde thru 0x032b10 (0xf33 bytes) 000656 1789317525.893028 read 0x02816b thru 0x032b10 (0xa9a6 bytes) 000657 1789317525.896706 trunc from 0x032b11 to 0x01d9f4 (0x1511c bytes) 000659 1789317525.909556 mapread 0x00e10e thru 0x00fd94 (0x1c87 bytes) 000660 1789317525.911755 trunc from 0x01d9f5 to 0x00a95e (0x13096 bytes) 000661 1789317525.928265 trunc from 0x00a95f to 0x0138fc (0x8f9e bytes) 000662 1789317525.938668 write 0x03b6c7 thru 0x03ffff (0x4939 bytes) 000663 1789317525.939812 read 0x00216d thru 0x009ae6 (0x797a bytes) 000664 1789317525.949729 write 0x028882 thru 0x037163 (0xe8e2 bytes) 000665 1789317525.951072 mapwrite 0x01f53b thru 0x028901 (0x93c7 bytes) 000668 1789317525.980406 punch from 0x01701d to 0x018778 (0x175c bytes) 000670 1789317525.988318 read 0x02305d thru 0x02e313 (0xb2b7 bytes) 000673 1789317525.994695 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xde1f209f (stale) Mirror 5: 0x97cc9eaa (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x65fb1f8f Mirror 6: 0x65fb1f8f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000674 1789317526.507127 mapread 0x03b42d thru 0x03ffff (0x4bd3 bytes) 000675 1789317526.528038 write 0x021975 thru 0x02fdc8 (0xe454 bytes) 000676 1789317526.579720 mapwrite 0x02a780 thru 0x037a1a (0xd29b bytes) 000679 1789317526.626795 MIRROR_RESYNC 4 mirrors 000680 1789317527.148287 punch from 0x03f567 to 0x03ffff (0xa99 bytes) 000682 1789317527.203053 trunc from 0x040000 to 0x00328a (0x3cd75 bytes) 000683 1789317527.247352 write 0x00eba4 thru 0x01205d (0x34ba bytes) 000684 1789317527.248461 mapwrite 0x029419 thru 0x02ee8c (0x5a74 bytes) 000685 1789317527.323034 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2ee8d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ee8d): Mirror 4: 0xd5ad5dff (stale) Mirror 5: 0xd5ad5dff (stale) Mirror 6: 0xd5ad5dff (stale) CRC-32 checksum value for chunk [0, 0x2ee8d): Mirror 1: 0xc505dc54 Mirror 7: 0xc505dc54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ee8d: skipped 000687 1789317527.781546 trunc from 0x02ee8d to 0x00da5f (0x2142d bytes) 000689 1789317527.840511 mapwrite 0x014fe2 thru 0x017749 (0x2768 bytes) 000690 1789317527.880760 read 0x0129aa thru 0x013d24 (0x137b bytes) 000692 1789317527.881847 mapread 0x00e355 thru 0x00f707 (0x13b3 bytes) 000693 1789317527.889011 trunc from 0x01774a to 0x029d43 (0x125fa bytes) 000695 1789317527.908230 MIRROR_RESYNC 5 mirrors 000696 1789317528.597681 mapread 0x0129f2 thru 0x01e60c (0xbc1b bytes) 000698 1789317528.621411 mapwrite 0x0225b9 thru 0x025355 (0x2d9d bytes) 000700 1789317528.725219 punch from 0x022929 to 0x028f24 (0x65fc bytes) 000704 1789317528.729512 mapwrite 0x03bf02 thru 0x03e115 (0x2214 bytes) 000705 1789317528.781037 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e116): Mirror 4: 0x9d9db31e (stale) Mirror 5: 0x9d9db31e (stale) Mirror 7: 0x9d9db31e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e116): Mirror 4: 0x9d9db31e (stale) Mirror 5: 0x9d9db31e (stale) Mirror 7: 0x9d9db31e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e116: skipped 000706 1789317529.015440 mapwrite 0x02db0d thru 0x037aca (0x9fbe bytes) 000707 1789317529.073776 punch from 0x01c5ae to 0x025996 (0x93e9 bytes) 000709 1789317529.080672 read 0x019975 thru 0x023804 (0x9e90 bytes) 000710 1789317529.088271 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e116): Mirror 5: 0x9d9db31e (stale) Mirror 7: 0x9d9db31e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e116): Mirror 5: 0x9d9db31e (stale) Mirror 7: 0x9d9db31e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e116: skipped 000713 1789317529.292901 write 0x00b956 thru 0x01550d (0x9bb8 bytes) 000714 1789317529.300658 mapread 0x03ac71 thru 0x03e115 (0x34a5 bytes) 000715 1789317529.314097 punch from 0x037305 to 0x038508 (0x1204 bytes) 000716 1789317529.322671 mapwrite 0x01c97a thru 0x02362d (0x6cb4 bytes) 000718 1789317529.354179 read 0x0322d4 thru 0x03d13a (0xae67 bytes) 000719 1789317529.361053 mapread 0x02e334 thru 0x036784 (0x8451 bytes) 000721 1789317529.367038 mapwrite 0x00a088 thru 0x00f4f6 (0x546f bytes) 000722 1789317529.398150 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e116): Mirror 7: 0x9d9db31e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e116): Mirror 7: 0x9d9db31e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e116: skipped 000723 1789317529.520136 mapwrite 0x01055d thru 0x016d01 (0x67a5 bytes) 000726 1789317529.563743 mapwrite 0x02fd47 thru 0x034364 (0x461e bytes) 000727 1789317529.588597 punch from 0x016e53 to 0x020f13 (0xa0c1 bytes) 000728 1789317529.594673 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e116): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e116): Mirror 7: 0x9d9db31e (stale) CRC-32 checksum value for chunk [0, 0x3e116): Mirror 1: 0xdf42f302 Mirror 8: 0xdf42f302 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e116: skipped 000729 1789317530.053180 mapread 0x02092d thru 0x02b994 (0xb068 bytes) 000730 1789317530.077478 trunc from 0x03e116 to 0x009579 (0x34b9c bytes) 000732 1789317530.169067 trunc from 0x00957a to 0x0330c2 (0x29b49 bytes) 000733 1789317530.179534 punch from 0x01f674 to 0x02571d (0x60aa bytes) 000734 1789317530.182294 mapwrite 0x02036f thru 0x028fc9 (0x8c5b bytes) 000735 1789317530.225206 trunc from 0x0330c3 to 0x00d5c9 (0x25af9 bytes) 000736 1789317530.240892 punch from 0x00b7ab to 0x00d5c9 (0x1e1f bytes) 000738 1789317530.243955 mapread 0x007042 thru 0x00d5c9 (0x6588 bytes) 000739 1789317530.250457 read 0x00d275 thru 0x00d5c9 (0x355 bytes) 000741 1789317530.251321 mapread 0x004048 thru 0x00d5c9 (0x9582 bytes) 000743 1789317530.252630 mapwrite 0x0372cc thru 0x0399e3 (0x2718 bytes) 000744 1789317530.294744 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x399e4): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399e4): Mirror 7: 0x92fd59ec (stale) Mirror 8: 0xa215fea0 (stale) CRC-32 checksum value for chunk [0, 0x399e4): Mirror 1: 0xf34f413e Mirror 9: 0xf34f413e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399e4: skipped 000746 1789317530.857006 write 0x000241 thru 0x004e3d (0x4bfd bytes) 000748 1789317530.929298 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x399e4): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399e4): Mirror 7: 0x92fd59ec (stale) Mirror 8: 0xa215fea0 (stale) Mirror 9: 0xf34f413e (stale) CRC-32 checksum value for chunk [0, 0x399e4): Mirror 1: 0x1ef17c04 Mirror 10: 0x1ef17c04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399e4: skipped 000752 1789317531.601046 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x399e4): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399e4): Mirror 7: 0x92fd59ec (stale) Mirror 8: 0xa215fea0 (stale) Mirror 9: 0xf34f413e (stale) CRC-32 checksum value for chunk [0, 0x399e4): Mirror 1: 0x1ef17c04 Mirror 10: 0x1ef17c04 Mirror 11: 0x1ef17c04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399e4: skipped 000753 1789317532.235200 mapwrite 0x024f8f thru 0x02ad2f (0x5da1 bytes) 000754 1789317532.397327 punch from 0x0261fb to 0x02f5ce (0x93d4 bytes) 000755 1789317532.400165 trunc from 0x0399e4 to 0x029ae6 (0xfefd bytes) 000756 1789317532.415069 punch from 0x00bf54 to 0x0114de (0x558b bytes) 000757 1789317532.419962 punch from 0x027b85 to 0x029ae6 (0x1f62 bytes) 000758 1789317532.424218 read 0x006e82 thru 0x0160ee (0xf26d bytes) 000759 1789317532.433584 mapread 0x028adb thru 0x029ae6 (0x100c bytes) 000760 1789317532.441894 read 0x01128d thru 0x01c01b (0xad8f bytes) 000761 1789317532.473976 mapwrite 0x0331de thru 0x03bda4 (0x8bc7 bytes) 000762 1789317532.541487 trunc from 0x03bda5 to 0x01583b (0x26569 bytes) 000764 1789317532.556674 punch from 0x00e2f1 to 0x0124fb (0x420b bytes) 000765 1789317532.559789 trunc from 0x01583c to 0x00c409 (0x9432 bytes) 000766 1789317532.571043 trunc from 0x00c40a to 0x00d85a (0x1451 bytes) 000768 1789317532.590772 trunc from 0x00d85b to 0x015f39 (0x86df bytes) 000770 1789317532.619012 MIRROR_RESYNC 6 mirrors 000771 1789317533.434850 punch from 0x0066e7 to 0x00bd4d (0x5667 bytes) 000772 1789317533.481862 MIRROR_RESYNC 6 mirrors 000774 1789317534.309964 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000775 1789317534.511763 mapread 0x009487 thru 0x015722 (0xc29c bytes) 000776 1789317534.523103 read 0x00ef1c thru 0x015d4c (0x6e31 bytes) 000777 1789317534.523498 read 0x002c5b thru 0x00bc89 (0x902f bytes) 000778 1789317534.534436 mapread 0x0113fb thru 0x015f39 (0x4b3f bytes) 000779 1789317534.535208 mapwrite 0x032340 thru 0x03f8ec (0xd5ad bytes) 000781 1789317534.653675 trunc from 0x03f8ed to 0x02b4bb (0x14431 bytes) 000784 1789317534.664121 mapread 0x01e648 thru 0x029bdd (0xb596 bytes) 000786 1789317534.666061 write 0x00ebea thru 0x01056a (0x1981 bytes) 000788 1789317534.673918 write 0x026850 thru 0x0317bb (0xaf6c bytes) 000790 1789317534.675115 punch from 0x01bede to 0x022ccf (0x6df2 bytes) 000791 1789317534.683219 mapwrite 0x001af1 thru 0x006353 (0x4863 bytes) 000792 1789317534.761614 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x317bc): Mirror 9: 0xfa75ac56 (stale) Mirror 10: 0xfa75ac56 (stale) Mirror 11: 0xfa75ac56 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x317bc): Mirror 9: 0xfa75ac56 (stale) Mirror 10: 0xfa75ac56 (stale) Mirror 11: 0xfa75ac56 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x317bc: skipped 000793 1789317534.997169 write 0x02b990 thru 0x02c956 (0xfc7 bytes) 000795 1789317535.004062 trunc from 0x0317bc to 0x00e8bd (0x22efe bytes) 000796 1789317535.024598 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xe8be): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe8be): Mirror 9: 0x1549bc6c (stale) Mirror 10: 0x1549bc6c (stale) Mirror 11: 0x1549bc6c (stale) CRC-32 checksum value for chunk [0, 0xe8be): Mirror 1: 0x8826a1d7 Mirror 12: 0x8826a1d7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe8be: skipped 000797 1789317535.558512 trunc from 0x00e8be to 0x0176fe (0x8e41 bytes) 000798 1789317535.598750 mapread 0x00d733 thru 0x0176fe (0x9fcc bytes) 000799 1789317535.609151 write 0x002ef6 thru 0x012e4c (0xff57 bytes) 000800 1789317535.612492 trunc from 0x0176ff to 0x0335e1 (0x1bee3 bytes) 000802 1789317535.628628 write 0x020288 thru 0x0251d4 (0x4f4d bytes) 000805 1789317535.635571 punch from 0x017134 to 0x020b87 (0x9a54 bytes) 000806 1789317535.648073 read 0x01ea22 thru 0x02ceb0 (0xe48f bytes) 000807 1789317535.656956 mapwrite 0x0144cb thru 0x014ab4 (0x5ea bytes) 000808 1789317535.691514 read 0x019025 thru 0x025315 (0xc2f1 bytes) 000810 1789317535.698358 read 0x018653 thru 0x01d897 (0x5245 bytes) 000811 1789317535.701907 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x335e2): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x335e2): Mirror 9: 0x71721fd5 (stale) Mirror 10: 0x71721fd5 (stale) Mirror 11: 0x71721fd5 (stale) Mirror 12: 0x46da492a (stale) CRC-32 checksum value for chunk [0, 0x335e2): Mirror 1: 0xd5b49534 Mirror 13: 0xd5b49534 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x335e2: skipped 000812 1789317536.252186 trunc from 0x0335e2 to 0x039639 (0x6058 bytes) 000813 1789317536.306525 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3963a): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3963a): Mirror 9: 0xe4d27220 (stale) Mirror 10: 0xe4d27220 (stale) Mirror 11: 0xe4d27220 (stale) Mirror 12: 0xba647285 (stale) Mirror 13: 0x45dbe4d7 (stale) CRC-32 checksum value for chunk [0, 0x3963a): Mirror 1: 0x45dbe4d7 Mirror 14: 0x45dbe4d7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3963a: skipped 000814 1789317536.865841 punch from 0x00ae84 to 0x010178 (0x52f5 bytes) 000817 1789317536.917796 mapwrite 0x02c1a1 thru 0x02d327 (0x1187 bytes) 000818 1789317536.944379 trunc from 0x03963a to 0x01dfa9 (0x1b690 bytes) 000820 1789317536.965090 mapread 0x006eec thru 0x011cc1 (0xadd6 bytes) 000821 1789317536.976317 read 0x00759d thru 0x010948 (0x93ac bytes) 000822 1789317536.978163 write 0x03cc9a thru 0x03ffff (0x3366 bytes) 000823 1789317536.978989 mapwrite 0x01db93 thru 0x027f37 (0xa3a5 bytes) 000824 1789317537.036252 mapread 0x03d15b thru 0x03ded3 (0xd79 bytes) 000825 1789317537.037027 write 0x000f26 thru 0x00324e (0x2329 bytes) 000826 1789317537.046070 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x767e6149 (stale) Mirror 10: 0x767e6149 (stale) Mirror 11: 0x767e6149 (stale) Mirror 13: 0xd41c920 (stale) Mirror 14: 0xd41c920 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x767e6149 (stale) Mirror 10: 0x767e6149 (stale) Mirror 11: 0x767e6149 (stale) Mirror 13: 0xd41c920 (stale) Mirror 14: 0xd41c920 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000827 1789317537.287252 mapwrite 0x012bea thru 0x0221bb (0xf5d2 bytes) 000828 1789317537.331151 read 0x02429b thru 0x025bfe (0x1964 bytes) 000829 1789317537.331769 read 0x0024cf thru 0x00416f (0x1ca1 bytes) 000830 1789317537.346442 read 0x020932 thru 0x0304e7 (0xfbb6 bytes) 000831 1789317537.347155 write 0x00a3dd thru 0x00b21b (0xe3f bytes) 000832 1789317537.348149 write 0x03da02 thru 0x03ffff (0x25fe bytes) 000833 1789317537.349095 punch from 0x022c3d to 0x027d1f (0x50e3 bytes) 000838 1789317537.359459 mapwrite 0x001621 thru 0x00be58 (0xa838 bytes) 000839 1789317537.402971 mapread 0x00ffe4 thru 0x0100e4 (0x101 bytes) 000841 1789317537.404248 mapread 0x034afe thru 0x037f39 (0x343c bytes) 000842 1789317537.405023 read 0x037f49 thru 0x038260 (0x318 bytes) 000843 1789317537.406261 mapwrite 0x03f36b thru 0x03ffff (0xc95 bytes) 000846 1789317537.440876 punch from 0x011dfb to 0x01dcf9 (0xbeff bytes) 000848 1789317537.443881 read 0x00c254 thru 0x0174b5 (0xb262 bytes) 000853 1789317537.450138 mapread 0x02afea thru 0x031432 (0x6449 bytes) 000855 1789317537.451881 punch from 0x00edd9 to 0x01dea4 (0xf0cc bytes) 000857 1789317537.455897 mapwrite 0x039ee2 thru 0x03ffff (0x611e bytes) 000858 1789317537.487252 mapread 0x02bc17 thru 0x02f0cc (0x34b6 bytes) 000860 1789317537.488240 read 0x011c52 thru 0x021a20 (0xfdcf bytes) 000861 1789317537.494919 write 0x024814 thru 0x032974 (0xe161 bytes) 000862 1789317537.495835 trunc from 0x040000 to 0x034de5 (0xb21a bytes) 000865 1789317537.511996 mapread 0x009cbe thru 0x00f263 (0x55a6 bytes) 000866 1789317537.513384 write 0x007712 thru 0x00d85b (0x614a bytes) 000867 1789317537.514437 mapwrite 0x02d70d thru 0x038136 (0xaa2a bytes) 000868 1789317537.570258 punch from 0x0169ae to 0x01d315 (0x6968 bytes) 000871 1789317537.573944 punch from 0x0064ae to 0x007998 (0x14eb bytes) 000872 1789317537.578584 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x38137): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38137): Mirror 9: 0xa6621c33 (stale) Mirror 10: 0xa6621c33 (stale) Mirror 11: 0xa6621c33 (stale) Mirror 13: 0x4b548017 (stale) Mirror 14: 0x4b548017 (stale) CRC-32 checksum value for chunk [0, 0x38137): Mirror 1: 0x12ec7726 Mirror 15: 0x12ec7726 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38137: skipped 000873 1789317538.122816 read 0x000120 thru 0x0063a4 (0x6285 bytes) 000874 1789317538.130026 read 0x032e66 thru 0x038136 (0x52d1 bytes) 000875 1789317538.140163 read 0x000f87 thru 0x006b1b (0x5b95 bytes) 000878 1789317538.141158 trunc from 0x038137 to 0x02614f (0x11fe7 bytes) 000879 1789317538.221701 read 0x014a71 thru 0x020628 (0xbbb8 bytes) 000880 1789317538.228038 trunc from 0x026150 to 0x01cffb (0x9154 bytes) 000882 1789317538.244486 trunc from 0x01cffc to 0x01bfc2 (0x1039 bytes) 000883 1789317538.258307 write 0x014d71 thru 0x01ce32 (0x80c2 bytes) 000884 1789317538.260240 write 0x000d36 thru 0x00cd53 (0xc01e bytes) 000885 1789317538.263433 trunc from 0x01ce33 to 0x001c06 (0x1b22c bytes) 000886 1789317538.276606 punch from 0x000bdc to 0x001c06 (0x102b bytes) 000887 1789317538.285218 trunc from 0x001c07 to 0x010703 (0xeafd bytes) 000888 1789317538.314818 read 0x0025f7 thru 0x00344e (0xe58 bytes) 000894 1789317538.329644 mapread 0x000560 thru 0x002efd (0x299e bytes) 000895 1789317538.332837 write 0x02608c thru 0x0276c8 (0x163d bytes) 000896 1789317538.335391 read 0x00ecf2 thru 0x00ef0e (0x21d bytes) 000897 1789317538.335938 write 0x00589b thru 0x0109c5 (0xb12b bytes) 000898 1789317538.337012 trunc from 0x0276c9 to 0x00dff0 (0x196d8 bytes) 000899 1789317538.354987 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0xdff1): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdff1): Mirror 9: 0x3279f7f4 (stale) Mirror 10: 0x3279f7f4 (stale) Mirror 11: 0x3279f7f4 (stale) Mirror 13: 0x13b7f575 (stale) Mirror 14: 0x13b7f575 (stale) Mirror 15: 0x14f7093 (stale) CRC-32 checksum value for chunk [0, 0xdff1): Mirror 1: 0x4d51aa6c Mirror 16: 0x4d51aa6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdff1: skipped 000900 1789317539.036971 read 0x00a435 thru 0x00dff0 (0x3bbc bytes) 000901 1789317539.053880 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xdff1): Mirror 9: 0x3279f7f4 (stale) Mirror 11: 0x3279f7f4 (stale) Mirror 13: 0x13b7f575 (stale) Mirror 14: 0x13b7f575 (stale) Mirror 15: 0x14f7093 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdff1): Mirror 9: 0x3279f7f4 (stale) Mirror 11: 0x3279f7f4 (stale) Mirror 13: 0x13b7f575 (stale) Mirror 14: 0x13b7f575 (stale) Mirror 15: 0x14f7093 (stale) CRC-32 checksum value for chunk [0, 0xdff1): Mirror 1: 0x4d51aa6c Mirror 16: 0x4d51aa6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdff1: skipped 000902 1789317539.423220 read 0x009396 thru 0x00b86e (0x24d9 bytes) 000904 1789317539.427232 trunc from 0x00dff1 to 0x0086d7 (0x5919 bytes) 000905 1789317539.486762 read 0x0039f0 thru 0x0086d7 (0x4ce8 bytes) 000907 1789317539.491654 mapwrite 0x03eb87 thru 0x03ffff (0x1479 bytes) 000909 1789317539.530664 mapwrite 0x01b8af thru 0x0229a8 (0x70fa bytes) 000910 1789317539.555937 mapread 0x00b139 thru 0x01acec (0xfbb4 bytes) 000911 1789317539.559185 MIRROR_RESYNC 7 mirrors 000912 1789317540.264345 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) 000913 1789317540.505128 write 0x030272 thru 0x031753 (0x14e2 bytes) 000914 1789317540.571089 mapread 0x03452f thru 0x03ffff (0xbad1 bytes) 000915 1789317540.596720 mapread 0x00d069 thru 0x01c005 (0xef9d bytes) 000917 1789317540.613342 trunc from 0x040000 to 0x034cc4 (0xb33b bytes) 000919 1789317540.637527 punch from 0x01cdf6 to 0x0202fa (0x3505 bytes) 000923 1789317540.648070 mapwrite 0x012270 thru 0x01f3ea (0xd17b bytes) 000927 1789317540.724975 mapwrite 0x011d22 thru 0x01604d (0x432c bytes) 000929 1789317540.780780 write 0x016931 thru 0x019258 (0x2928 bytes) 000931 1789317540.781833 punch from 0x00dc92 to 0x00e110 (0x47f bytes) 000933 1789317540.794809 punch from 0x00b524 to 0x015632 (0xa10f bytes) 000934 1789317540.802952 read 0x007a72 thru 0x011ed0 (0xa45f bytes) 000936 1789317540.809820 write 0x00a19a thru 0x00fb6d (0x59d4 bytes) 000937 1789317540.810842 punch from 0x02d684 to 0x0307b4 (0x3131 bytes) 000939 1789317540.818611 read 0x014ce3 thru 0x01ad55 (0x6073 bytes) 000940 1789317540.825816 read 0x0322c5 thru 0x034cc4 (0x2a00 bytes) 000941 1789317540.826698 read 0x02aada thru 0x034cc4 (0xa1eb bytes) 000942 1789317540.827301 write 0x003dea thru 0x004183 (0x39a bytes) 000944 1789317540.828913 read 0x01a18e thru 0x01e309 (0x417c bytes) 000945 1789317540.829887 mapwrite 0x01d0fe thru 0x0228fa (0x57fd bytes) 000946 1789317540.857726 read 0x02f9a3 thru 0x034cc4 (0x5322 bytes) 000949 1789317540.859009 mapwrite 0x03ee1d thru 0x03ffff (0x11e3 bytes) 000950 1789317540.912524 trunc from 0x040000 to 0x00c9df (0x33620 bytes) 000951 1789317540.924964 read 0x003f3d thru 0x00c9df (0x8aa3 bytes) 000952 1789317540.925713 trunc from 0x00c9e0 to 0x0220b8 (0x156d9 bytes) 000953 1789317540.947237 mapwrite 0x038ff9 thru 0x03ffff (0x7007 bytes) 000954 1789317541.003567 write 0x01fc00 thru 0x02f551 (0xf952 bytes) 000955 1789317541.004948 mapwrite 0x03265c thru 0x03ffff (0xd9a4 bytes) 000957 1789317541.066197 write 0x01f024 thru 0x02afb3 (0xbf90 bytes) 000960 1789317541.070583 write 0x03c4bc thru 0x03ffff (0x3b44 bytes) 000961 1789317541.071684 mapread 0x01b7f2 thru 0x023b88 (0x8397 bytes) 000962 1789317541.075755 mapread 0x0300ad thru 0x03e289 (0xe1dd bytes) 000963 1789317541.078972 mapwrite 0x02a700 thru 0x0338be (0x91bf bytes) 000964 1789317541.125045 mapread 0x02f1d0 thru 0x039b92 (0xa9c3 bytes) 000965 1789317541.126091 read 0x014865 thru 0x014940 (0xdc bytes) 000966 1789317541.128442 punch from 0x0229ae to 0x023b19 (0x116c bytes) 000968 1789317541.137098 read 0x011502 thru 0x01db8e (0xc68d bytes) 000969 1789317541.137848 trunc from 0x040000 to 0x001467 (0x3eb98 bytes) 000970 1789317541.153593 mapwrite 0x00bd7a thru 0x00c81b (0xaa2 bytes) 000971 1789317541.228857 write 0x006150 thru 0x00d53a (0x73eb bytes) 000972 1789317541.230280 mapwrite 0x02fdaf thru 0x0318a5 (0x1af7 bytes) 000974 1789317541.279501 mapread 0x02ce65 thru 0x0318a5 (0x4a41 bytes) 000975 1789317541.280473 mapwrite 0x03df2e thru 0x03ffff (0x20d2 bytes) 000976 1789317541.325978 mapread 0x0270b2 thru 0x02c5e7 (0x5536 bytes) 000980 1789317541.331505 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x313:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x56581b91 (stale) Mirror 11: 0x56581b91 (stale) Mirror 13: 0x56581b91 (stale) Mirror 15: 0x56581b91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x56581b91 (stale) Mirror 11: 0x56581b91 (stale) Mirror 13: 0x56581b91 (stale) Mirror 15: 0x56581b91 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000982 1789317541.564933 write 0x00ab0c thru 0x01534b (0xa840 bytes) 000983 1789317541.573550 write 0x03d813 thru 0x03ffff (0x27ed bytes) 000984 1789317541.578403 mapwrite 0x02f815 thru 0x034d71 (0x555d bytes) 000986 1789317541.625796 write 0x006e0c thru 0x012bd3 (0xbdc8 bytes) 000988 1789317541.631224 read 0x00856c thru 0x00bacb (0x3560 bytes) 000989 1789317541.631916 punch from 0x01a1ac to 0x021110 (0x6f65 bytes) 000990 1789317541.641961 write 0x009426 thru 0x0177d2 (0xe3ad bytes) 000991 1789317541.648094 mapread 0x00b83f thru 0x017621 (0xbde3 bytes) 000992 1789317541.649011 mapwrite 0x01ff00 thru 0x02bf92 (0xc093 bytes) 000994 1789317541.694625 punch from 0x01cbb6 to 0x02a15d (0xd5a8 bytes) 000995 1789317541.697815 punch from 0x03b147 to 0x03ffff (0x4eb9 bytes) 000998 1789317541.707050 MIRROR_RESYNC 5 mirrors 001000 1789317542.309936 write 0x0185c6 thru 0x024503 (0xbf3e bytes) All operations completed A-OK!