== sanity-flr test 70a: flr mode fsx test ================ 04:58:51 (1787821131) Seed set to 1133 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1787821133.686102 write 0x007f92 thru 0x00db12 (0x5b81 bytes) 000002 1787821133.702093 mapread 0x008903 thru 0x00db12 (0x5210 bytes) truncating to largest ever: 0x1bf6c 000004 1787821133.706866 trunc from 0x00db13 to 0x01bf6b (0xe459 bytes) 000005 1787821133.737082 mapwrite 0x013f58 thru 0x01e457 (0xa500 bytes) 000006 1787821133.893074 mapwrite 0x021f4b thru 0x022ff4 (0x10aa bytes) 000008 1787821133.988876 MIRROR_EXTEND to 2 mirrors 000009 1787821134.727949 read 0x003abf thru 0x011f57 (0xe499 bytes) 000010 1787821134.738916 mapwrite 0x007f5d thru 0x00d0eb (0x518f bytes) 000013 1787821134.970058 mapread 0x00b60f thru 0x0199f1 (0xe3e3 bytes) 000014 1787821134.997185 MIRROR_RESYNC 2 mirrors 000015 1787821135.756929 mapread 0x012a2f thru 0x015911 (0x2ee3 bytes) 000016 1787821135.794999 write 0x00245e thru 0x00ff58 (0xdafb bytes) 000017 1787821135.899871 mapwrite 0x03f210 thru 0x03ffff (0xdf0 bytes) 000018 1787821136.040210 mapwrite 0x01a088 thru 0x02a001 (0xff7a bytes) 000019 1787821136.185196 mapread 0x03c65e thru 0x03ffff (0x39a2 bytes) 000022 1787821136.188151 write 0x00d2e3 thru 0x01baba (0xe7d8 bytes) 000028 1787821136.205640 mapread 0x029cd4 thru 0x02f4b5 (0x57e2 bytes) 000029 1787821136.226125 mapread 0x03bbff thru 0x03ffff (0x4401 bytes) 000032 1787821136.231364 mapread 0x01800a thru 0x02556e (0xd565 bytes) 000033 1787821136.241265 MIRROR_RESYNC 2 mirrors 000034 1787821137.154350 mapwrite 0x032d7e thru 0x035b7a (0x2dfd bytes) 000036 1787821137.405919 read 0x0089f2 thru 0x00e894 (0x5ea3 bytes) 000037 1787821137.446059 MIRROR_RESYNC 2 mirrors 000038 1787821138.173382 write 0x03d8a7 thru 0x03ffff (0x2759 bytes) 000039 1787821138.282782 write 0x0266ef thru 0x034d97 (0xe6a9 bytes) 000041 1787821138.316426 read 0x00ba77 thru 0x01ac30 (0xf1ba bytes) 000042 1787821138.346931 MIRROR_RESYNC 2 mirrors 000043 1787821139.246998 MIRROR_EXTEND to 3 mirrors 000044 1787821140.114965 MIRROR_RESYNC 3 mirrors 000051 1787821140.630880 trunc from 0x040000 to 0x0077b6 (0x38849 bytes) 000054 1787821140.713979 read 0x0045a4 thru 0x0077b6 (0x3213 bytes) 000055 1787821140.724913 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x77b7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x77b7): Mirror 2: 0xfe3cd30 (stale) Mirror 3: 0xfe3cd30 (stale) CRC-32 checksum value for chunk [0, 0x77b7): Mirror 1: 0xfe3cd30 Mirror 4: 0xfe3cd30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x77b7: skipped 000056 1787821141.791939 read 0x0064d1 thru 0x006bc6 (0x6f6 bytes) 000057 1787821141.796865 read 0x0036c2 thru 0x0077b6 (0x40f5 bytes) 000058 1787821141.810945 mapread 0x0007f7 thru 0x0077b6 (0x6fc0 bytes) 000063 1787821141.814627 read 0x00615e thru 0x0077b6 (0x1659 bytes) 000066 1787821141.815722 read 0x006c50 thru 0x0077b6 (0xb67 bytes) 000068 1787821141.821193 mapwrite 0x0355d9 thru 0x0384f6 (0x2f1e bytes) 000070 1787821142.007729 write 0x00968b thru 0x011b05 (0x847b bytes) truncating to largest ever: 0x3846e 000071 1787821142.009381 trunc from 0x0384f7 to 0x03846d (0x89 bytes) 000072 1787821142.028760 write 0x015da7 thru 0x023dba (0xe014 bytes) 000073 1787821142.030192 mapread 0x02f76b thru 0x03640f (0x6ca5 bytes) 000074 1787821142.031340 mapwrite 0x00100d thru 0x00a99e (0x9992 bytes) 000075 1787821142.080624 read 0x03617a thru 0x03846d (0x22f4 bytes) 000076 1787821142.082329 read 0x0290e1 thru 0x0349dc (0xb8fc bytes) 000077 1787821142.089286 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3846e): Mirror 3: 0xceeec0b1 (stale) Mirror 4: 0x33027868 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3846e): Mirror 3: 0xceeec0b1 (stale) Mirror 4: 0x33027868 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3846e: skipped 000078 1787821142.449136 MIRROR_RESYNC 3 mirrors 000079 1787821143.554512 trunc from 0x03846e to 0x00e49b (0x29fd2 bytes) 000084 1787821143.692843 mapwrite 0x00c787 thru 0x010106 (0x3980 bytes) 000086 1787821143.831207 mapwrite 0x03b178 thru 0x03ffff (0x4e88 bytes) 000087 1787821143.947853 mapwrite 0x018402 thru 0x020bb9 (0x87b8 bytes) 000092 1787821144.035576 mapwrite 0x00d8c1 thru 0x015903 (0x8043 bytes) 000094 1787821144.120036 mapread 0x020207 thru 0x026110 (0x5f0a bytes) 000095 1787821144.131238 write 0x020f67 thru 0x0212de (0x378 bytes) 000097 1787821144.148849 write 0x033035 thru 0x03ffff (0xcfcb bytes) 000098 1787821144.158727 mapwrite 0x01b5c1 thru 0x026c7b (0xb6bb bytes) 000099 1787821144.281256 trunc from 0x040000 to 0x001f01 (0x3e0fe bytes) 000101 1787821144.309672 mapwrite 0x004217 thru 0x00bec1 (0x7cab bytes) 000102 1787821144.485071 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xbec2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbec2): Mirror 3: 0x36b95fed (stale) Mirror 4: 0x36b95fed (stale) CRC-32 checksum value for chunk [0, 0xbec2): Mirror 1: 0x6a79ede6 Mirror 5: 0x6a79ede6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbec2: skipped 000103 1787821145.321697 mapread 0x00712a thru 0x00bec1 (0x4d98 bytes) 000104 1787821145.340776 mapwrite 0x027b90 thru 0x0365e0 (0xea51 bytes) 000105 1787821145.519778 trunc from 0x0365e1 to 0x0252b1 (0x1132f bytes) 000107 1787821145.540705 write 0x03158f thru 0x03aa2e (0x94a0 bytes) 000108 1787821145.542003 read 0x024dbf thru 0x02edb6 (0x9ff8 bytes) 000111 1787821145.556006 mapread 0x01146d thru 0x01ecfb (0xd88f bytes) 000113 1787821145.576147 mapwrite 0x020561 thru 0x02ce0e (0xc8ae bytes) 000116 1787821145.640463 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3aa2f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aa2f): Mirror 3: 0xe266c3c1 (stale) Mirror 4: 0xe266c3c1 (stale) Mirror 5: 0xba11a7af (stale) CRC-32 checksum value for chunk [0, 0x3aa2f): Mirror 1: 0x5fb0d189 Mirror 6: 0x5fb0d189 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aa2f: skipped 000118 1787821146.759946 mapread 0x01847a thru 0x0253b6 (0xcf3d bytes) 000119 1787821146.796901 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aa2f): Mirror 3: 0xe266c3c1 (stale) Mirror 4: 0xe266c3c1 (stale) Mirror 5: 0xba11a7af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aa2f): Mirror 3: 0xe266c3c1 (stale) Mirror 4: 0xe266c3c1 (stale) Mirror 5: 0xba11a7af (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aa2f: skipped 000120 1787821147.208076 trunc from 0x03aa2f to 0x031541 (0x94ed bytes) 000121 1787821147.239302 trunc from 0x031542 to 0x0173c8 (0x1a179 bytes) 000125 1787821147.267917 MIRROR_RESYNC 4 mirrors 000126 1787821148.818515 mapread 0x00f599 thru 0x016a13 (0x747b bytes) 000127 1787821148.836063 mapwrite 0x001e36 thru 0x00c87c (0xaa47 bytes) 000128 1787821149.016727 mapwrite 0x016806 thru 0x01afc0 (0x47bb bytes) 000130 1787821149.183562 trunc from 0x01afc1 to 0x01a815 (0x7ab bytes) 000132 1787821149.210947 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a816): Mirror 4: 0x433aa0eb (stale) Mirror 5: 0x433aa0eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a816): Mirror 4: 0x433aa0eb (stale) Mirror 5: 0x433aa0eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a816: skipped 000133 1787821149.576457 mapread 0x014245 thru 0x01542a (0x11e6 bytes) 000135 1787821149.586741 write 0x02f9c1 thru 0x03924e (0x988e bytes) 000136 1787821149.588734 mapread 0x035029 thru 0x03924e (0x4226 bytes) 000137 1787821149.590696 trunc from 0x03924f to 0x025398 (0x13eb6 bytes) 000139 1787821149.609233 mapread 0x023cd3 thru 0x025398 (0x16c6 bytes) 000140 1787821149.628720 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25399): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25399): Mirror 4: 0xe8887637 (stale) Mirror 5: 0xe8887637 (stale) CRC-32 checksum value for chunk [0, 0x25399): Mirror 1: 0x5e168fa Mirror 6: 0x5e168fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25399: skipped 000141 1787821150.820602 trunc from 0x025399 to 0x02f669 (0xa2d1 bytes) 000144 1787821150.901285 mapread 0x00d218 thru 0x01bb3d (0xe926 bytes) 000145 1787821150.931873 read 0x01cf1a thru 0x025f88 (0x906f bytes) 000146 1787821150.944277 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 4: 0x8524979e (stale) Mirror 5: 0x8524979e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 4: 0x8524979e (stale) Mirror 5: 0x8524979e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f66a: skipped 000147 1787821151.345937 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 4: 0x8524979e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 4: 0x8524979e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f66a: skipped 000148 1787821151.800682 write 0x013db7 thru 0x020bad (0xcdf7 bytes) 000149 1787821151.823149 read 0x01a8ca thru 0x01b485 (0xbbc bytes) 000151 1787821151.832636 read 0x01dbb1 thru 0x02070b (0x2b5b bytes) 000153 1787821151.834701 write 0x00965d thru 0x017b5e (0xe502 bytes) 000155 1787821151.887942 read 0x0079b7 thru 0x017764 (0xfdae bytes) 000156 1787821151.903181 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 4: 0x8524979e (stale) CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 1: 0x80dc96ee Mirror 5: 0x80dc96ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f66a: skipped 000161 1787821153.627785 mapread 0x025630 thru 0x02f615 (0x9fe6 bytes) 000163 1787821153.660860 mapread 0x0259fe thru 0x02b867 (0x5e6a bytes) 000164 1787821153.662738 write 0x01b3af thru 0x025348 (0x9f9a bytes) 000165 1787821153.829003 mapread 0x017423 thru 0x01cf33 (0x5b11 bytes) 000167 1787821153.862242 MIRROR_RESYNC 3 mirrors 000168 1787821154.913793 read 0x01de43 thru 0x028237 (0xa3f5 bytes) 000170 1787821154.923220 mapwrite 0x021de0 thru 0x02c6f0 (0xa911 bytes) 000173 1787821155.163712 mapread 0x022ddb thru 0x02c1c8 (0x93ee bytes) 000174 1787821155.173815 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 4: 0xc5bfa4e0 (stale) Mirror 5: 0xc5bfa4e0 (stale) CRC-32 checksum value for chunk [0, 0x2f66a): Mirror 1: 0xa73f6cfa Mirror 6: 0xa73f6cfa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f66a: skipped 000175 1787821156.035724 trunc from 0x02f66a to 0x0180cf (0x1759a bytes) 000176 1787821156.170085 mapread 0x00ed35 thru 0x0179f8 (0x8cc4 bytes) 000178 1787821156.188096 trunc from 0x0180d0 to 0x034341 (0x1c272 bytes) 000179 1787821156.204275 read 0x013d22 thru 0x018ccf (0x4fae bytes) 000181 1787821156.205023 mapread 0x004907 thru 0x008de1 (0x44db bytes) 000182 1787821156.235441 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34342): Mirror 5: 0x6701baee (stale) Mirror 6: 0x6e8452c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34342): Mirror 5: 0x6701baee (stale) Mirror 6: 0x6e8452c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34342: skipped 000183 1787821156.521029 write 0x019ec1 thru 0x01e51d (0x465d bytes) 000184 1787821156.533830 mapwrite 0x029946 thru 0x02eb1e (0x51d9 bytes) 000185 1787821156.599521 write 0x032e1a thru 0x03ba3e (0x8c25 bytes) 000186 1787821156.601564 mapwrite 0x0387db thru 0x03fe8e (0x76b4 bytes) 000189 1787821156.676713 read 0x014b68 thru 0x017dab (0x3244 bytes) 000190 1787821156.684363 trunc from 0x03fe8f to 0x01a2f9 (0x25b95 bytes) 000191 1787821156.699116 write 0x022a72 thru 0x026cc4 (0x4253 bytes) 000193 1787821156.701966 mapwrite 0x002f06 thru 0x00c0f6 (0x91f1 bytes) 000194 1787821156.756667 read 0x01af87 thru 0x026cc4 (0xbd3e bytes) 000195 1787821156.768950 read 0x004326 thru 0x005cec (0x19c7 bytes) 000196 1787821156.770581 write 0x015011 thru 0x022c9d (0xdc8d bytes) 000197 1787821156.772754 read 0x005e7a thru 0x00a0af (0x4236 bytes) 000198 1787821156.773803 mapwrite 0x016f03 thru 0x01b433 (0x4531 bytes) 000199 1787821156.828594 mapwrite 0x00ab71 thru 0x00df77 (0x3407 bytes) 000200 1787821156.916992 mapwrite 0x02d597 thru 0x030737 (0x31a1 bytes) 000202 1787821157.033791 mapread 0x01894f thru 0x01d43c (0x4aee bytes) 000203 1787821157.035207 mapwrite 0x0132c0 thru 0x01f980 (0xc6c1 bytes) 000204 1787821157.087167 mapread 0x00d8a3 thru 0x0102e5 (0x2a43 bytes) 000206 1787821157.089178 mapread 0x00b98c thru 0x015cdc (0xa351 bytes) 000208 1787821157.092253 trunc from 0x030738 to 0x02ab2a (0x5c0d bytes) 000210 1787821157.142133 mapwrite 0x00523a thru 0x005bb4 (0x97b bytes) 000211 1787821157.204632 MIRROR_RESYNC 3 mirrors 000214 1787821158.390857 read 0x0283cf thru 0x02ab2a (0x275c bytes) 000215 1787821158.396297 write 0x027ea5 thru 0x03649c (0xe5f8 bytes) 000217 1787821158.462956 mapread 0x029c65 thru 0x031ca4 (0x8040 bytes) 000218 1787821158.464378 trunc from 0x03649d to 0x013b9b (0x22901 bytes) 000222 1787821158.486824 read 0x00f991 thru 0x013b9b (0x420b bytes) 000223 1787821158.495077 mapread 0x002b00 thru 0x00e086 (0xb587 bytes) 000224 1787821158.496399 read 0x007c74 thru 0x00fda0 (0x812d bytes) 000225 1787821158.496835 write 0x028c0e thru 0x0345e9 (0xb9dc bytes) 000227 1787821158.501740 mapread 0x010079 thru 0x010fb8 (0xf40 bytes) 000228 1787821158.502579 write 0x00b78e thru 0x019232 (0xdaa5 bytes) 000230 1787821158.515156 trunc from 0x0345ea to 0x00865a (0x2bf8f bytes) 000231 1787821158.543273 trunc from 0x00865b to 0x012400 (0x9da6 bytes) 000232 1787821158.567227 write 0x03d1b3 thru 0x03ffff (0x2e4d bytes) 000234 1787821158.569295 mapwrite 0x0085bf thru 0x017025 (0xea67 bytes) 000239 1787821158.662500 write 0x0392e4 thru 0x03c994 (0x36b1 bytes) 000240 1787821158.663726 mapread 0x02cad5 thru 0x033d81 (0x72ad bytes) 000241 1787821158.664792 mapwrite 0x03f363 thru 0x03ffff (0xc9d bytes) 000243 1787821158.793910 trunc from 0x040000 to 0x017d78 (0x28287 bytes) 000246 1787821158.821935 trunc from 0x017d79 to 0x02c629 (0x148b1 bytes) 000247 1787821158.876991 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c62a): Mirror 5: 0xdda87ac0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c62a): Mirror 5: 0xdda87ac0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c62a: skipped 000249 1787821159.232726 read 0x00e6a2 thru 0x016241 (0x7ba0 bytes) 000251 1787821159.259277 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) 000255 1787821159.445968 write 0x00157e thru 0x00542e (0x3eb1 bytes) 000256 1787821159.470063 MIRROR_EXTEND to 2 mirrors 000259 1787821160.577913 read 0x004317 thru 0x00f9f1 (0xb6db bytes) 000260 1787821160.587406 mapwrite 0x010c79 thru 0x019c46 (0x8fce bytes) 000263 1787821160.744794 trunc from 0x02c62a to 0x01394e (0x18cdb bytes) 000264 1787821160.783261 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) 000268 1787821160.947987 mapread 0x00cc27 thru 0x01394e (0x6d28 bytes) 000269 1787821160.971657 trunc from 0x01394f to 0x00c1fa (0x7754 bytes) 000270 1787821160.992882 write 0x01d677 thru 0x02baa6 (0xe430 bytes) 000271 1787821160.996527 read 0x028da4 thru 0x02baa6 (0x2d03 bytes) 000273 1787821160.997797 trunc from 0x02baa7 to 0x012111 (0x19995 bytes) 000275 1787821161.014981 trunc from 0x012112 to 0x00c125 (0x5fec bytes) 000278 1787821161.033861 read 0x00b035 thru 0x00c125 (0x10f1 bytes) 000279 1787821161.035143 write 0x0022f6 thru 0x00c24b (0x9f56 bytes) 000280 1787821161.045677 mapread 0x007499 thru 0x00c24b (0x4db3 bytes) 000281 1787821161.046856 mapwrite 0x0304d7 thru 0x0323d4 (0x1efe bytes) 000282 1787821161.121846 read 0x02c316 thru 0x0317ed (0x54d8 bytes) 000283 1787821161.123068 mapread 0x01b3ee thru 0x01bdcd (0x9e0 bytes) 000284 1787821161.124955 mapread 0x029127 thru 0x02d143 (0x401d bytes) 000289 1787821161.129039 mapwrite 0x03b58f thru 0x03ffff (0x4a71 bytes) 000292 1787821161.210231 mapread 0x0051c0 thru 0x007066 (0x1ea7 bytes) 000293 1787821161.215786 MIRROR_EXTEND to 2 mirrors 000294 1787821162.240759 mapwrite 0x0146f3 thru 0x01af60 (0x686e bytes) 000295 1787821162.440696 read 0x0125d7 thru 0x01b7f9 (0x9223 bytes) 000297 1787821162.448566 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) 000300 1787821162.668105 mapwrite 0x03730a thru 0x03d15b (0x5e52 bytes) 000301 1787821162.751631 trunc from 0x040000 to 0x0343ca (0xbc35 bytes) 000305 1787821162.804480 read 0x0251eb thru 0x031856 (0xc66c bytes) 000308 1787821162.821211 mapread 0x0238d9 thru 0x03371c (0xfe44 bytes) 000310 1787821162.832033 mapwrite 0x01a7cd thru 0x02026d (0x5aa1 bytes) 000312 1787821162.918949 mapread 0x00c951 thru 0x01b260 (0xe910 bytes) 000314 1787821162.938999 MIRROR_EXTEND to 2 mirrors 000315 1787821163.749160 trunc from 0x0343cb to 0x011e6a (0x22560 bytes) 000318 1787821163.897444 mapwrite 0x0384e6 thru 0x03ffff (0x7b1a bytes) 000319 1787821164.025640 read 0x02c7b9 thru 0x039e07 (0xd64f bytes) 000320 1787821164.035263 write 0x01eb90 thru 0x026d78 (0x81e9 bytes) 000321 1787821164.053123 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x45e9e854 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x48ca6ca5 Mirror 3: 0x48ca6ca5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000323 1787821165.310686 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) 000324 1787821165.623206 read 0x0030ca thru 0x00686a (0x37a1 bytes) 000325 1787821165.628708 read 0x01294d thru 0x01963c (0x6cf0 bytes) 000326 1787821165.642718 mapread 0x018157 thru 0x021b5e (0x9a08 bytes) truncating to largest ever: 0x3d70c 000327 1787821165.644636 trunc from 0x040000 to 0x03d70b (0x28f4 bytes) 000328 1787821165.791952 write 0x02b3a5 thru 0x034cd4 (0x9930 bytes) 000332 1787821165.805861 read 0x015d47 thru 0x017b9f (0x1e59 bytes) 000333 1787821165.818897 mapwrite 0x00915a thru 0x00e38e (0x5235 bytes) 000334 1787821165.876719 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d70c): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d70c): Mirror 3: 0xcbdb7a37 (stale) CRC-32 checksum value for chunk [0, 0x3d70c): Mirror 1: 0xee483da5 Mirror 4: 0xee483da5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d70c: skipped 000335 1787821166.950010 trunc from 0x03d70c to 0x0049ea (0x38d21 bytes) 000336 1787821167.064527 trunc from 0x0049eb to 0x0048c7 (0x123 bytes) 000338 1787821167.089829 trunc from 0x0048c8 to 0x033c66 (0x2f39f bytes) 000339 1787821167.120135 mapread 0x02c00e thru 0x033c66 (0x7c59 bytes) 000341 1787821167.143038 write 0x00e028 thru 0x0163ef (0x83c8 bytes) 000345 1787821167.157991 trunc from 0x033c67 to 0x01500b (0x1ec5b bytes) 000347 1787821167.182905 mapread 0x00ebad thru 0x012bd6 (0x402a bytes) 000348 1787821167.184536 mapread 0x005ea7 thru 0x00853d (0x2697 bytes) 000352 1787821167.195133 read 0x005c82 thru 0x00e3b3 (0x8732 bytes) 000353 1787821167.200944 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1500c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1500c): Mirror 3: 0xad9ebc73 (stale) Mirror 4: 0xbc72676d (stale) CRC-32 checksum value for chunk [0, 0x1500c): Mirror 1: 0x9a5279ce Mirror 5: 0x9a5279ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1500c: skipped 000354 1787821168.181852 MIRROR_RESYNC 4 mirrors 000357 1787821169.020162 mapwrite 0x03f25a thru 0x03ffff (0xda6 bytes) 000359 1787821169.277714 mapwrite 0x005324 thru 0x0064ae (0x118b bytes) 000361 1787821169.352264 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf23a0d64 (stale) Mirror 5: 0xf23a0d64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf23a0d64 (stale) Mirror 5: 0xf23a0d64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000363 1787821169.898170 trunc from 0x040000 to 0x00fbf5 (0x3040a bytes) 000364 1787821169.935124 MIRROR_RESYNC 3 mirrors 000365 1787821171.069446 trunc from 0x00fbf6 to 0x00cf21 (0x2cd4 bytes) 000367 1787821171.184552 trunc from 0x00cf22 to 0x0233c3 (0x164a2 bytes) 000370 1787821171.210557 mapread 0x007e79 thru 0x014894 (0xca1c bytes) 000371 1787821171.244402 mapwrite 0x02c75c thru 0x0343b3 (0x7c58 bytes) 000372 1787821171.323922 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x343b4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x343b4): Mirror 4: 0x819a78f5 (stale) Mirror 5: 0x819a78f5 (stale) CRC-32 checksum value for chunk [0, 0x343b4): Mirror 1: 0xd96b2f46 Mirror 6: 0xd96b2f46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x343b4: skipped 000373 1787821172.529130 trunc from 0x0343b4 to 0x002bf9 (0x317ba bytes) 000375 1787821172.838201 write 0x0113b0 thru 0x01f582 (0xe1d3 bytes) 000377 1787821172.855036 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1f583): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f583): Mirror 4: 0x544d6c05 (stale) Mirror 5: 0x544d6c05 (stale) Mirror 6: 0xa021d075 (stale) CRC-32 checksum value for chunk [0, 0x1f583): Mirror 1: 0xf252063a Mirror 7: 0xf252063a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f583: skipped 000379 1787821174.239733 mapread 0x001ed9 thru 0x009dad (0x7ed5 bytes) 000380 1787821174.266517 mapwrite 0x015403 thru 0x01e0e2 (0x8ce0 bytes) 000381 1787821174.501110 write 0x000e50 thru 0x01004f (0xf200 bytes) 000382 1787821174.521943 mapwrite 0x028cef thru 0x02b7a5 (0x2ab7 bytes) 000383 1787821174.652805 mapwrite 0x0199f9 thru 0x0295e8 (0xfbf0 bytes) 000384 1787821174.729942 mapread 0x014df2 thru 0x020fb5 (0xc1c4 bytes) 000385 1787821174.730841 read 0x01c809 thru 0x02a818 (0xe010 bytes) 000387 1787821174.731839 mapread 0x00a2d5 thru 0x0148d9 (0xa605 bytes) 000389 1787821174.735135 trunc from 0x02b7a6 to 0x0130d4 (0x186d1 bytes) 000390 1787821174.757935 trunc from 0x0130d5 to 0x00555b (0xdb79 bytes) 000392 1787821174.782913 mapread 0x003ecf thru 0x00555b (0x168d bytes) 000394 1787821174.784825 trunc from 0x00555c to 0x012286 (0xcd2b bytes) 000395 1787821174.810430 MIRROR_RESYNC 5 mirrors 000396 1787821176.221559 write 0x039ab6 thru 0x03fbac (0x60f7 bytes) 000397 1787821176.285635 trunc from 0x03fbad to 0x00a318 (0x35894 bytes) 000399 1787821176.307975 mapread 0x002085 thru 0x00a0f7 (0x8073 bytes) 000401 1787821176.327801 write 0x02133e thru 0x0252d3 (0x3f96 bytes) 000403 1787821176.334763 MIRROR_RESYNC 5 mirrors 000405 1787821177.843461 read 0x00a6bb thru 0x0186a1 (0xdfe7 bytes) 000406 1787821177.860105 mapread 0x01f9c3 thru 0x021e43 (0x2481 bytes) 000407 1787821177.875551 mapread 0x002572 thru 0x00bbba (0x9649 bytes) 000408 1787821177.886920 mapread 0x000932 thru 0x007c20 (0x72ef bytes) 000409 1787821177.892072 read 0x001396 thru 0x00ea2a (0xd695 bytes) 000410 1787821177.896454 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) 000412 1787821178.205848 read 0x0159d8 thru 0x02198f (0xbfb8 bytes) 000413 1787821178.222881 trunc from 0x0252d4 to 0x009c74 (0x1b65f bytes) 000415 1787821178.309112 read 0x002fb4 thru 0x009c74 (0x6cc1 bytes) 000416 1787821178.318445 mapwrite 0x038c50 thru 0x03ffff (0x73b0 bytes) 000418 1787821178.422279 trunc from 0x040000 to 0x03897b (0x7684 bytes) 000419 1787821178.453891 mapread 0x020cc5 thru 0x02e28a (0xd5c6 bytes) 000420 1787821178.458121 read 0x02e191 thru 0x03897b (0xa7eb bytes) 000421 1787821178.459077 trunc from 0x03897c to 0x02570c (0x1326f bytes) 000422 1787821178.482862 read 0x01f5b5 thru 0x02381b (0x4267 bytes) 000423 1787821178.483828 read 0x01adbf thru 0x022af4 (0x7d36 bytes) 000424 1787821178.484538 trunc from 0x02570d to 0x03063d (0xaf31 bytes) 000425 1787821178.499584 mapread 0x01417d thru 0x014f2d (0xdb1 bytes) 000426 1787821178.500581 mapwrite 0x01d6f7 thru 0x02b364 (0xdc6e bytes) 000427 1787821178.553498 mapread 0x015aaa thru 0x0245a0 (0xeaf7 bytes) 000430 1787821178.563654 MIRROR_RESYNC 4 mirrors 000431 1787821179.933788 mapwrite 0x0325f5 thru 0x03ffff (0xda0b bytes) 000433 1787821180.235165 write 0x0050ac thru 0x014bf5 (0xfb4a bytes) 000434 1787821180.249872 write 0x03765d thru 0x03ffff (0x89a3 bytes) 000438 1787821180.252773 write 0x03ca43 thru 0x03ffff (0x35bd bytes) 000441 1787821180.255682 mapwrite 0x008fb7 thru 0x00c58e (0x35d8 bytes) 000443 1787821180.311732 mapread 0x03f1c4 thru 0x03ffff (0xe3c bytes) 000444 1787821180.314676 mapwrite 0x031604 thru 0x036d7d (0x577a bytes) 000446 1787821180.411558 mapread 0x02af3b thru 0x030248 (0x530e bytes) 000450 1787821180.430791 mapwrite 0x02b088 thru 0x03a4cb (0xf444 bytes) 000451 1787821180.495513 write 0x03f43f thru 0x03ffff (0xbc1 bytes) 000452 1787821180.500425 read 0x008c7d thru 0x00f006 (0x638a bytes) 000455 1787821180.513295 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x96342a1b (stale) Mirror 6: 0x96342a1b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x96342a1b (stale) Mirror 6: 0x96342a1b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000458 1787821180.889497 mapread 0x03b7af thru 0x03c4b5 (0xd07 bytes) 000461 1787821180.906869 mapread 0x027e51 thru 0x032ae7 (0xac97 bytes) 000462 1787821180.927469 write 0x02718f thru 0x035666 (0xe4d8 bytes) 000465 1787821180.931878 read 0x028fad thru 0x02f585 (0x65d9 bytes) 000466 1787821180.933935 write 0x030fd7 thru 0x038ff4 (0x801e bytes) 000467 1787821180.941533 mapwrite 0x00dedb thru 0x01c0db (0xe201 bytes) 000470 1787821181.037912 mapwrite 0x0159b4 thru 0x01f3e4 (0x9a31 bytes) 000471 1787821181.149385 trunc from 0x040000 to 0x011b1f (0x2e4e0 bytes) 000472 1787821181.198532 write 0x030e26 thru 0x03a806 (0x99e1 bytes) 000475 1787821181.225671 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a807): Mirror 5: 0xd667994e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a807): Mirror 5: 0xd667994e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a807: skipped 000476 1787821181.589399 mapwrite 0x016134 thru 0x024ec2 (0xed8f bytes) 000479 1787821181.724029 trunc from 0x03a807 to 0x0058b8 (0x34f4e bytes) 000480 1787821181.748478 read 0x003742 thru 0x0042ac (0xb6b bytes) 000481 1787821181.755814 mapread 0x004af4 thru 0x0058b8 (0xdc5 bytes) 000482 1787821181.765787 write 0x00a8d2 thru 0x015708 (0xae37 bytes) 000483 1787821181.767501 trunc from 0x015709 to 0x0317a3 (0x1c09b bytes) 000484 1787821181.785955 mapwrite 0x004e0b thru 0x00d3ac (0x85a2 bytes) 000485 1787821181.843863 trunc from 0x0317a4 to 0x0009cf (0x30dd4 bytes) 000486 1787821181.865530 mapwrite 0x014c27 thru 0x01c85c (0x7c36 bytes) 000487 1787821181.939820 mapread 0x017ae8 thru 0x01c85c (0x4d75 bytes) 000489 1787821181.941935 mapwrite 0x016d99 thru 0x01c2a4 (0x550c bytes) 000490 1787821182.020656 mapread 0x0082c9 thru 0x01330a (0xb042 bytes) 000493 1787821182.035692 mapwrite 0x02847c thru 0x03262a (0xa1af bytes) 000496 1787821182.128820 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3262b): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3262b): Mirror 5: 0xa6e8a83c (stale) CRC-32 checksum value for chunk [0, 0x3262b): Mirror 1: 0x7a2f8111 Mirror 6: 0x7a2f8111 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3262b: skipped 000497 1787821183.157000 trunc from 0x03262b to 0x00ca69 (0x25bc1 bytes) 000498 1787821183.290158 read 0x0040bf thru 0x00ca69 (0x89ab bytes) 000499 1787821183.302597 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xca6a): Mirror 5: 0x54e716cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xca6a): Mirror 5: 0x54e716cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xca6a: skipped 000500 1787821183.577593 mapwrite 0x02cd32 thru 0x03abb4 (0xde83 bytes) 000502 1787821183.700158 mapwrite 0x02ecf3 thru 0x02f7fe (0xb0c bytes) 000503 1787821183.754111 write 0x0349e4 thru 0x037ee4 (0x3501 bytes) 000504 1787821183.756213 read 0x03466b thru 0x03abb4 (0x654a bytes) 000507 1787821183.759148 mapwrite 0x00b098 thru 0x00eaa2 (0x3a0b bytes) 000508 1787821183.846174 mapread 0x0141ba thru 0x0191d2 (0x5019 bytes) 000510 1787821183.859468 write 0x011750 thru 0x020c6c (0xf51d bytes) 000511 1787821183.866124 mapread 0x01c970 thru 0x027bd1 (0xb262 bytes) 000512 1787821183.876918 mapread 0x00c5bb thru 0x013de9 (0x782f bytes) 000513 1787821183.878535 read 0x0306d5 thru 0x039483 (0x8daf bytes) 000515 1787821183.881907 mapwrite 0x01528d thru 0x01da1e (0x8792 bytes) 000516 1787821183.943748 read 0x01b4b9 thru 0x0232d9 (0x7e21 bytes) 000517 1787821183.944368 write 0x004984 thru 0x00511d (0x79a bytes) 000520 1787821183.947524 mapwrite 0x035c28 thru 0x03ffff (0xa3d8 bytes) 000521 1787821184.038936 write 0x00fb3e thru 0x0179c9 (0x7e8c bytes) 000522 1787821184.040065 mapwrite 0x03e45e thru 0x03ffff (0x1ba2 bytes) 000523 1787821184.089874 read 0x03169f thru 0x03efd7 (0xd939 bytes) 000525 1787821184.091759 write 0x011b6e thru 0x012815 (0xca8 bytes) 000526 1787821184.093817 read 0x02d970 thru 0x037971 (0xa002 bytes) 000527 1787821184.099290 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x96342a1b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf25c9818 Mirror 6: 0xf25c9818 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000529 1787821184.900087 read 0x01646f thru 0x01c17c (0x5d0e bytes) 000532 1787821184.911691 trunc from 0x040000 to 0x01cc8b (0x23374 bytes) 000533 1787821185.037096 mapread 0x009924 thru 0x01061d (0x6cfa bytes) 000534 1787821185.073860 MIRROR_RESYNC 3 mirrors 000536 1787821186.093599 read 0x0148fd thru 0x015bc6 (0x12ca bytes) 000537 1787821186.111802 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) 000539 1787821186.437297 trunc from 0x01cc8c to 0x02ad71 (0xe0e6 bytes) 000541 1787821186.565940 trunc from 0x02ad72 to 0x02b7ac (0xa3b bytes) 000542 1787821186.583285 mapread 0x025e32 thru 0x02b7ac (0x597b bytes) 000544 1787821186.606952 mapread 0x01a8e9 thru 0x02105b (0x6773 bytes) 000549 1787821186.628393 mapwrite 0x029483 thru 0x034f43 (0xbac1 bytes) 000554 1787821186.713053 mapwrite 0x003423 thru 0x004bec (0x17ca bytes) 000556 1787821186.771394 read 0x027658 thru 0x029b74 (0x251d bytes) 000558 1787821186.772462 mapread 0x02ed22 thru 0x034f43 (0x6222 bytes) 000559 1787821186.778099 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) 000560 1787821186.921724 trunc from 0x034f44 to 0x036c0f (0x1ccc bytes) 000563 1787821186.958153 write 0x0293df thru 0x0353cd (0xbfef bytes) 000568 1787821186.981668 mapread 0x0014bb thru 0x00ae77 (0x99bd bytes) 000569 1787821187.012734 read 0x02c4db thru 0x02ef9b (0x2ac1 bytes) 000570 1787821187.028935 MIRROR_EXTEND to 2 mirrors 000571 1787821188.145360 read 0x02332c thru 0x02d410 (0xa0e5 bytes) 000572 1787821188.157373 write 0x03a8ed thru 0x03ffff (0x5713 bytes) 000574 1787821188.303389 mapwrite 0x01951f thru 0x0200bd (0x6b9f bytes) 000577 1787821188.448089 read 0x008bfc thru 0x00af7d (0x2382 bytes) 000578 1787821188.459742 mapread 0x028851 thru 0x02eafc (0x62ac bytes) 000579 1787821188.460904 mapwrite 0x00f9cc thru 0x011419 (0x1a4e bytes) 000580 1787821188.504087 MIRROR_RESYNC 2 mirrors 000582 1787821189.474489 mapread 0x025d0b thru 0x02be28 (0x611e bytes) 000583 1787821189.559974 MIRROR_EXTEND to 3 mirrors 000584 1787821190.512369 mapwrite 0x016c8a thru 0x0222b1 (0xb628 bytes) 000585 1787821190.739405 trunc from 0x040000 to 0x00cb2d (0x334d2 bytes) 000586 1787821190.770006 read 0x003db3 thru 0x0086bc (0x490a bytes) 000587 1787821190.782511 read 0x006f75 thru 0x009746 (0x27d2 bytes) 000589 1787821190.795621 mapread 0x00b386 thru 0x00cb2d (0x17a8 bytes) 000590 1787821190.802544 MIRROR_RESYNC 3 mirrors 000591 1787821191.744368 mapwrite 0x01a2df thru 0x02487d (0xa59f bytes) 000592 1787821192.048899 write 0x031e4f thru 0x0390f3 (0x72a5 bytes) 000593 1787821192.051350 mapwrite 0x02d2e8 thru 0x03226f (0x4f88 bytes) 000594 1787821192.126500 mapwrite 0x03c96f thru 0x03ffff (0x3691 bytes) 000595 1787821192.213707 read 0x0362e8 thru 0x03e9b7 (0x86d0 bytes) 000596 1787821192.218588 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4de60fec (stale) Mirror 3: 0x4de60fec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5dd6acbf Mirror 4: 0x5dd6acbf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000598 1787821193.552784 mapwrite 0x01a0dd thru 0x02095f (0x6883 bytes) 000601 1787821193.784946 mapwrite 0x024eed thru 0x02e364 (0x9478 bytes) 000603 1787821193.902380 mapread 0x0167f5 thru 0x0259da (0xf1e6 bytes) 000604 1787821193.913587 MIRROR_RESYNC 4 mirrors 000605 1787821195.328546 mapread 0x027d6d thru 0x03598d (0xdc21 bytes) 000607 1787821195.405456 write 0x02110c thru 0x0235c7 (0x24bc bytes) 000608 1787821195.562087 trunc from 0x040000 to 0x03a704 (0x58fb bytes) 000609 1787821195.583575 mapread 0x0371d0 thru 0x03a704 (0x3535 bytes) 000610 1787821195.597266 mapread 0x01a37d thru 0x025786 (0xb40a bytes) 000611 1787821195.633517 write 0x012e6a thru 0x01e09a (0xb231 bytes) 000613 1787821195.659690 write 0x00b53c thru 0x00f062 (0x3b27 bytes) 000615 1787821195.681638 mapread 0x031231 thru 0x035a7c (0x484c bytes) 000616 1787821195.683587 write 0x0176be thru 0x020ea9 (0x97ec bytes) 000617 1787821195.685600 trunc from 0x03a705 to 0x001c15 (0x38aef bytes) 000618 1787821195.721004 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1c16): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c16): Mirror 2: 0xb6812694 (stale) Mirror 3: 0xb6812694 (stale) Mirror 4: 0xb6812694 (stale) CRC-32 checksum value for chunk [0, 0x1c16): Mirror 1: 0xb6812694 Mirror 5: 0xb6812694 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c16: skipped 000619 1787821196.790761 read 0x000a97 thru 0x001c15 (0x117f bytes) 000620 1787821196.802547 trunc from 0x001c16 to 0x02c5c8 (0x2a9b3 bytes) 000621 1787821196.989717 write 0x012808 thru 0x01499c (0x2195 bytes) 000623 1787821197.007650 mapread 0x00837e thru 0x0138e7 (0xb56a bytes) 000626 1787821197.047018 MIRROR_RESYNC 5 mirrors 000627 1787821198.971836 read 0x00a6aa thru 0x0181ea (0xdb41 bytes) 000628 1787821198.988075 mapread 0x0177ae thru 0x01f27c (0x7acf bytes) 000629 1787821199.004581 read 0x02aa9b thru 0x02c5c8 (0x1b2e bytes) 000631 1787821199.014377 read 0x0027ce thru 0x00576d (0x2fa0 bytes) 000632 1787821199.014786 trunc from 0x02c5c9 to 0x016be3 (0x159e5 bytes) 000634 1787821199.128010 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x16be4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16be4): Mirror 2: 0xebe48d (stale) Mirror 3: 0xebe48d (stale) Mirror 4: 0xebe48d (stale) Mirror 5: 0xebe48d (stale) CRC-32 checksum value for chunk [0, 0x16be4): Mirror 1: 0xebe48d Mirror 6: 0xebe48d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16be4: skipped 000635 1787821200.187652 mapwrite 0x01ea47 thru 0x02194b (0x2f05 bytes) 000636 1787821200.384367 trunc from 0x02194c to 0x007559 (0x1a3f2 bytes) 000640 1787821200.428236 mapread 0x0054a9 thru 0x007559 (0x20b1 bytes) 000641 1787821200.467673 mapread 0x002f05 thru 0x007559 (0x4655 bytes) 000644 1787821200.472755 trunc from 0x00755a to 0x000d86 (0x67d3 bytes) 000645 1787821200.508071 MIRROR_RESYNC 6 mirrors 000647 1787821201.649037 mapwrite 0x0022b9 thru 0x00941a (0x7162 bytes) 000652 1787821201.841406 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x941b): Mirror 3: 0x61427be1 (stale) Mirror 4: 0x61427be1 (stale) Mirror 5: 0x61427be1 (stale) Mirror 6: 0x61427be1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x941b): Mirror 3: 0x61427be1 (stale) Mirror 4: 0x61427be1 (stale) Mirror 5: 0x61427be1 (stale) Mirror 6: 0x61427be1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x941b: skipped 000654 1787821202.268151 read 0x004c86 thru 0x005557 (0x8d2 bytes) 000655 1787821202.282422 read 0x007644 thru 0x00941a (0x1dd7 bytes) 000657 1787821202.302624 MIRROR_RESYNC 5 mirrors 000658 1787821203.365948 write 0x013e33 thru 0x018ffd (0x51cb bytes) 000663 1787821203.482834 write 0x00b410 thru 0x01542a (0xa01b bytes) 000664 1787821203.492386 mapread 0x010329 thru 0x01821d (0x7ef5 bytes) 000666 1787821203.496002 mapwrite 0x018ce0 thru 0x01cc25 (0x3f46 bytes) 000667 1787821203.692341 mapwrite 0x02dbb4 thru 0x036c0f (0x905c bytes) 000668 1787821203.854203 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x36c10): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36c10): Mirror 3: 0xfe58f82c (stale) Mirror 4: 0xfe58f82c (stale) Mirror 5: 0xfe58f82c (stale) Mirror 6: 0xfe58f82c (stale) CRC-32 checksum value for chunk [0, 0x36c10): Mirror 1: 0x7a78c665 Mirror 7: 0x7a78c665 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36c10: skipped 000671 1787821205.009621 trunc from 0x036c10 to 0x006954 (0x302bb bytes) 000675 1787821205.128855 trunc from 0x006955 to 0x02b113 (0x247bf bytes) 000677 1787821205.165237 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2b114): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b114): Mirror 3: 0x836605e2 (stale) Mirror 4: 0x836605e2 (stale) Mirror 5: 0x836605e2 (stale) Mirror 6: 0x836605e2 (stale) Mirror 7: 0x8677d7e7 (stale) CRC-32 checksum value for chunk [0, 0x2b114): Mirror 1: 0xf1497a75 Mirror 8: 0xf1497a75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b114: skipped 000678 1787821206.683265 mapread 0x019ee6 thru 0x01fa61 (0x5b7c bytes) 000679 1787821206.704504 read 0x00de44 thru 0x01d1ef (0xf3ac bytes) 000681 1787821206.714197 trunc from 0x02b114 to 0x00d898 (0x1d87b bytes) 000687 1787821206.811723 mapwrite 0x002b62 thru 0x012ae8 (0xff87 bytes) 000689 1787821206.928007 MIRROR_RESYNC 7 mirrors 000690 1787821208.308935 mapwrite 0x02cf7e thru 0x03ab27 (0xdbaa bytes) 000691 1787821208.527481 mapread 0x0056f5 thru 0x00c13f (0x6a4b bytes) 000693 1787821208.549839 read 0x02edfc thru 0x038468 (0x966d bytes) 000694 1787821208.550740 mapread 0x036d5c thru 0x03ab27 (0x3dcc bytes) 000697 1787821208.555836 trunc from 0x03ab28 to 0x03c354 (0x182d bytes) 000699 1787821208.589382 read 0x028dbc thru 0x03482c (0xba71 bytes) 000700 1787821208.596480 MIRROR_RESYNC 7 mirrors 000703 1787821210.482345 trunc from 0x03c355 to 0x02ec39 (0xd71b bytes) 000704 1787821210.653153 read 0x020f1e thru 0x02ec39 (0xdd1c bytes) 000706 1787821210.666825 write 0x026d96 thru 0x02c208 (0x5473 bytes) 000707 1787821210.668809 write 0x02139d thru 0x02edfb (0xda5f bytes) 000708 1787821210.671754 read 0x00ffc6 thru 0x01fbfa (0xfc35 bytes) 000710 1787821210.684555 mapwrite 0x00a7ef thru 0x0104fe (0x5d10 bytes) 000712 1787821210.830120 mapwrite 0x003f9e thru 0x013524 (0xf587 bytes) 000715 1787821210.950013 read 0x015553 thru 0x01d2ab (0x7d59 bytes) 000717 1787821210.955192 mapwrite 0x02f3c8 thru 0x03837e (0x8fb7 bytes) 000718 1787821211.123534 write 0x037bfa thru 0x03ffff (0x8406 bytes) 000721 1787821211.131609 trunc from 0x040000 to 0x01a076 (0x25f89 bytes) 000722 1787821211.176662 trunc from 0x01a077 to 0x01b1b1 (0x113b bytes) 000723 1787821211.238283 read 0x00e5aa thru 0x0196a4 (0xb0fb bytes) 000724 1787821211.238930 read 0x00e7ba thru 0x01b1b1 (0xc9f8 bytes) 000725 1787821211.245525 write 0x01d50a thru 0x0291e3 (0xbcda bytes) 000726 1787821211.249106 trunc from 0x0291e4 to 0x022e5f (0x6384 bytes) 000727 1787821211.286527 MIRROR_RESYNC 7 mirrors 000731 1787821213.156918 trunc from 0x022e60 to 0x01e102 (0x4d5d bytes) 000732 1787821213.381450 mapread 0x007b00 thru 0x014d59 (0xd25a bytes) 000733 1787821213.424512 read 0x00277f thru 0x0069cc (0x424e bytes) 000734 1787821213.429902 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1e103): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e103): Mirror 3: 0x7c34d765 (stale) Mirror 4: 0x7c34d765 (stale) Mirror 5: 0x7c34d765 (stale) Mirror 6: 0x7c34d765 (stale) Mirror 7: 0x7c34d765 (stale) Mirror 8: 0x7c34d765 (stale) CRC-32 checksum value for chunk [0, 0x1e103): Mirror 1: 0x7c34d765 Mirror 9: 0x7c34d765 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e103: skipped 000735 1787821214.833177 mapwrite 0x0004b5 thru 0x000d0c (0x858 bytes) 000736 1787821215.052273 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e103): Mirror 3: 0x7c34d765 (stale) Mirror 4: 0x7c34d765 (stale) Mirror 5: 0x7c34d765 (stale) Mirror 6: 0x7c34d765 (stale) Mirror 8: 0x7c34d765 (stale) Mirror 9: 0x7c34d765 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e103): Mirror 3: 0x7c34d765 (stale) Mirror 4: 0x7c34d765 (stale) Mirror 5: 0x7c34d765 (stale) Mirror 6: 0x7c34d765 (stale) Mirror 8: 0x7c34d765 (stale) Mirror 9: 0x7c34d765 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e103: skipped 000737 1787821215.719112 mapwrite 0x02c2ed thru 0x032559 (0x626d bytes) 000738 1787821215.817145 mapread 0x02a697 thru 0x032559 (0x7ec3 bytes) 000739 1787821215.818061 trunc from 0x03255a to 0x00a8f1 (0x27c68 bytes) 000740 1787821215.844348 write 0x01c171 thru 0x01c1e6 (0x76 bytes) 000741 1787821215.854109 MIRROR_RESYNC 7 mirrors 000743 1787821217.931251 write 0x015156 thru 0x023a10 (0xe8bb bytes) 000746 1787821218.024136 mapread 0x00b97f thru 0x013872 (0x7ef4 bytes) 000748 1787821218.051811 write 0x00557a thru 0x00880a (0x3291 bytes) 000751 1787821218.059087 write 0x02c4c7 thru 0x0324fc (0x6036 bytes) 000752 1787821218.060680 mapwrite 0x004515 thru 0x00c650 (0x813c bytes) 000753 1787821218.137978 trunc from 0x0324fd to 0x01e2e1 (0x1421b bytes) 000755 1787821218.160880 trunc from 0x01e2e2 to 0x033865 (0x15584 bytes) 000756 1787821218.183104 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x33866): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33866): Mirror 3: 0x8d802dc0 (stale) Mirror 4: 0x8d802dc0 (stale) Mirror 5: 0x8d802dc0 (stale) Mirror 6: 0x8d802dc0 (stale) Mirror 8: 0x8d802dc0 (stale) Mirror 9: 0x8d802dc0 (stale) CRC-32 checksum value for chunk [0, 0x33866): Mirror 1: 0x26673370 Mirror 10: 0x26673370 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33866: skipped 000757 1787821219.689935 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x33866): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33866): Mirror 3: 0x8d802dc0 (stale) Mirror 4: 0x8d802dc0 (stale) Mirror 5: 0x8d802dc0 (stale) Mirror 6: 0x8d802dc0 (stale) Mirror 8: 0x8d802dc0 (stale) Mirror 9: 0x8d802dc0 (stale) CRC-32 checksum value for chunk [0, 0x33866): Mirror 1: 0x26673370 Mirror 10: 0x26673370 Mirror 11: 0x26673370 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33866: skipped 000760 1787821221.275651 write 0x012cb7 thru 0x02030c (0xd656 bytes) 000763 1787821221.369837 mapwrite 0x03dd48 thru 0x03ffff (0x22b8 bytes) 000764 1787821221.473129 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x42869a5f (stale) Mirror 4: 0x42869a5f (stale) Mirror 5: 0x42869a5f (stale) Mirror 6: 0x42869a5f (stale) Mirror 8: 0x42869a5f (stale) Mirror 9: 0x42869a5f (stale) Mirror 10: 0x686fdafe (stale) Mirror 11: 0x686fdafe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7b99a183 Mirror 12: 0x7b99a183 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000766 1787821222.826779 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x42869a5f (stale) Mirror 4: 0x42869a5f (stale) Mirror 6: 0x42869a5f (stale) Mirror 8: 0x42869a5f (stale) Mirror 9: 0x42869a5f (stale) Mirror 10: 0x686fdafe (stale) Mirror 11: 0x686fdafe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x42869a5f (stale) Mirror 4: 0x42869a5f (stale) Mirror 6: 0x42869a5f (stale) Mirror 8: 0x42869a5f (stale) Mirror 9: 0x42869a5f (stale) Mirror 10: 0x686fdafe (stale) Mirror 11: 0x686fdafe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7b99a183 Mirror 12: 0x7b99a183 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000767 1787821223.981913 trunc from 0x040000 to 0x01cd6f (0x23290 bytes) 000769 1787821224.221612 trunc from 0x01cd70 to 0x02c8b1 (0xfb42 bytes) 000770 1787821224.278409 write 0x02c622 thru 0x02fbf0 (0x35cf bytes) 000773 1787821224.306305 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2fbf1): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fbf1): Mirror 3: 0xfb26aade (stale) Mirror 4: 0xfb26aade (stale) Mirror 6: 0xfb26aade (stale) Mirror 8: 0xfb26aade (stale) Mirror 9: 0xfb26aade (stale) Mirror 10: 0xb417576b (stale) Mirror 11: 0xb417576b (stale) Mirror 12: 0x5ff4e913 (stale) CRC-32 checksum value for chunk [0, 0x2fbf1): Mirror 1: 0xf34ada50 Mirror 13: 0xf34ada50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fbf1: skipped 000775 1787821226.738236 trunc from 0x02fbf1 to 0x031104 (0x1514 bytes) 000776 1787821226.916391 mapwrite 0x026fe3 thru 0x02dd2c (0x6d4a bytes) 000777 1787821227.107110 trunc from 0x031105 to 0x010a90 (0x20674 bytes) 000779 1787821227.144938 mapread 0x001d50 thru 0x003917 (0x1bc8 bytes) 000780 1787821227.156876 mapread 0x00e828 thru 0x010a90 (0x2269 bytes) 000781 1787821227.164672 write 0x01fd30 thru 0x02810f (0x83e0 bytes) 000782 1787821227.165998 read 0x01e473 thru 0x0279c2 (0x9550 bytes) 000783 1787821227.171661 trunc from 0x028110 to 0x01ac4d (0xd4c2 bytes) 000784 1787821227.186832 mapread 0x0103ef thru 0x01598e (0x55a0 bytes) 000785 1787821227.195492 mapwrite 0x0323f8 thru 0x034d94 (0x299d bytes) 000787 1787821227.264648 read 0x02667e thru 0x02f0e7 (0x8a6a bytes) 000789 1787821227.282196 write 0x03d7e9 thru 0x03ffff (0x2817 bytes) 000790 1787821227.294450 MIRROR_RESYNC 10 mirrors 000792 1787821230.946597 read 0x02f633 thru 0x0360c3 (0x6a91 bytes) 000793 1787821230.961417 read 0x00d9ee thru 0x00fbb0 (0x21c3 bytes) 000794 1787821230.974009 write 0x020da4 thru 0x02e26c (0xd4c9 bytes) 000797 1787821231.156837 trunc from 0x040000 to 0x020fe4 (0x1f01b bytes) 000798 1787821231.177346 mapread 0x013ff3 thru 0x018b1a (0x4b28 bytes) 000799 1787821231.215525 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20fe5): Mirror 3: 0x7ca36936 (stale) Mirror 4: 0x7ca36936 (stale) Mirror 6: 0x7ca36936 (stale) Mirror 9: 0x7ca36936 (stale) Mirror 10: 0x7ca36936 (stale) Mirror 11: 0x7ca36936 (stale) Mirror 12: 0x7ca36936 (stale) Mirror 13: 0x7ca36936 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20fe5): Mirror 3: 0x7ca36936 (stale) Mirror 4: 0x7ca36936 (stale) Mirror 6: 0x7ca36936 (stale) Mirror 9: 0x7ca36936 (stale) Mirror 10: 0x7ca36936 (stale) Mirror 11: 0x7ca36936 (stale) Mirror 12: 0x7ca36936 (stale) Mirror 13: 0x7ca36936 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20fe5: skipped 000802 1787821232.034387 trunc from 0x020fe5 to 0x016003 (0xafe1 bytes) 000803 1787821232.077901 MIRROR_RESYNC 9 mirrors 000805 1787821233.989631 write 0x027515 thru 0x0288f6 (0x13e2 bytes) 000806 1787821234.087555 mapwrite 0x01593a thru 0x024d9d (0xf464 bytes) 000808 1787821234.307619 mapread 0x010d87 thru 0x01c811 (0xba8b bytes) 000810 1787821234.314566 MIRROR_RESYNC 9 mirrors 000811 1787821236.187245 mapread 0x01e12f thru 0x0288f6 (0xa7c8 bytes) 000812 1787821236.217580 mapwrite 0x005087 thru 0x009448 (0x43c2 bytes) 000813 1787821236.543574 mapread 0x02635e thru 0x0288f6 (0x2599 bytes) 000814 1787821236.582449 mapwrite 0x0247dd thru 0x0293b8 (0x4bdc bytes) 000815 1787821236.733053 read 0x000d3b thru 0x001b09 (0xdcf bytes) 000816 1787821236.740280 mapwrite 0x03ecc7 thru 0x03ffff (0x1339 bytes) 000818 1787821236.835659 MIRROR_RESYNC 9 mirrors 000819 1787821239.217614 mapread 0x019ca6 thru 0x02367e (0x99d9 bytes) 000820 1787821239.243014 mapwrite 0x02ed29 thru 0x03dcd4 (0xefac bytes) 000822 1787821239.550753 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2e222f3f (stale) Mirror 6: 0x2e222f3f (stale) Mirror 9: 0x2e222f3f (stale) Mirror 10: 0x2e222f3f (stale) Mirror 11: 0x2e222f3f (stale) Mirror 12: 0x2e222f3f (stale) Mirror 13: 0x2e222f3f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2e222f3f (stale) Mirror 6: 0x2e222f3f (stale) Mirror 9: 0x2e222f3f (stale) Mirror 10: 0x2e222f3f (stale) Mirror 11: 0x2e222f3f (stale) Mirror 12: 0x2e222f3f (stale) Mirror 13: 0x2e222f3f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000824 1787821240.302434 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2e222f3f (stale) Mirror 6: 0x2e222f3f (stale) Mirror 9: 0x2e222f3f (stale) Mirror 10: 0x2e222f3f (stale) Mirror 11: 0x2e222f3f (stale) Mirror 12: 0x2e222f3f (stale) Mirror 13: 0x2e222f3f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf8da2999 Mirror 14: 0xf8da2999 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000825 1787821241.655370 mapread 0x03f5d2 thru 0x03ffff (0xa2e bytes) 000828 1787821241.663307 mapread 0x0084ee thru 0x016b31 (0xe644 bytes) 000830 1787821241.692047 mapread 0x02e3a4 thru 0x03c900 (0xe55d bytes) 000831 1787821241.714520 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2e222f3f (stale) Mirror 6: 0x2e222f3f (stale) Mirror 9: 0x2e222f3f (stale) Mirror 10: 0x2e222f3f (stale) Mirror 11: 0x2e222f3f (stale) Mirror 12: 0x2e222f3f (stale) Mirror 13: 0x2e222f3f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf8da2999 Mirror 14: 0xf8da2999 Mirror 15: 0xf8da2999 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000834 1787821242.889624 trunc from 0x040000 to 0x0389b8 (0x7647 bytes) 000837 1787821243.019033 mapwrite 0x02212e thru 0x023bfe (0x1ad1 bytes) 000838 1787821243.063306 mapread 0x016b90 thru 0x0202bc (0x972d bytes) 000839 1787821243.085848 read 0x009281 thru 0x013b48 (0xa8c8 bytes) 000840 1787821243.096692 trunc from 0x0389b9 to 0x0395cd (0xc15 bytes) 000842 1787821243.123180 mapread 0x01c620 thru 0x029cce (0xd6af bytes) 000845 1787821243.134745 write 0x007e87 thru 0x00d164 (0x52de bytes) 000846 1787821243.140334 trunc from 0x0395ce to 0x035355 (0x4278 bytes) 000847 1787821243.159293 read 0x02638c thru 0x030e4d (0xaac2 bytes) 000848 1787821243.160223 write 0x03a80d thru 0x03c298 (0x1a8c bytes) 000853 1787821243.168114 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c299): Mirror 4: 0x419b1b4f (stale) Mirror 6: 0x419b1b4f (stale) Mirror 9: 0x419b1b4f (stale) Mirror 10: 0x419b1b4f (stale) Mirror 11: 0x419b1b4f (stale) Mirror 12: 0x419b1b4f (stale) Mirror 14: 0x820b33ed (stale) Mirror 15: 0x820b33ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c299): Mirror 4: 0x419b1b4f (stale) Mirror 6: 0x419b1b4f (stale) Mirror 9: 0x419b1b4f (stale) Mirror 10: 0x419b1b4f (stale) Mirror 11: 0x419b1b4f (stale) Mirror 12: 0x419b1b4f (stale) Mirror 14: 0x820b33ed (stale) Mirror 15: 0x820b33ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c299: skipped 000854 1787821243.815907 mapwrite 0x017af8 thru 0x027a72 (0xff7b bytes) 000855 1787821244.063739 read 0x00c929 thru 0x00cf70 (0x648 bytes) 000856 1787821244.068390 mapwrite 0x034957 thru 0x0356cf (0xd79 bytes) 000858 1787821244.121554 mapread 0x00303b thru 0x011993 (0xe959 bytes) 000860 1787821244.156207 write 0x03cdb9 thru 0x03eadd (0x1d25 bytes) 000861 1787821244.158854 write 0x00fbd6 thru 0x01a661 (0xaa8c bytes) 000862 1787821244.161164 mapwrite 0x026faf thru 0x02b932 (0x4984 bytes) 000863 1787821244.247346 write 0x01c1a0 thru 0x023934 (0x7795 bytes) 000865 1787821244.250272 trunc from 0x03eade to 0x00a614 (0x344c9 bytes) 000866 1787821244.267442 mapwrite 0x027626 thru 0x02dad9 (0x64b4 bytes) 000867 1787821244.389193 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dada): Mirror 4: 0x4b20e48c (stale) Mirror 9: 0x4b20e48c (stale) Mirror 10: 0x4b20e48c (stale) Mirror 11: 0x4b20e48c (stale) Mirror 12: 0x4b20e48c (stale) Mirror 14: 0x4b20e48c (stale) Mirror 15: 0x4b20e48c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dada): Mirror 4: 0x4b20e48c (stale) Mirror 9: 0x4b20e48c (stale) Mirror 10: 0x4b20e48c (stale) Mirror 11: 0x4b20e48c (stale) Mirror 12: 0x4b20e48c (stale) Mirror 14: 0x4b20e48c (stale) Mirror 15: 0x4b20e48c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dada: skipped 000868 1787821244.996826 mapread 0x00d840 thru 0x0165e3 (0x8da4 bytes) 000869 1787821245.031339 read 0x014583 thru 0x018247 (0x3cc5 bytes) 000871 1787821245.052864 mapread 0x005fef thru 0x00d053 (0x7065 bytes) 000872 1787821245.072278 read 0x027e60 thru 0x02dad9 (0x5c7a bytes) 000874 1787821245.094553 read 0x007a5c thru 0x00a814 (0x2db9 bytes) 000876 1787821245.096293 trunc from 0x02dada to 0x02973d (0x439c bytes) 000877 1787821245.122784 mapread 0x00d1ad thru 0x014566 (0x73ba bytes) 000878 1787821245.132757 MIRROR_RESYNC 8 mirrors 000880 1787821247.156979 mapwrite 0x009c15 thru 0x00e136 (0x4522 bytes) 000881 1787821247.552224 mapwrite 0x028c76 thru 0x03373b (0xaac6 bytes) 000883 1787821247.785385 mapwrite 0x021e32 thru 0x031470 (0xf63f bytes) 000884 1787821247.895890 mapwrite 0x02bcb1 thru 0x02d50e (0x185e bytes) 000885 1787821247.955858 mapread 0x0262d9 thru 0x029211 (0x2f39 bytes) 000886 1787821247.957918 write 0x01ab0e thru 0x01fe5e (0x5351 bytes) 000888 1787821247.996173 MIRROR_RESYNC 8 mirrors 000889 1787821251.565379 mapread 0x01914f thru 0x022932 (0x97e4 bytes) 000890 1787821251.605369 MIRROR_RESYNC 8 mirrors 000892 1787821252.516651 write 0x00dba4 thru 0x0110ac (0x3509 bytes) 000893 1787821252.667667 read 0x02753f thru 0x02fe4f (0x8911 bytes) 000895 1787821252.687707 mapread 0x0108bf thru 0x01ebb6 (0xe2f8 bytes) 000896 1787821252.808983 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3373c): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3373c): Mirror 4: 0xfe93fb7d (stale) Mirror 9: 0xfe93fb7d (stale) Mirror 10: 0xfe93fb7d (stale) Mirror 11: 0xfe93fb7d (stale) Mirror 12: 0xfe93fb7d (stale) Mirror 14: 0xfe93fb7d (stale) Mirror 15: 0xfe93fb7d (stale) CRC-32 checksum value for chunk [0, 0x3373c): Mirror 1: 0x13dfc4f0 Mirror 16: 0x13dfc4f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3373c: skipped 000898 1787821254.572033 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3373c): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3373c): Mirror 4: 0xfe93fb7d (stale) Mirror 9: 0xfe93fb7d (stale) Mirror 10: 0xfe93fb7d (stale) Mirror 11: 0xfe93fb7d (stale) Mirror 12: 0xfe93fb7d (stale) Mirror 14: 0xfe93fb7d (stale) Mirror 15: 0xfe93fb7d (stale) CRC-32 checksum value for chunk [0, 0x3373c): Mirror 1: 0x13dfc4f0 Mirror 16: 0x13dfc4f0 Mirror 17: 0x13dfc4f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3373c: skipped 000900 1787821256.227009 trunc from 0x03373c to 0x02824c (0xb4ef bytes) 000901 1787821256.434526 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2824d): Mirror 4: 0x575d3d7d (stale) Mirror 9: 0x575d3d7d (stale) Mirror 10: 0x575d3d7d (stale) Mirror 11: 0x575d3d7d (stale) Mirror 14: 0x575d3d7d (stale) Mirror 15: 0x575d3d7d (stale) Mirror 16: 0x1588f1f5 (stale) Mirror 17: 0x1588f1f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2824d): Mirror 4: 0x575d3d7d (stale) Mirror 9: 0x575d3d7d (stale) Mirror 10: 0x575d3d7d (stale) Mirror 11: 0x575d3d7d (stale) Mirror 14: 0x575d3d7d (stale) Mirror 15: 0x575d3d7d (stale) Mirror 16: 0x1588f1f5 (stale) Mirror 17: 0x1588f1f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2824d: skipped 000902 1787821257.483415 read 0x001539 thru 0x001ed4 (0x99c bytes) 000903 1787821257.497475 read 0x01478a thru 0x01ed1d (0xa594 bytes) 000904 1787821257.543145 trunc from 0x02824d to 0x036e5a (0xec0e bytes) 000905 1787821257.590432 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x36e5b): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e5b): Mirror 4: 0x9bd1b669 (stale) Mirror 9: 0x9bd1b669 (stale) Mirror 10: 0x9bd1b669 (stale) Mirror 11: 0x9bd1b669 (stale) Mirror 14: 0x9bd1b669 (stale) Mirror 15: 0x9bd1b669 (stale) Mirror 16: 0x76e4a7b9 (stale) Mirror 17: 0x76e4a7b9 (stale) CRC-32 checksum value for chunk [0, 0x36e5b): Mirror 1: 0x45067f4a Mirror 18: 0x45067f4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e5b: skipped 000907 1787821259.560948 read 0x00a467 thru 0x00fa7a (0x5614 bytes) 000908 1787821259.587582 read 0x0361e7 thru 0x036e5a (0xc74 bytes) 000909 1787821259.630700 trunc from 0x036e5b to 0x0166bd (0x2079d bytes) 000910 1787821259.804695 write 0x024485 thru 0x02faef (0xb66b bytes) 000911 1787821259.806340 trunc from 0x02faf0 to 0x01d58b (0x12564 bytes) 000913 1787821259.868686 trunc from 0x01d58c to 0x02f9f1 (0x12466 bytes) 000914 1787821259.905409 mapread 0x01ebab thru 0x0231bf (0x4615 bytes) 000919 1787821259.994242 read 0x02d533 thru 0x02f9f1 (0x24bf bytes) 000921 1787821260.026035 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2f9f2): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f9f2): Mirror 4: 0xcc65466 (stale) Mirror 9: 0xcc65466 (stale) Mirror 10: 0xcc65466 (stale) Mirror 11: 0xcc65466 (stale) Mirror 14: 0xcc65466 (stale) Mirror 15: 0xcc65466 (stale) Mirror 16: 0x743e546e (stale) Mirror 17: 0x743e546e (stale) Mirror 18: 0x417c6fdc (stale) CRC-32 checksum value for chunk [0, 0x2f9f2): Mirror 1: 0xe90057cc Mirror 19: 0xe90057cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f9f2: skipped 000922 1787821262.149966 mapwrite 0x0357c8 thru 0x035e3b (0x674 bytes) 000923 1787821262.338429 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35e3c): Mirror 4: 0x263b43c5 (stale) Mirror 9: 0x263b43c5 (stale) Mirror 10: 0x263b43c5 (stale) Mirror 11: 0x263b43c5 (stale) Mirror 14: 0x263b43c5 (stale) Mirror 16: 0x7e9daad9 (stale) Mirror 17: 0x7e9daad9 (stale) Mirror 18: 0x354b4239 (stale) Mirror 19: 0x1a8189f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e3c): Mirror 4: 0x263b43c5 (stale) Mirror 9: 0x263b43c5 (stale) Mirror 10: 0x263b43c5 (stale) Mirror 11: 0x263b43c5 (stale) Mirror 14: 0x263b43c5 (stale) Mirror 16: 0x7e9daad9 (stale) Mirror 17: 0x7e9daad9 (stale) Mirror 18: 0x354b4239 (stale) Mirror 19: 0x1a8189f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e3c: skipped 000924 1787821263.054581 read 0x0131e9 thru 0x016a77 (0x388f bytes) 000928 1787821263.068877 mapwrite 0x035d0e thru 0x03ffff (0xa2f2 bytes) 000929 1787821263.218480 MIRROR_RESYNC 10 mirrors 000930 1787821265.966983 read 0x0058d5 thru 0x0090ab (0x37d7 bytes) 000934 1787821265.993903 trunc from 0x040000 to 0x022d34 (0x1d2cb bytes) 000935 1787821266.165403 mapwrite 0x01652c thru 0x020742 (0xa217 bytes) 000936 1787821266.251596 trunc from 0x022d35 to 0x03a495 (0x17761 bytes) 000937 1787821266.285078 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3a496): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a496): Mirror 4: 0xbb2930a1 (stale) Mirror 9: 0xbb2930a1 (stale) Mirror 10: 0xbb2930a1 (stale) Mirror 11: 0xbb2930a1 (stale) Mirror 14: 0xbb2930a1 (stale) Mirror 16: 0xbb2930a1 (stale) Mirror 17: 0xbb2930a1 (stale) Mirror 18: 0xbb2930a1 (stale) Mirror 19: 0xbb2930a1 (stale) CRC-32 checksum value for chunk [0, 0x3a496): Mirror 1: 0x125dd854 Mirror 20: 0x125dd854 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a496: skipped 000940 1787821267.995193 trunc from 0x03a496 to 0x012683 (0x27e12 bytes) 000941 1787821268.093268 mapwrite 0x01e216 thru 0x0222dc (0x40c7 bytes) 000942 1787821268.205072 read 0x01391f thru 0x021669 (0xdd4b bytes) 000943 1787821268.219933 trunc from 0x0222dd to 0x00629e (0x1c03e bytes) 000944 1787821268.250022 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x629f): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x629f): Mirror 4: 0xa47fdacd (stale) Mirror 9: 0xa47fdacd (stale) Mirror 10: 0xa47fdacd (stale) Mirror 11: 0xa47fdacd (stale) Mirror 14: 0xa47fdacd (stale) Mirror 16: 0xa47fdacd (stale) Mirror 17: 0xa47fdacd (stale) Mirror 18: 0xa47fdacd (stale) Mirror 19: 0xa47fdacd (stale) Mirror 20: 0xa47fdacd (stale) CRC-32 checksum value for chunk [0, 0x629f): Mirror 1: 0xa47fdacd Mirror 21: 0xa47fdacd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x629f: skipped 000945 1787821269.226398 MIRROR_RESYNC 12 mirrors 000950 1787821271.197964 write 0x029544 thru 0x0300fa (0x6bb7 bytes) 000954 1787821271.305621 trunc from 0x0300fb to 0x010fab (0x1f14f bytes) 000955 1787821271.335838 trunc from 0x010fac to 0x022642 (0x11697 bytes) 000957 1787821271.357281 mapread 0x0182db thru 0x018a48 (0x76e bytes) 000958 1787821271.363915 write 0x037f4c thru 0x03ffff (0x80b4 bytes) 000959 1787821271.367182 mapread 0x031ea7 thru 0x03dc42 (0xbd9c bytes) 000962 1787821271.381850 mapread 0x03865d thru 0x03ffff (0x79a3 bytes) 000966 1787821271.385121 read 0x00b331 thru 0x01adb9 (0xfa89 bytes) 000967 1787821271.396135 read 0x028852 thru 0x030ea1 (0x8650 bytes) 000969 1787821271.409061 mapread 0x00418f thru 0x006813 (0x2685 bytes) 000971 1787821271.410707 mapwrite 0x030547 thru 0x0346d2 (0x418c bytes) 000972 1787821271.482013 trunc from 0x040000 to 0x02b718 (0x148e7 bytes) 000973 1787821271.500212 read 0x00dca6 thru 0x00e01d (0x378 bytes) 000975 1787821271.503084 read 0x02b149 thru 0x02b718 (0x5d0 bytes) 000976 1787821271.503907 mapwrite 0x030e99 thru 0x0396b8 (0x8820 bytes) 000977 1787821271.660178 MIRROR_RESYNC 12 mirrors 000978 1787821275.177666 MIRROR_EXTEND to 13 mirrors 000981 1787821277.142189 trunc from 0x0396b9 to 0x033212 (0x64a6 bytes) 000982 1787821277.335939 trunc from 0x033213 to 0x028bb2 (0xa660 bytes) 000984 1787821277.363745 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28bb3): Mirror 9: 0xea7d1015 (stale) Mirror 10: 0xea7d1015 (stale) Mirror 11: 0xea7d1015 (stale) Mirror 14: 0xea7d1015 (stale) Mirror 16: 0xea7d1015 (stale) Mirror 17: 0xea7d1015 (stale) Mirror 18: 0xea7d1015 (stale) Mirror 19: 0xea7d1015 (stale) Mirror 20: 0xea7d1015 (stale) Mirror 21: 0xea7d1015 (stale) Mirror 22: 0xea7d1015 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28bb3): Mirror 9: 0xea7d1015 (stale) Mirror 10: 0xea7d1015 (stale) Mirror 11: 0xea7d1015 (stale) Mirror 14: 0xea7d1015 (stale) Mirror 16: 0xea7d1015 (stale) Mirror 17: 0xea7d1015 (stale) Mirror 18: 0xea7d1015 (stale) Mirror 19: 0xea7d1015 (stale) Mirror 20: 0xea7d1015 (stale) Mirror 21: 0xea7d1015 (stale) Mirror 22: 0xea7d1015 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28bb3: skipped 000985 1787821278.024255 trunc from 0x028bb3 to 0x00fcac (0x18f06 bytes) 000986 1787821278.035650 mapwrite 0x01a1d5 thru 0x01bf82 (0x1dae bytes) 000987 1787821278.166951 trunc from 0x01bf83 to 0x029b04 (0xdb82 bytes) 000988 1787821278.191929 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x29b05): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b05): Mirror 9: 0xce1821ca (stale) Mirror 10: 0xce1821ca (stale) Mirror 11: 0xce1821ca (stale) Mirror 14: 0xce1821ca (stale) Mirror 16: 0xce1821ca (stale) Mirror 17: 0xce1821ca (stale) Mirror 18: 0xce1821ca (stale) Mirror 19: 0xce1821ca (stale) Mirror 20: 0xce1821ca (stale) Mirror 21: 0xce1821ca (stale) Mirror 22: 0xce1821ca (stale) CRC-32 checksum value for chunk [0, 0x29b05): Mirror 1: 0xcb46c660 Mirror 23: 0xcb46c660 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b05: skipped 000989 1787821279.880106 mapread 0x014735 thru 0x024475 (0xfd41 bytes) 000990 1787821279.906388 mapwrite 0x02acc3 thru 0x02dcd5 (0x3013 bytes) 000992 1787821280.062992 write 0x02e23d thru 0x03234b (0x410f bytes) 000993 1787821280.064971 trunc from 0x03234c to 0x0317e3 (0xb68 bytes) 000994 1787821280.084998 mapwrite 0x0317d1 thru 0x0346ee (0x2f1e bytes) 000995 1787821280.141547 write 0x013e4b thru 0x0222d9 (0xe48f bytes) 000996 1787821280.149290 mapwrite 0x01ad23 thru 0x01aeba (0x198 bytes) 000997 1787821280.197605 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x346ef): Mirror 9: 0xe3a780fd (stale) Mirror 10: 0xe3a780fd (stale) Mirror 11: 0xe3a780fd (stale) Mirror 16: 0xe3a780fd (stale) Mirror 17: 0xe3a780fd (stale) Mirror 18: 0xe3a780fd (stale) Mirror 19: 0xe3a780fd (stale) Mirror 20: 0xe3a780fd (stale) Mirror 21: 0xe3a780fd (stale) Mirror 22: 0xe3a780fd (stale) Mirror 23: 0x223b6458 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x346ef): Mirror 9: 0xe3a780fd (stale) Mirror 10: 0xe3a780fd (stale) Mirror 11: 0xe3a780fd (stale) Mirror 16: 0xe3a780fd (stale) Mirror 17: 0xe3a780fd (stale) Mirror 18: 0xe3a780fd (stale) Mirror 19: 0xe3a780fd (stale) Mirror 20: 0xe3a780fd (stale) Mirror 21: 0xe3a780fd (stale) Mirror 22: 0xe3a780fd (stale) Mirror 23: 0x223b6458 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x346ef: skipped 000998 1787821281.008291 mapwrite 0x00a695 thru 0x019134 (0xeaa0 bytes) 000999 1787821281.131967 read 0x010cec thru 0x014021 (0x3336 bytes) 001000 1787821281.132955 write 0x03647c thru 0x0364b9 (0x3e bytes) All operations completed A-OK!