== sanity-flr test 70a: flr mode fsx test ================ 21:25:47 (1782609947) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 9949 skipping zero size read truncating to largest ever: 0x87a7 000002 1782609950.182131 trunc from 00000000 to 0x0087a6 (0x87a7 bytes) 000003 1782609950.213908 write 0x035a2e thru 0x036e18 (0x13eb bytes) zero_range to largest ever: 0x163a6 000004 1782609950.216213 trunc from 0x008708 to 0x0163a5 (0xdc9e bytes) 000005 1782609950.228069 trunc from 0x0130f3 to 0x014943 (0x1851 bytes) 000006 1782609950.240456 fallocate 0x00d8e7 thru 0x00ea6e (0x1188 bytes) 000007 1782609950.246554 read 0x0258f7 thru 0x02bf18 (0x6622 bytes) 000008 1782609950.266968 mapread 0x008596 thru 0x00ae1a (0x2885 bytes) 000009 1782609950.333108 mapread 0x00abc1 thru 0x00ef14 (0x4354 bytes) 000010 1782609950.337233 trunc from 0x016c3a to 0x026219 (0xf5e0 bytes) 000011 1782609950.355524 mapread 0x01f5f9 thru 0x029122 (0x9b2a bytes) 000012 1782609950.383589 punch from 0x01954a to 0x027368 (0xde1f bytes) 000013 1782609950.409548 MIRROR_EXTEND to 2 mirrors 000014 1782609951.469378 MIRROR_RESYNC 2 mirrors 000015 1782609952.017538 mapwrite 0x00d79f thru 0x00ea92 (0x12f4 bytes) 000017 1782609952.105564 trunc from 0x01d7ea to 0x02a28f (0xcaa6 bytes) 000018 1782609952.110448 mapwrite 0x0204ca thru 0x027d3c (0x7873 bytes) truncating to largest ever: 0x2a8db 000019 1782609952.150302 trunc from 0x036e19 to 0x02a8da (0xc53e bytes) 000020 1782609952.248391 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2a8db): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a8db): Mirror 2: 0xf5f9e263 (stale) CRC-32 checksum value for chunk [0, 0x2a8db): Mirror 1: 0x84ea377d Mirror 3: 0x84ea377d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a8db: skipped fallocating to largest ever: 0x40000 000021 1782609953.691991 fallocate 0x032dcb thru 0x03ffff (0xd235 bytes) 000022 1782609953.757911 write 0x00f170 thru 0x0144f3 (0x5384 bytes) 000023 1782609953.791668 trunc from 0x01de08 to 0x02a8da (0xcad3 bytes) 000024 1782609953.817895 MIRROR_RESYNC 3 mirrors 000025 1782609955.196719 write 0x022751 thru 0x02b149 (0x89f9 bytes) 000026 1782609955.290869 trunc from 0x00a090 to 0x0191b5 (0xf126 bytes) 000027 1782609955.301681 trunc from 0x02b14a to 0x026398 (0x4db1 bytes) 000028 1782609955.365911 read 0x003795 thru 0x00c929 (0x9195 bytes) 000029 1782609955.386691 mapread 0x01eac6 thru 0x021028 (0x2563 bytes) 000030 1782609955.423850 fallocate 0x006f11 thru 0x009d83 (0x2e73 bytes) 000031 1782609955.439732 trunc from 0x011547 to 0x019020 (0x7ada bytes) 000032 1782609955.449943 read 0x0070cc thru 0x00b85a (0x478f bytes) 000033 1782609955.454678 trunc from 0x026399 to 0x02c9a5 (0x660d bytes) 000035 1782609955.485557 mapwrite 0x024e0f thru 0x029cb1 (0x4ea3 bytes) 000036 1782609955.588465 trunc from 0x02c9a6 to 0x0374d1 (0xab2c bytes) 000038 1782609955.639940 mapread 0x000b61 thru 0x003870 (0x2d10 bytes) 000039 1782609955.649065 mapread 0x02f8f2 thru 0x0374d1 (0x7be0 bytes) 000040 1782609955.697832 trunc from 0x0374d2 to 0x032950 (0x4b81 bytes) 000042 1782609955.738478 read 0x00623a thru 0x016210 (0xffd7 bytes) 000043 1782609955.741966 write 0x012272 thru 0x01598b (0x371a bytes) 000044 1782609955.744854 trunc from 0x00e8c0 to 0x016b45 (0x8286 bytes) 000045 1782609955.778402 trunc from 0x00d9b2 to 0x0116ea (0x3d39 bytes) 000046 1782609955.795050 mapwrite 0x01f638 thru 0x0291f3 (0x9bbc bytes) 000047 1782609955.860924 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32951): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32951): Mirror 2: 0x3b43f462 (stale) Mirror 3: 0x3b43f462 (stale) CRC-32 checksum value for chunk [0, 0x32951): Mirror 1: 0x1588c6a2 Mirror 4: 0x1588c6a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32951: skipped 000048 1782609957.274439 mapread 0x016f3d thru 0x0265a3 (0xf667 bytes) 000050 1782609957.313067 write 0x01a3ef thru 0x0246b0 (0xa2c2 bytes) 000052 1782609957.416541 mapwrite 0x03090b thru 0x037cac (0x73a2 bytes) 000053 1782609957.566256 mapread 0x033600 thru 0x037cac (0x46ad bytes) 000054 1782609957.567965 fallocate 0x008201 thru 0x012d66 (0xab66 bytes) 000056 1782609957.577980 mapread 0x01ca05 thru 0x01e52f (0x1b2b bytes) 000057 1782609957.580365 mapwrite 0x009b61 thru 0x010738 (0x6bd8 bytes) 000058 1782609957.610940 mapread 0x01920a thru 0x023d64 (0xab5b bytes) 000059 1782609957.624974 fallocate 0x01aab1 thru 0x02a4f8 (0xfa48 bytes) 000060 1782609957.631042 read 0x027782 thru 0x02a98c (0x320b bytes) 000061 1782609957.637032 punch from 0x000049 to 0x004970 (0x4928 bytes) 000062 1782609957.647106 punch from 0x0075cd to 0x015ba8 (0xe5dc bytes) 000063 1782609957.654969 trunc from 0x037cad to 0x030059 (0x7c53 bytes) 000064 1782609957.694645 punch from 0x00ad41 to 0x012579 (0x7839 bytes) 000065 1782609957.708857 fallocate 0x0113eb thru 0x0194e0 (0x80f6 bytes) 000066 1782609957.720590 trunc from 0x03005a to 0x01a46a (0x15bef bytes) 000067 1782609957.749769 trunc from 0x01a46b to 0x02afe1 (0x10b77 bytes) 000068 1782609957.777950 mapread 0x0154d0 thru 0x020c2b (0xb75c bytes) 000069 1782609957.810879 punch from 0x0227f0 to 0x02afe1 (0x87f2 bytes) 000070 1782609957.816398 write 0x00b347 thru 0x014d60 (0x9a1a bytes) 000071 1782609957.827328 fallocate 0x032a14 thru 0x039293 (0x6880 bytes) 000072 1782609957.843139 mapread 0x026680 thru 0x0282e2 (0x1c63 bytes) 000073 1782609957.863807 write 0x02a113 thru 0x0373a7 (0xd295 bytes) 000074 1782609957.880684 fallocate 0x0287d7 thru 0x037be4 (0xf40e bytes) 000075 1782609957.892201 mapwrite 0x0024f7 thru 0x01153c (0xf046 bytes) 000076 1782609957.950004 punch from 0x00a139 to 0x016071 (0xbf39 bytes) 000077 1782609957.969999 read 0x01931b thru 0x01d25c (0x3f42 bytes) 000079 1782609957.971457 trunc from 0x005b94 to 0x0126e2 (0xcb4f bytes) 000080 1782609957.992114 fallocate 0x037894 thru 0x03ffff (0x876c bytes) 000081 1782609958.011225 mapread 0x011d24 thru 0x01be78 (0xa155 bytes) 000082 1782609958.042856 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb7c2e1cb (stale) Mirror 4: 0x976ef454 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb7c2e1cb (stale) Mirror 4: 0x976ef454 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000083 1782609958.534412 write 0x01aa6c thru 0x02a978 (0xff0d bytes) 000084 1782609958.567868 read 0x003852 thru 0x00c1db (0x898a bytes) 000087 1782609958.590167 write 0x00d3e9 thru 0x018d54 (0xb96c bytes) 000088 1782609958.613013 fallocate 0x00281d thru 0x01129d (0xea81 bytes) 000089 1782609958.643682 MIRROR_RESYNC 3 mirrors 000090 1782609960.026036 punch from 0x00557a to 0x0082da (0x2d61 bytes) 000091 1782609960.087688 mapwrite 0x00e715 thru 0x018f70 (0xa85c bytes) 000092 1782609960.152406 trunc from 0x008dd4 to 0x013cb1 (0xaede bytes) 000093 1782609960.160990 read 0x019dea thru 0x01cdb6 (0x2fcd bytes) 000094 1782609960.171734 trunc from 0x01d71f to 0x02667e (0x8f60 bytes) 000095 1782609960.181765 punch from 0x01f4c8 to 0x026dad (0x78e6 bytes) 000096 1782609960.193836 MIRROR_RESYNC 3 mirrors 000097 1782609961.190715 read 0x036320 thru 0x039736 (0x3417 bytes) 000098 1782609961.198053 read 0x015101 thru 0x01e172 (0x9072 bytes) 000099 1782609961.215946 MIRROR_EXTEND to 4 mirrors 000100 1782609962.325667 punch from 0x0072ea to 0x0154a2 (0xe1b9 bytes) 000102 1782609962.394158 mapwrite 0x024dc4 thru 0x02a67d (0x58ba bytes) 000103 1782609962.452581 trunc from 0x01c4c5 to 0x022b5a (0x6696 bytes) 000104 1782609962.473821 MIRROR_RESYNC 4 mirrors 000105 1782609963.846595 punch from 0x03242b to 0x03a0c7 (0x7c9d bytes) 000106 1782609963.906083 read 0x02630d thru 0x02d548 (0x723c bytes) 000107 1782609963.917536 mapwrite 0x025ed9 thru 0x028628 (0x2750 bytes) 000108 1782609963.936798 mapread 0x02719e thru 0x029b37 (0x299a bytes) 000109 1782609963.939478 mapread 0x000600 thru 0x008554 (0x7f55 bytes) 000110 1782609963.954006 mapwrite 0x0006e2 thru 0x008897 (0x81b6 bytes) 000111 1782609963.978210 mapwrite 0x00a5f9 thru 0x012aef (0x84f7 bytes) 000112 1782609964.035585 trunc from 0x040000 to 0x02172f (0x1e8d0 bytes) 000113 1782609964.059939 trunc from 0x014259 to 0x01fec1 (0xbc69 bytes) 000114 1782609964.070693 trunc from 0x00e78f to 0x0168b1 (0x8123 bytes) 000116 1782609964.089773 fallocate 0x03858f thru 0x03ffff (0x7a71 bytes) 000117 1782609964.108400 trunc from 0x0273d1 to 0x02f357 (0x7f87 bytes) 000118 1782609964.136708 read 0x01d3c6 thru 0x022871 (0x54ac bytes) 000119 1782609964.147715 write 0x022cdf thru 0x02d12a (0xa44c bytes) 000120 1782609964.149254 read 0x03e02a thru 0x03f79f (0x1776 bytes) 000121 1782609964.149944 trunc from 0x040000 to 0x02c138 (0x13ec7 bytes) 000122 1782609964.168132 trunc from 0x02c139 to 0x01304f (0x190e9 bytes) 000123 1782609964.198655 mapread 0x001217 thru 0x0050cd (0x3eb7 bytes) 000126 1782609964.201029 write 0x00e081 thru 0x011c54 (0x3bd4 bytes) 000129 1782609964.206670 mapread 0x00d2fb thru 0x010136 (0x2e3c bytes) 000130 1782609964.208144 read 0x0027f7 thru 0x00507e (0x2888 bytes) 000131 1782609964.209670 write 0x013722 thru 0x014471 (0xd50 bytes) 000133 1782609964.219664 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14472): Mirror 4: 0xaf7a235d (stale) Mirror 5: 0xaf7a235d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14472): Mirror 4: 0xaf7a235d (stale) Mirror 5: 0xaf7a235d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14472: skipped 000134 1782609964.683829 write 0x00a9d4 thru 0x01409d (0x96ca bytes) 000135 1782609964.711174 trunc from 0x0068f8 to 0x014471 (0xdb7a bytes) 000136 1782609964.733240 trunc from 0x00db21 to 0x011f89 (0x4469 bytes) 000137 1782609964.742417 write 0x0132b0 thru 0x01b27a (0x7fcb bytes) 000138 1782609964.752276 mapread 0x019056 thru 0x01b27a (0x2225 bytes) 000139 1782609964.753884 trunc from 0x01b27b to 0x03ecba (0x23a40 bytes) 000140 1782609964.785457 write 0x00592f thru 0x01031c (0xa9ee bytes) 000141 1782609964.820753 punch from 0x007b58 to 0x00c075 (0x451e bytes) 000142 1782609964.851477 fallocate 0x00a6eb thru 0x00e363 (0x3c79 bytes) 000143 1782609964.866425 write 0x01bbc3 thru 0x0291fb (0xd639 bytes) 000144 1782609964.878465 mapwrite 0x01746e thru 0x01a250 (0x2de3 bytes) 000145 1782609964.939665 mapwrite 0x00bbb8 thru 0x01896f (0xcdb8 bytes) 000146 1782609964.985724 punch from 0x000e9f to 0x01099d (0xfaff bytes) 000147 1782609964.991992 punch from 0x0253b3 to 0x0284ba (0x3108 bytes) 000148 1782609964.997635 mapwrite 0x01e4e4 thru 0x0219ae (0x34cb bytes) 000149 1782609965.017092 fallocate 0x03c7b6 thru 0x03ffff (0x384a bytes) 000150 1782609965.024735 mapwrite 0x03426e thru 0x03ffff (0xbd92 bytes) 000151 1782609965.106488 trunc from 0x040000 to 0x02ec62 (0x1139d bytes) 000152 1782609965.131893 trunc from 0x02ec63 to 0x015e53 (0x18e0f bytes) 000153 1782609965.154408 mapread 0x00d0f8 thru 0x0143ad (0x72b6 bytes) 000154 1782609965.174876 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x15e54): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15e54): Mirror 4: 0x742ff48b (stale) Mirror 5: 0x742ff48b (stale) CRC-32 checksum value for chunk [0, 0x15e54): Mirror 1: 0xcee41e22 Mirror 6: 0xcee41e22 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15e54: skipped 000155 1782609966.293711 punch from 0x008321 to 0x015e53 (0xdb33 bytes) 000156 1782609966.364738 read 0x01245e thru 0x015e53 (0x39f6 bytes) 000157 1782609966.375361 mapwrite 0x01d6a2 thru 0x025ee9 (0x8848 bytes) 000158 1782609966.502667 fallocate 0x000ad2 thru 0x00bf24 (0xb453 bytes) 000159 1782609966.515794 write 0x00c8ec thru 0x016a44 (0xa159 bytes) 000161 1782609966.531221 fallocate 0x038007 thru 0x03ffff (0x7ff9 bytes) 000162 1782609966.542947 mapwrite 0x0120b5 thru 0x01b7a1 (0x96ed bytes) 000163 1782609966.593372 trunc from 0x040000 to 0x002ab8 (0x3d547 bytes) 000165 1782609966.620412 trunc from 0x000841 to 0x002ab8 (0x2278 bytes) 000166 1782609966.632822 read 0x000fe1 thru 0x002ab8 (0x1ad8 bytes) 000167 1782609966.639806 write 0x013600 thru 0x020109 (0xcb0a bytes) 000168 1782609966.643896 mapwrite 0x02f2d4 thru 0x03c4b0 (0xd1dd bytes) 000169 1782609966.718685 fallocate 0x035b27 thru 0x03ffff (0xa4d9 bytes) 000170 1782609966.724778 read 0x008f10 thru 0x0175d2 (0xe6c3 bytes) 000171 1782609966.726451 fallocate 0x00749e thru 0x0117ff (0xa362 bytes) 000172 1782609966.731742 mapwrite 0x01720a thru 0x019b75 (0x296c bytes) 000173 1782609966.743188 trunc from 0x03bbd0 to 0x03c4b0 (0x8e1 bytes) 000174 1782609966.753133 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c4b1): Mirror 5: 0x1a930211 (stale) Mirror 6: 0x691bce56 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4b1): Mirror 5: 0x1a930211 (stale) Mirror 6: 0x691bce56 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4b1: skipped 000175 1782609967.200914 punch from 0x03317b to 0x03821a (0x50a0 bytes) 000176 1782609967.220806 mapread 0x001452 thru 0x010289 (0xee38 bytes) 000177 1782609967.254339 fallocate 0x039635 thru 0x039895 (0x261 bytes) 000178 1782609967.260471 mapread 0x029dbb thru 0x039d96 (0xffdc bytes) 000179 1782609967.285380 trunc from 0x03c4b1 to 0x03954d (0x2f63 bytes) 000180 1782609967.314741 trunc from 0x01b28c to 0x029a59 (0xe7ce bytes) 000181 1782609967.321595 trunc from 0x007c0d to 0x00fa00 (0x7df4 bytes) 000182 1782609967.332428 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3954e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3954e): Mirror 5: 0x675906a0 (stale) Mirror 6: 0x3a70d8b4 (stale) CRC-32 checksum value for chunk [0, 0x3954e): Mirror 1: 0x8c57b623 Mirror 7: 0x8c57b623 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3954e: skipped 000183 1782609968.486778 trunc from 0x03954e to 0x02f259 (0xa2f4 bytes) 000184 1782609968.573563 write 0x035a38 thru 0x03a330 (0x48f9 bytes) 000185 1782609968.576255 mapwrite 0x01c3cb thru 0x0204cd (0x4103 bytes) 000186 1782609968.632840 trunc from 0x03a331 to 0x001689 (0x38ca7 bytes) 000187 1782609968.683107 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x168a): Mirror 6: 0xc66dcdd8 (stale) Mirror 7: 0x64ebc225 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x168a): Mirror 6: 0xc66dcdd8 (stale) Mirror 7: 0x64ebc225 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x168a: skipped 000188 1782609969.080525 mapwrite 0x024c46 thru 0x026f71 (0x232c bytes) 000189 1782609969.142297 mapwrite 0x0348c0 thru 0x03df6c (0x96ad bytes) 000190 1782609969.262902 write 0x008432 thru 0x00a48e (0x205d bytes) 000191 1782609969.301444 read 0x0064c8 thru 0x01073d (0xa276 bytes) 000192 1782609969.316546 write 0x03adc3 thru 0x03d1b5 (0x23f3 bytes) 000193 1782609969.319475 trunc from 0x03df6d to 0x0363a4 (0x7bc8 bytes) 000194 1782609969.354410 read 0x02752c thru 0x02fa63 (0x8538 bytes) 000195 1782609969.381275 read 0x0258e2 thru 0x030f29 (0xb648 bytes) 000196 1782609969.382119 trunc from 0x0363a5 to 0x00f125 (0x2727f bytes) 000197 1782609969.399456 write 0x03ddbf thru 0x03ee78 (0x10ba bytes) 000199 1782609969.402839 mapwrite 0x037266 thru 0x037356 (0xf1 bytes) 000200 1782609969.438434 write 0x0397e0 thru 0x03a894 (0x10b5 bytes) 000201 1782609969.441468 read 0x002bc5 thru 0x009529 (0x6965 bytes) 000203 1782609969.448656 MIRROR_RESYNC 3 mirrors 000204 1782609970.984180 mapwrite 0x03cbae thru 0x03efba (0x240d bytes) 000205 1782609971.081655 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3efbb): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3efbb): Mirror 6: 0x5e50eb1d (stale) Mirror 7: 0x5e50eb1d (stale) CRC-32 checksum value for chunk [0, 0x3efbb): Mirror 1: 0x1970c576 Mirror 8: 0x1970c576 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3efbb: skipped 000206 1782609972.228053 trunc from 0x03efbb to 0x028564 (0x16a56 bytes) 000208 1782609972.378784 trunc from 0x028565 to 0x00881b (0x1fd49 bytes) 000209 1782609972.410527 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x881c): Mirror 6: 0x9770c052 (stale) Mirror 7: 0x9770c052 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x881c): Mirror 6: 0x9770c052 (stale) Mirror 7: 0x9770c052 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x881c: skipped 000210 1782609972.676792 write 0x00ba3f thru 0x00efa8 (0x356a bytes) 000211 1782609972.683713 punch from 0x008f72 to 0x00efa8 (0x6037 bytes) 000212 1782609972.695640 mapwrite 0x033bc0 thru 0x0386f4 (0x4b35 bytes) 000213 1782609972.743473 punch from 0x02c71f to 0x0311a7 (0x4a89 bytes) 000216 1782609972.750553 write 0x016626 thru 0x022ab4 (0xc48f bytes) 000217 1782609972.763554 punch from 0x031577 to 0x034645 (0x30cf bytes) 000218 1782609972.771883 trunc from 0x01cc4b to 0x02928d (0xc643 bytes) 000219 1782609972.784762 trunc from 0x01d908 to 0x02b515 (0xdc0e bytes) 000222 1782609972.796292 MIRROR_RESYNC 3 mirrors 000223 1782609974.018234 MIRROR_EXTEND to 4 mirrors 000224 1782609974.977872 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) 000226 1782609975.390504 fallocate 0x00587f thru 0x00f25d (0x99df bytes) 000227 1782609975.445082 punch from 0x027f81 to 0x0308f6 (0x8976 bytes) 000228 1782609975.450452 punch from 0x001702 to 0x001987 (0x286 bytes) 000229 1782609975.456169 fallocate 0x038581 thru 0x03e2b6 (0x5d36 bytes) 000230 1782609975.461676 punch from 0x017454 to 0x017cc0 (0x86d bytes) 000232 1782609975.467755 punch from 0x028879 to 0x030697 (0x7e1f bytes) 000233 1782609975.473619 mapread 0x01dde4 thru 0x01f5f7 (0x1814 bytes) 000234 1782609975.493187 mapwrite 0x0313b6 thru 0x035a56 (0x46a1 bytes) 000235 1782609975.522427 read 0x010258 thru 0x014a36 (0x47df bytes) 000236 1782609975.531788 fallocate 0x0168d5 thru 0x0262fa (0xfa26 bytes) 000237 1782609975.536847 read 0x011a7d thru 0x01e4db (0xca5f bytes) 000238 1782609975.555394 mapread 0x01930d thru 0x027c01 (0xe8f5 bytes) 000240 1782609975.561956 trunc from 0x03e2b7 to 0x02400a (0x1a2ac bytes) 000241 1782609975.587564 punch from 0x01fd65 to 0x023cce (0x3f6a bytes) 000242 1782609975.601813 trunc from 0x00f3c0 to 0x0125b7 (0x31f8 bytes) 000243 1782609975.639833 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2400b): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2400b): Mirror 6: 0xc9ab08c (stale) Mirror 7: 0xc9ab08c (stale) CRC-32 checksum value for chunk [0, 0x2400b): Mirror 1: 0xa6dd5a12 Mirror 8: 0xa6dd5a12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2400b: skipped 000244 1782609976.983230 read 0x017086 thru 0x02400a (0xcf85 bytes) 000245 1782609976.995246 mapread 0x00ac60 thru 0x00f920 (0x4cc1 bytes) 000246 1782609977.023525 trunc from 0x013379 to 0x01b592 (0x821a bytes) 000247 1782609977.077394 mapwrite 0x02a164 thru 0x032e07 (0x8ca4 bytes) 000248 1782609977.195751 mapread 0x010cb5 thru 0x01c8d9 (0xbc25 bytes) 000249 1782609977.245610 mapwrite 0x01cfef thru 0x024284 (0x7296 bytes) 000250 1782609977.289603 write 0x007749 thru 0x014eb4 (0xd76c bytes) 000251 1782609977.311445 trunc from 0x032e08 to 0x025788 (0xd67f bytes) 000252 1782609977.359587 punch from 0x005e34 to 0x008f21 (0x30ee bytes) 000253 1782609977.407084 trunc from 0x01d2ea to 0x025788 (0x849f bytes) 000254 1782609977.419015 trunc from 0x00e9eb to 0x016689 (0x7c9f bytes) 000255 1782609977.426865 read 0x021043 thru 0x025788 (0x4746 bytes) 000256 1782609977.444212 read 0x004243 thru 0x010432 (0xc1f0 bytes) 000257 1782609977.446506 trunc from 0x025789 to 0x007010 (0x1e778 bytes) 000258 1782609977.477259 mapwrite 0x00959d thru 0x0173b5 (0xde19 bytes) 000259 1782609977.528741 trunc from 0x012a93 to 0x0173b5 (0x4923 bytes) 000260 1782609977.535441 mapread 0x010caa thru 0x0173b5 (0x670c bytes) 000261 1782609977.569453 fallocate 0x01c616 thru 0x025987 (0x9372 bytes) 000262 1782609977.577593 mapwrite 0x0125c4 thru 0x017acf (0x550c bytes) 000263 1782609977.610940 mapwrite 0x01e01c thru 0x02b4ce (0xd4b3 bytes) 000264 1782609977.691746 mapwrite 0x02c5b7 thru 0x0337f1 (0x723b bytes) 000265 1782609977.742858 mapwrite 0x01d981 thru 0x01ec62 (0x12e2 bytes) 000266 1782609977.758695 fallocate 0x03afc7 thru 0x03ffff (0x5039 bytes) 000267 1782609977.770555 trunc from 0x0192fe to 0x02810f (0xee12 bytes) 000268 1782609977.777146 punch from 0x01a8c4 to 0x028cb7 (0xe3f4 bytes) 000269 1782609977.790076 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe37236f6 (stale) Mirror 8: 0xf7585945 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe37236f6 (stale) Mirror 8: 0xf7585945 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000270 1782609978.288347 trunc from 0x040000 to 0x02a231 (0x15dce bytes) 000271 1782609978.316135 mapread 0x0187b2 thru 0x023068 (0xa8b7 bytes) 000272 1782609978.373785 write 0x029188 thru 0x02f6df (0x6558 bytes) 000273 1782609978.377697 trunc from 0x02f6e0 to 0x01b344 (0x1439b bytes) 000274 1782609978.422844 punch from 0x01449d to 0x01b344 (0x6ea8 bytes) 000275 1782609978.436168 read 0x0146f1 thru 0x018f02 (0x4812 bytes) 000276 1782609978.456168 read 0x00d2df thru 0x019d68 (0xca8a bytes) 000277 1782609978.487594 trunc from 0x01b345 to 0x018b73 (0x27d1 bytes) 000278 1782609978.506617 mapwrite 0x0166f8 thru 0x022c88 (0xc591 bytes) 000280 1782609978.593934 mapwrite 0x015e38 thru 0x02491b (0xeae4 bytes) 000281 1782609978.717156 fallocate 0x000ffe thru 0x009a1a (0x8a1d bytes) 000282 1782609978.728509 mapwrite 0x03ccac thru 0x03ffff (0x3354 bytes) 000283 1782609978.865692 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf7585945 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf7585945 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000284 1782609979.397283 trunc from 0x036cc7 to 0x03ffff (0x9339 bytes) 000285 1782609979.402644 mapwrite 0x02ae7d thru 0x030cd1 (0x5e55 bytes) 000287 1782609979.443728 mapread 0x0306d4 thru 0x030824 (0x151 bytes) 000288 1782609979.461232 MIRROR_RESYNC 2 mirrors 000289 1782609980.185852 MIRROR_EXTEND to 3 mirrors 000290 1782609980.998009 fallocate 0x0163a2 thru 0x01e750 (0x83af bytes) 000291 1782609981.103000 fallocate 0x03fcc1 thru 0x03ffff (0x33f bytes) 000292 1782609981.119743 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3508f174 (stale) Mirror 9: 0x3508f174 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3508f174 Mirror 10: 0x3508f174 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000293 1782609982.352571 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3508f174 (stale) Mirror 9: 0x3508f174 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3508f174 Mirror 10: 0x3508f174 Mirror 11: 0x3508f174 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000294 1782609983.533675 fallocate 0x02e4b3 thru 0x036fb2 (0x8b00 bytes) 000295 1782609983.629068 write 0x024fb1 thru 0x02eab2 (0x9b02 bytes) 000296 1782609983.664809 mapwrite 0x008c8b thru 0x013fe5 (0xb35b bytes) 000297 1782609983.762220 fallocate 0x033bae thru 0x0386d7 (0x4b2a bytes) 000298 1782609983.774355 write 0x0243f7 thru 0x02f498 (0xb0a2 bytes) 000299 1782609983.788580 fallocate 0x01fba6 thru 0x024cca (0x5125 bytes) 000300 1782609983.801714 punch from 0x029ec3 to 0x02af7f (0x10bd bytes) 000301 1782609983.826285 write 0x013bc5 thru 0x020556 (0xc992 bytes) 000302 1782609983.837304 mapread 0x03a440 thru 0x03ffff (0x5bc0 bytes) 000303 1782609983.871839 trunc from 0x040000 to 0x01f476 (0x20b89 bytes) 000304 1782609983.920130 write 0x02cc94 thru 0x03c833 (0xfba0 bytes) 000305 1782609983.926750 fallocate 0x02bb0b thru 0x034d94 (0x928a bytes) 000306 1782609983.941624 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c834): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c834): Mirror 8: 0x3234988a (stale) Mirror 9: 0x3234988a (stale) Mirror 10: 0x3234988a (stale) Mirror 11: 0x3234988a (stale) CRC-32 checksum value for chunk [0, 0x3c834): Mirror 1: 0xd156be57 Mirror 12: 0xd156be57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c834: skipped 000307 1782609985.799061 mapwrite 0x024ccd thru 0x02652f (0x1863 bytes) 000308 1782609985.966457 write 0x0090c3 thru 0x0130d0 (0xa00e bytes) 000309 1782609986.025088 MIRROR_RESYNC 6 mirrors 000310 1782609988.690299 mapread 0x012623 thru 0x01f563 (0xcf41 bytes) 000312 1782609988.754429 trunc from 0x03c834 to 0x02ed55 (0xdade bytes) 000313 1782609988.863078 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ed56): Mirror 9: 0xaa40e99c (stale) Mirror 10: 0xaa40e99c (stale) Mirror 11: 0xaa40e99c (stale) Mirror 12: 0xaa40e99c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed56): Mirror 9: 0xaa40e99c (stale) Mirror 10: 0xaa40e99c (stale) Mirror 11: 0xaa40e99c (stale) Mirror 12: 0xaa40e99c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed56: skipped 000314 1782609989.570382 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ed56): Mirror 9: 0xaa40e99c (stale) Mirror 10: 0xaa40e99c (stale) Mirror 11: 0xaa40e99c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed56): Mirror 9: 0xaa40e99c (stale) Mirror 10: 0xaa40e99c (stale) Mirror 11: 0xaa40e99c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed56: skipped 000315 1782609990.189776 mapwrite 0x011e45 thru 0x016d7c (0x4f38 bytes) 000316 1782609990.229172 mapread 0x02bc13 thru 0x02ed55 (0x3143 bytes) 000317 1782609990.239611 trunc from 0x01c57f to 0x028970 (0xc3f2 bytes) 000318 1782609990.248127 trunc from 0x02ed56 to 0x00ec85 (0x200d0 bytes) 000319 1782609990.270565 fallocate 0x004190 thru 0x010f58 (0xcdc9 bytes) 000320 1782609990.276999 fallocate 0x006ecb thru 0x00c37e (0x54b4 bytes) 000321 1782609990.283453 read 0x001be8 thru 0x00e5a0 (0xc9b9 bytes) 000322 1782609990.294454 punch from 0x00deeb to 0x00ec85 (0xd9b bytes) 000323 1782609990.300708 mapwrite 0x00379a thru 0x006a41 (0x32a8 bytes) 000324 1782609990.323613 trunc from 0x009057 to 0x00cdc4 (0x3d6e bytes) 000325 1782609990.329660 trunc from 0x0043c6 to 0x00662c (0x2267 bytes) 000327 1782609990.338570 fallocate 0x034941 thru 0x039aa1 (0x5161 bytes) 000328 1782609990.344556 mapwrite 0x032385 thru 0x039dd5 (0x7a51 bytes) 000329 1782609990.422730 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39dd6): Mirror 10: 0xb0215753 (stale) Mirror 11: 0xb0215753 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39dd6): Mirror 10: 0xb0215753 (stale) Mirror 11: 0xb0215753 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39dd6: skipped 000330 1782609990.992599 read 0x01cd2a thru 0x02511a (0x83f1 bytes) 000331 1782609991.017842 write 0x029bd4 thru 0x037df0 (0xe21d bytes) 000332 1782609991.061009 trunc from 0x039dd6 to 0x00b22e (0x2eba7 bytes) 000333 1782609991.106524 write 0x0122b4 thru 0x0180b7 (0x5e04 bytes) 000334 1782609991.113734 MIRROR_RESYNC 3 mirrors 000335 1782609992.287940 fallocate 0x0049d3 thru 0x009926 (0x4f54 bytes) 000336 1782609992.324951 mapread 0x000168 thru 0x0066db (0x6574 bytes) 000337 1782609992.359428 read 0x002de0 thru 0x00e588 (0xb7a9 bytes) 000338 1782609992.360718 punch from 0x0092ed to 0x00a53c (0x1250 bytes) 000339 1782609992.366019 mapread 0x017fac thru 0x0180b7 (0x10c bytes) 000340 1782609992.381170 mapread 0x00b1b3 thru 0x0180b7 (0xcf05 bytes) 000341 1782609992.382913 punch from 0x006db7 to 0x00da63 (0x6cad bytes) 000342 1782609992.396703 mapwrite 0x010966 thru 0x01557f (0x4c1a bytes) 000343 1782609992.426057 trunc from 0x0157fa to 0x0180b7 (0x28be bytes) 000346 1782609992.439446 punch from 0x00d1eb to 0x0180b7 (0xaecd bytes) 000347 1782609992.447213 punch from 0x001a37 to 0x005ebf (0x4489 bytes) 000348 1782609992.456084 mapread 0x006f76 thru 0x014e1f (0xdeaa bytes) 000349 1782609992.495731 read 0x005a12 thru 0x009101 (0x36f0 bytes) 000350 1782609992.497105 fallocate 0x02767b thru 0x03543e (0xddc4 bytes) 000352 1782609992.503405 mapwrite 0x00eb57 thru 0x012f9c (0x4446 bytes) 000353 1782609992.519124 mapread 0x00f212 thru 0x0180b7 (0x8ea6 bytes) 000355 1782609992.522558 mapwrite 0x02bc90 thru 0x02def8 (0x2269 bytes) 000356 1782609992.591683 trunc from 0x02def9 to 0x0246ac (0x984c bytes) 000357 1782609992.608938 mapwrite 0x03c35d thru 0x03ffff (0x3ca3 bytes) 000358 1782609992.652634 read 0x0134aa thru 0x021fc3 (0xeb1a bytes) 000359 1782609992.653599 trunc from 0x040000 to 0x000c47 (0x3f3b8 bytes) 000360 1782609992.671006 trunc from 0x000a53 to 0x000c47 (0x1f5 bytes) 000361 1782609992.691472 trunc from 0x000c48 to 0x00e568 (0xd921 bytes) 000362 1782609992.719302 trunc from 0x00e569 to 0x00852c (0x603c bytes) 000363 1782609992.752228 trunc from 0x00852d to 0x03bb65 (0x33639 bytes) 000364 1782609992.773165 trunc from 0x01c482 to 0x023ca3 (0x7822 bytes) 000365 1782609992.793994 MIRROR_RESYNC 3 mirrors 000366 1782609993.703418 mapwrite 0x02b3ef thru 0x0388f1 (0xd503 bytes) 000367 1782609993.841578 mapwrite 0x007f9e thru 0x01573b (0xd79e bytes) 000368 1782609993.923247 mapread 0x0039a1 thru 0x004609 (0xc69 bytes) 000369 1782609993.924766 mapwrite 0x002293 thru 0x00fe6b (0xdbd9 bytes) 000370 1782609993.955609 fallocate 0x034672 thru 0x035082 (0xa11 bytes) 000371 1782609993.960919 write 0x016380 thru 0x0177e4 (0x1465 bytes) 000372 1782609993.962071 punch from 0x01a9bb to 0x01eeff (0x4545 bytes) 000373 1782609993.966710 fallocate 0x028fff thru 0x033d91 (0xad93 bytes) 000375 1782609993.973110 write 0x031e5c thru 0x03e3fa (0xc59f bytes) 000378 1782609993.977768 trunc from 0x03e3fb to 0x001665 (0x3cd95 bytes) 000379 1782609993.996931 punch from 0x001610 to 0x001665 (0x56 bytes) 000380 1782609994.002566 fallocate 0x022962 thru 0x02f4cd (0xcb6c bytes) 000381 1782609994.008503 read 0x00065a thru 0x001665 (0x100c bytes) 000382 1782609994.015408 fallocate 0x0236a7 thru 0x02e866 (0xb1c0 bytes) 000383 1782609994.020498 punch from 0x02bc71 to 0x02e866 (0x2bf6 bytes) 000384 1782609994.033414 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e867): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e867): Mirror 10: 0xdd020715 (stale) Mirror 11: 0xdd020715 (stale) CRC-32 checksum value for chunk [0, 0x2e867): Mirror 1: 0xdd020715 Mirror 12: 0xdd020715 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e867: skipped 000385 1782609995.266470 fallocate 0x0038bc thru 0x010ae6 (0xd22b bytes) 000386 1782609995.322720 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e867): Mirror 10: 0xdd020715 (stale) Mirror 12: 0xdd020715 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e867): Mirror 10: 0xdd020715 (stale) Mirror 12: 0xdd020715 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e867: skipped 000387 1782609995.710629 fallocate 0x038314 thru 0x03f40c (0x70f9 bytes) 000388 1782609995.718127 mapwrite 0x0144b6 thru 0x022e32 (0xe97d bytes) 000389 1782609995.844618 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f40d): Mirror 12: 0x2bcbc08a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f40d): Mirror 12: 0x2bcbc08a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f40d: skipped 000390 1782609996.192099 fallocate 0x00e3d4 thru 0x010e50 (0x2a7d bytes) 000391 1782609996.211623 punch from 0x00d646 to 0x0126f8 (0x50b3 bytes) 000392 1782609996.217543 fallocate 0x026c16 thru 0x027c0e (0xff9 bytes) 000393 1782609996.233487 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f40d): Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f40d): Mirror 12: 0x2bcbc08a (stale) CRC-32 checksum value for chunk [0, 0x3f40d): Mirror 1: 0x3078dec0 Mirror 13: 0x3078dec0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f40d: skipped 000395 1782609997.350032 trunc from 0x014c8e to 0x01dff9 (0x936c bytes) 000396 1782609997.425749 read 0x025c50 thru 0x02ae6b (0x521c bytes) 000397 1782609997.444482 mapwrite 0x0309b1 thru 0x03e73a (0xdd8a bytes) 000398 1782609997.519166 mapwrite 0x01edcd thru 0x02557c (0x67b0 bytes) 000399 1782609997.585609 read 0x033f31 thru 0x038cbc (0x4d8c bytes) 000400 1782609997.602468 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f40d): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f40d): Mirror 12: 0x2bcbc08a (stale) Mirror 13: 0x3078dec0 (stale) CRC-32 checksum value for chunk [0, 0x3f40d): Mirror 1: 0xa685ea47 Mirror 14: 0xa685ea47 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f40d: skipped 000401 1782609998.973033 mapread 0x008e7a thru 0x00f480 (0x6607 bytes) 000402 1782609999.017025 punch from 0x00436a to 0x00e3be (0xa055 bytes) 000403 1782609999.088229 write 0x0059fa thru 0x0096e3 (0x3cea bytes) 000404 1782609999.116916 trunc from 0x0303cb to 0x03d927 (0xd55d bytes) 000407 1782609999.131239 punch from 0x026737 to 0x0312e3 (0xabad bytes) 000408 1782609999.145154 trunc from 0x03f40d to 0x001cd6 (0x3d736 bytes) 000410 1782609999.184586 mapwrite 0x0009de thru 0x0097b2 (0x8dd5 bytes) 000411 1782609999.333134 fallocate 0x004f41 thru 0x00f5d3 (0xa693 bytes) 000412 1782609999.346652 trunc from 0x0004b3 to 0x003bcf (0x371d bytes) 000413 1782609999.355592 punch from 0x00da30 to 0x00f5d3 (0x1ba4 bytes) 000414 1782609999.368487 mapwrite 0x00aaee thru 0x00ddf7 (0x330a bytes) 000415 1782609999.403470 read 0x00adfe thru 0x00f5d3 (0x47d6 bytes) 000416 1782609999.407873 fallocate 0x00e56a thru 0x019036 (0xaacd bytes) 000417 1782609999.416537 mapread 0x0093a0 thru 0x00f5d3 (0x6234 bytes) 000418 1782609999.424118 trunc from 0x00f5d4 to 0x025dda (0x16807 bytes) 000419 1782609999.486296 trunc from 0x025ddb to 0x00d375 (0x18a65 bytes) 000420 1782609999.517163 trunc from 0x002aeb to 0x00d375 (0xa88b bytes) 000421 1782609999.524791 punch from 0x00b2f1 to 0x00d375 (0x2085 bytes) 000422 1782609999.533435 punch from 0x00617f to 0x00d375 (0x71f7 bytes) 000423 1782609999.542571 mapread 0x00a1c7 thru 0x00d375 (0x31af bytes) 000424 1782609999.560020 trunc from 0x00d376 to 0x00ab0f (0x2866 bytes) 000426 1782609999.595478 mapwrite 0x0098e3 thru 0x016252 (0xc970 bytes) 000427 1782609999.695683 trunc from 0x016253 to 0x009418 (0xce3a bytes) 000429 1782609999.714966 fallocate 0x035a58 thru 0x03b16e (0x5717 bytes) 000430 1782609999.726011 read 0x02e06b thru 0x03af45 (0xcedb bytes) 000431 1782609999.738016 mapwrite 0x021013 thru 0x02ad70 (0x9d5e bytes) 000432 1782609999.759107 write 0x016c49 thru 0x0240d9 (0xd491 bytes) 000433 1782609999.768998 MIRROR_RESYNC 4 mirrors 000434 1782610001.414105 mapread 0x035133 thru 0x03b16e (0x603c bytes) 000435 1782610001.445636 punch from 0x01d385 to 0x020bd9 (0x3855 bytes) 000436 1782610001.495108 mapwrite 0x030ff5 thru 0x032ffd (0x2009 bytes) 000437 1782610001.542511 trunc from 0x03b16f to 0x00e07b (0x2d0f3 bytes) 000438 1782610001.586382 mapread 0x006d6a thru 0x00e07b (0x7312 bytes) 000439 1782610001.612495 mapread 0x001122 thru 0x00dcf9 (0xcbd8 bytes) 000440 1782610001.618853 punch from 0x000336 to 0x007811 (0x74dc bytes) 000441 1782610001.639003 read 0x0008c8 thru 0x00e07b (0xd7b4 bytes) 000442 1782610001.658409 fallocate 0x02ca3f thru 0x033379 (0x693b bytes) 000443 1782610001.669887 fallocate 0x03f8e0 thru 0x03ffff (0x720 bytes) 000444 1782610001.685297 trunc from 0x00e07c to 0x006b96 (0x74e5 bytes) 000445 1782610001.721006 mapwrite 0x00fa1e thru 0x01a7ca (0xadad bytes) 000446 1782610001.841948 trunc from 0x01a7cb to 0x032632 (0x17e68 bytes) 000447 1782610001.869023 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x32633): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32633): Mirror 12: 0x8e2c3503 (stale) Mirror 13: 0x8e2c3503 (stale) Mirror 14: 0x8e2c3503 (stale) CRC-32 checksum value for chunk [0, 0x32633): Mirror 1: 0x4d9d2b8e Mirror 15: 0x4d9d2b8e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32633: skipped 000448 1782610002.898123 write 0x0264f7 thru 0x028019 (0x1b23 bytes) 000449 1782610002.952869 punch from 0x01c0ff to 0x025d4e (0x9c50 bytes) 000450 1782610002.959005 mapread 0x022ab1 thru 0x030904 (0xde54 bytes) 000451 1782610002.986616 punch from 0x00deb0 to 0x0188ad (0xa9fe bytes) 000452 1782610002.995463 trunc from 0x030d1a to 0x032632 (0x1919 bytes) 000453 1782610003.001108 mapwrite 0x022497 thru 0x031d29 (0xf893 bytes) 000454 1782610003.054131 punch from 0x01a74d to 0x01c24d (0x1b01 bytes) 000456 1782610003.072495 trunc from 0x032633 to 0x00da81 (0x24bb1 bytes) 000457 1782610003.115778 trunc from 0x00da82 to 0x01790f (0x9e8e bytes) 000458 1782610003.156118 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17910): Mirror 13: 0x521330a0 (stale) Mirror 14: 0x521330a0 (stale) Mirror 15: 0xe924c8ba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17910): Mirror 13: 0x521330a0 (stale) Mirror 14: 0x521330a0 (stale) Mirror 15: 0xe924c8ba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17910: skipped 000459 1782610003.646226 trunc from 0x017910 to 0x008799 (0xf176 bytes) 000460 1782610003.673094 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x879a): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x879a): Mirror 13: 0x13b55896 (stale) Mirror 14: 0x13b55896 (stale) Mirror 15: 0x13b55896 (stale) CRC-32 checksum value for chunk [0, 0x879a): Mirror 1: 0x13b55896 Mirror 16: 0x13b55896 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x879a: skipped 000461 1782610004.591827 trunc from 0x006fee to 0x008799 (0x17ac bytes) 000462 1782610004.642067 mapwrite 0x02a895 thru 0x02fb6d (0x52d9 bytes) 000463 1782610004.741670 mapread 0x01ff1d thru 0x02b036 (0xb11a bytes) 000465 1782610004.761432 read 0x01fbb8 thru 0x02779f (0x7be8 bytes) 000466 1782610004.763507 trunc from 0x02fb6e to 0x019daa (0x15dc3 bytes) 000467 1782610004.808659 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19dab): Mirror 14: 0xceb81236 (stale) Mirror 15: 0xbcd2fcce (stale) Mirror 16: 0x94d4e500 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19dab): Mirror 14: 0xceb81236 (stale) Mirror 15: 0xbcd2fcce (stale) Mirror 16: 0x94d4e500 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19dab: skipped 000468 1782610005.348501 trunc from 0x00fac7 to 0x0116f3 (0x1c2d bytes) 000469 1782610005.360305 mapread 0x004989 thru 0x00805d (0x36d5 bytes) 000470 1782610005.393166 write 0x02b444 thru 0x033fea (0x8ba7 bytes) 000471 1782610005.402597 read 0x02879d thru 0x0289e1 (0x245 bytes) 000472 1782610005.413592 mapread 0x012f41 thru 0x018084 (0x5144 bytes) 000473 1782610005.429452 write 0x03880f thru 0x03ffff (0x77f1 bytes) 000474 1782610005.430917 mapread 0x01fe08 thru 0x02af5a (0xb153 bytes) 000476 1782610005.462985 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xee66e6fa (stale) Mirror 15: 0x22ef04e7 (stale) Mirror 16: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x87a34e6b Mirror 17: 0x87a34e6b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000477 1782610006.380006 fallocate 0x020378 thru 0x02313f (0x2dc8 bytes) 000478 1782610006.436534 trunc from 0x00c144 to 0x01a522 (0xe3df bytes) 000479 1782610006.455620 MIRROR_RESYNC 5 mirrors 000480 1782610007.905463 read 0x0359ff thru 0x03ffff (0xa601 bytes) 000481 1782610007.920721 mapread 0x0256d3 thru 0x032822 (0xd150 bytes) 000482 1782610007.970045 trunc from 0x01b1fb to 0x01e96f (0x3775 bytes) 000483 1782610008.023237 trunc from 0x040000 to 0x034e55 (0xb1aa bytes) 000484 1782610008.063696 read 0x03202d thru 0x034e55 (0x2e29 bytes) 000486 1782610008.107178 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34e56): Mirror 15: 0x3ff2886e (stale) Mirror 16: 0x3ff2886e (stale) Mirror 17: 0x3ff2886e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e56): Mirror 15: 0x3ff2886e (stale) Mirror 16: 0x3ff2886e (stale) Mirror 17: 0x3ff2886e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e56: skipped 000487 1782610008.495655 MIRROR_RESYNC 4 mirrors 000488 1782610009.684541 trunc from 0x023ab1 to 0x024c0a (0x115a bytes) 000489 1782610009.724302 mapread 0x001ab0 thru 0x0036e0 (0x1c31 bytes) 000490 1782610009.754082 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x34e56): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e56): Mirror 15: 0x3ff2886e (stale) Mirror 16: 0x3ff2886e (stale) Mirror 17: 0x3ff2886e (stale) CRC-32 checksum value for chunk [0, 0x34e56): Mirror 1: 0x3ff2886e Mirror 18: 0x3ff2886e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e56: skipped 000491 1782610010.936576 write 0x034945 thru 0x03ffff (0xb6bb bytes) 000492 1782610010.989948 mapwrite 0x00db13 thru 0x016c5f (0x914d bytes) 000493 1782610011.043469 write 0x021e45 thru 0x023225 (0x13e1 bytes) 000494 1782610011.063436 mapread 0x00aec9 thru 0x010ae3 (0x5c1b bytes) 000495 1782610011.069952 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x4009a99 (stale) Mirror 16: 0x4009a99 (stale) Mirror 17: 0x4009a99 (stale) Mirror 18: 0x4009a99 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x62d3578a Mirror 19: 0x62d3578a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000496 1782610012.087101 mapread 0x00956b thru 0x0189cd (0xf463 bytes) 000497 1782610012.165417 trunc from 0x0087a3 to 0x00d797 (0x4ff5 bytes) 000498 1782610012.212984 trunc from 0x032fb0 to 0x03ffd8 (0xd029 bytes) 000499 1782610012.219157 read 0x0032f2 thru 0x00c2c8 (0x8fd7 bytes) 000500 1782610012.233583 write 0x0117ba thru 0x014112 (0x2959 bytes) 000501 1782610012.248087 mapread 0x03c67b thru 0x03ffff (0x3985 bytes) 000502 1782610012.257352 trunc from 0x040000 to 0x03ce34 (0x31cb bytes) 000503 1782610012.299817 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ce35): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce35): Mirror 15: 0xb3d60432 (stale) Mirror 16: 0xb3d60432 (stale) Mirror 17: 0xb3d60432 (stale) Mirror 18: 0xb3d60432 (stale) Mirror 19: 0xe6dcc4c5 (stale) CRC-32 checksum value for chunk [0, 0x3ce35): Mirror 1: 0x86514148 Mirror 20: 0x86514148 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce35: skipped 000504 1782610013.455497 write 0x01d53c thru 0x025818 (0x82dd bytes) 000505 1782610013.533582 trunc from 0x020971 to 0x030270 (0xf900 bytes) 000507 1782610013.562548 trunc from 0x03ce35 to 0x0393e4 (0x3a50 bytes) 000508 1782610013.611093 trunc from 0x018dbb to 0x027345 (0xe58b bytes) 000509 1782610013.623044 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x393e5): Mirror 15: 0x7d92b3d3 (stale) Mirror 16: 0x7d92b3d3 (stale) Mirror 17: 0x7d92b3d3 (stale) Mirror 18: 0x7d92b3d3 (stale) Mirror 20: 0x646b6e4d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393e5): Mirror 15: 0x7d92b3d3 (stale) Mirror 16: 0x7d92b3d3 (stale) Mirror 17: 0x7d92b3d3 (stale) Mirror 18: 0x7d92b3d3 (stale) Mirror 20: 0x646b6e4d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393e5: skipped 000510 1782610014.116280 trunc from 0x0238a1 to 0x027a3c (0x419c bytes) 000511 1782610014.123502 trunc from 0x0209f7 to 0x02a3ed (0x99f7 bytes) 000512 1782610014.129181 write 0x023ad7 thru 0x033026 (0xf550 bytes) 000513 1782610014.144917 read 0x037524 thru 0x0393e4 (0x1ec1 bytes) 000514 1782610014.151797 fallocate 0x01fc40 thru 0x0267b5 (0x6b76 bytes) 000515 1782610014.160341 MIRROR_RESYNC 6 mirrors 000516 1782610015.983578 write 0x0155cb thru 0x016e27 (0x185d bytes) 000517 1782610016.055051 fallocate 0x011214 thru 0x01ef7c (0xdd69 bytes) 000518 1782610016.066825 write 0x030884 thru 0x03c2a5 (0xba22 bytes) 000519 1782610016.072811 write 0x00bb91 thru 0x015d55 (0xa1c5 bytes) 000521 1782610016.087075 mapwrite 0x019b48 thru 0x020a94 (0x6f4d bytes) 000522 1782610016.182196 trunc from 0x00262c to 0x00ba39 (0x940e bytes) 000523 1782610016.191877 punch from 0x028938 to 0x028bd3 (0x29c bytes) 000524 1782610016.200637 fallocate 0x003502 thru 0x00af5d (0x7a5c bytes) 000525 1782610016.211107 trunc from 0x03c2a6 to 0x02f454 (0xce51 bytes) 000526 1782610016.231586 mapread 0x02766d thru 0x02d5b5 (0x5f49 bytes) 000527 1782610016.242284 write 0x00657e thru 0x0154d1 (0xef54 bytes) 000529 1782610016.255134 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f455): Mirror 16: 0x3924a770 (stale) Mirror 17: 0x3924a770 (stale) Mirror 18: 0x3924a770 (stale) Mirror 20: 0x3924a770 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f455): Mirror 16: 0x3924a770 (stale) Mirror 17: 0x3924a770 (stale) Mirror 18: 0x3924a770 (stale) Mirror 20: 0x3924a770 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f455: skipped 000530 1782610016.779496 mapread 0x014cba thru 0x024647 (0xf98e bytes) 000531 1782610016.810537 trunc from 0x02820d to 0x02f454 (0x7248 bytes) 000532 1782610016.816089 punch from 0x00933c to 0x00d4c8 (0x418d bytes) 000533 1782610016.823565 mapread 0x007ae7 thru 0x0095da (0x1af4 bytes) 000534 1782610016.834109 punch from 0x02e69e to 0x02f454 (0xdb7 bytes) 000535 1782610016.839278 read 0x0264f4 thru 0x02f454 (0x8f61 bytes) 000536 1782610016.854541 punch from 0x026500 to 0x02f454 (0x8f55 bytes) 000537 1782610016.863955 read 0x0074d0 thru 0x009065 (0x1b96 bytes) 000538 1782610016.864633 trunc from 0x02aed0 to 0x02f454 (0x4585 bytes) 000539 1782610016.882861 fallocate 0x010b5f thru 0x017dbf (0x7261 bytes) 000540 1782610016.889111 mapread 0x016f0e thru 0x023dfc (0xceef bytes) 000541 1782610016.891118 punch from 0x0015ce to 0x0099db (0x840e bytes) 000543 1782610016.902703 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f455): Mirror 16: 0x3924a770 (stale) Mirror 17: 0x3924a770 (stale) Mirror 18: 0x3924a770 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f455): Mirror 16: 0x3924a770 (stale) Mirror 17: 0x3924a770 (stale) Mirror 18: 0x3924a770 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f455: skipped 000544 1782610017.381577 mapread 0x014517 thru 0x0145af (0x99 bytes) 000545 1782610017.389179 trunc from 0x00761f to 0x01245f (0xae41 bytes) 000546 1782610017.396291 mapwrite 0x00e919 thru 0x01bb66 (0xd24e bytes) 000547 1782610017.468344 trunc from 0x02f455 to 0x00e6da (0x20d7a bytes) 000548 1782610017.492021 punch from 0x0020f5 to 0x0065f5 (0x4501 bytes) 000549 1782610017.501023 trunc from 0x007dc1 to 0x00e6da (0x691a bytes) 000550 1782610017.531829 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe6db): Mirror 17: 0xdc2ee46e (stale) Mirror 18: 0xdc2ee46e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe6db): Mirror 17: 0xdc2ee46e (stale) Mirror 18: 0xdc2ee46e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe6db: skipped 000551 1782610017.856073 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xe6db): Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe6db): Mirror 17: 0xdc2ee46e (stale) Mirror 18: 0xdc2ee46e (stale) CRC-32 checksum value for chunk [0, 0xe6db): Mirror 1: 0x42ce7077 Mirror 19: 0x42ce7077 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe6db: skipped 000554 1782610019.197010 trunc from 0x00e6db to 0x03fe62 (0x31788 bytes) 000555 1782610019.262302 trunc from 0x03fe63 to 0x0284d2 (0x17990 bytes) 000556 1782610019.288893 mapread 0x00255c thru 0x00f663 (0xd108 bytes) 000557 1782610019.320533 trunc from 0x021861 to 0x0284d2 (0x6c72 bytes) 000558 1782610019.332212 fallocate 0x018f0d thru 0x023209 (0xa2fd bytes) 000559 1782610019.339174 mapwrite 0x00ddde thru 0x0140b6 (0x62d9 bytes) 000560 1782610019.384027 trunc from 0x0284d3 to 0x003b3b (0x24997 bytes) 000561 1782610019.410290 trunc from 0x003b3c to 0x02c513 (0x289d8 bytes) 000562 1782610019.438231 fallocate 0x0069e8 thru 0x009404 (0x2a1d bytes) 000563 1782610019.447935 fallocate 0x00b8a7 thru 0x017286 (0xb9e0 bytes) 000564 1782610019.459444 trunc from 0x007c43 to 0x014173 (0xc531 bytes) 000565 1782610019.468488 trunc from 0x008bf6 to 0x009835 (0xc40 bytes) 000566 1782610019.478557 mapread 0x0114a9 thru 0x019afc (0x8654 bytes) 000567 1782610019.504871 read 0x025b44 thru 0x029a11 (0x3ece bytes) 000568 1782610019.512587 mapwrite 0x01d517 thru 0x0260e6 (0x8bd0 bytes) 000570 1782610019.555154 write 0x035c2c thru 0x0379ea (0x1dbf bytes) 000572 1782610019.558005 punch from 0x010cc9 to 0x01a037 (0x936f bytes) 000573 1782610019.565013 fallocate 0x004169 thru 0x0074ed (0x3385 bytes) 000574 1782610019.572449 read 0x006825 thru 0x010269 (0x9a45 bytes) 000575 1782610019.585269 write 0x007b25 thru 0x01341e (0xb8fa bytes) 000576 1782610019.587522 punch from 0x007349 to 0x009b41 (0x27f9 bytes) 000579 1782610019.610280 fallocate 0x00a831 thru 0x0178e9 (0xd0b9 bytes) 000580 1782610019.617477 mapwrite 0x03f7f6 thru 0x03ffff (0x80a bytes) 000581 1782610019.675649 read 0x028d76 thru 0x033aca (0xad55 bytes) 000582 1782610019.676685 fallocate 0x02ddc9 thru 0x032ec1 (0x50f9 bytes) 000583 1782610019.693836 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xf2980d03 (stale) Mirror 18: 0xf2980d03 (stale) Mirror 19: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2f50ad58 Mirror 20: 0x2f50ad58 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000584 1782610021.019166 read 0x024968 thru 0x0294e0 (0x4b79 bytes) 000585 1782610021.053997 trunc from 0x01f295 to 0x026491 (0x71fd bytes) 000586 1782610021.118169 punch from 0x03c7a0 to 0x03ffff (0x3860 bytes) 000587 1782610021.128778 mapwrite 0x02a836 thru 0x031ac6 (0x7291 bytes) 000588 1782610021.165885 trunc from 0x013f7a to 0x014739 (0x7c0 bytes) 000589 1782610021.171069 write 0x00dcc7 thru 0x01bf59 (0xe293 bytes) 000590 1782610021.185530 read 0x012151 thru 0x013359 (0x1209 bytes) 000591 1782610021.186726 punch from 0x00db20 to 0x016e8a (0x936b bytes) 000592 1782610021.203590 trunc from 0x017c90 to 0x02039c (0x870d bytes) 000593 1782610021.211875 mapwrite 0x02633c thru 0x02bb09 (0x57ce bytes) 000594 1782610021.243491 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xf2980d03 (stale) Mirror 18: 0xf2980d03 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0x2f50ad58 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3df867c4 Mirror 21: 0x3df867c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000595 1782610022.808445 fallocate 0x014b71 thru 0x0173fd (0x288d bytes) 000596 1782610022.851427 mapread 0x035dbf thru 0x03ffff (0xa241 bytes) 000597 1782610022.875985 trunc from 0x040000 to 0x03e1d4 (0x1e2b bytes) 000598 1782610022.930972 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e1d5): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e1d5): Mirror 17: 0xe94be6a (stale) Mirror 18: 0xe94be6a (stale) Mirror 19: 0xd364ec29 (stale) Mirror 20: 0x1c308e91 (stale) Mirror 21: 0xf3c296d9 (stale) CRC-32 checksum value for chunk [0, 0x3e1d5): Mirror 1: 0xf3c296d9 Mirror 22: 0xf3c296d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e1d5: skipped 000599 1782610024.306443 mapwrite 0x02909e thru 0x02a821 (0x1784 bytes) 000600 1782610024.460794 mapwrite 0x03367e thru 0x03b2a9 (0x7c2c bytes) 000601 1782610024.536796 mapwrite 0x03baaa thru 0x03ffff (0x4556 bytes) 000602 1782610024.621911 mapwrite 0x038389 thru 0x03ebae (0x6826 bytes) 000603 1782610024.645211 fallocate 0x03b02b thru 0x03ffff (0x4fd5 bytes) 000604 1782610024.655287 trunc from 0x001cce to 0x003660 (0x1993 bytes) 000605 1782610024.664055 fallocate 0x035dec thru 0x03ffff (0xa214 bytes) 000606 1782610024.675839 mapread 0x014524 thru 0x015eea (0x19c7 bytes) 000607 1782610024.702912 mapwrite 0x026fcc thru 0x027d90 (0xdc5 bytes) 000608 1782610024.757644 read 0x037462 thru 0x03fdf4 (0x8993 bytes) 000609 1782610024.758823 fallocate 0x01d36e thru 0x0239b1 (0x6644 bytes) 000610 1782610024.770197 mapread 0x014324 thru 0x0237f3 (0xf4d0 bytes) 000611 1782610024.784844 mapwrite 0x017f60 thru 0x025da0 (0xde41 bytes) 000612 1782610024.819104 write 0x035b98 thru 0x03ffff (0xa468 bytes) 000613 1782610024.821710 trunc from 0x025cf9 to 0x030bf7 (0xaeff bytes) 000614 1782610024.835079 punch from 0x007d47 to 0x014ede (0xd198 bytes) 000615 1782610024.843223 read 0x0152b7 thru 0x01fe43 (0xab8d bytes) 000616 1782610024.845698 trunc from 0x040000 to 0x016a53 (0x295ac bytes) 000617 1782610024.886076 MIRROR_RESYNC 7 mirrors 000618 1782610026.568803 trunc from 0x00db48 to 0x016a53 (0x8f0c bytes) 000619 1782610026.612813 MIRROR_RESYNC 7 mirrors 000620 1782610028.128669 trunc from 0x01158a to 0x0165de (0x5055 bytes) 000621 1782610028.159849 mapwrite 0x01f25a thru 0x0239f1 (0x4798 bytes) 000622 1782610028.216412 write 0x023ccf thru 0x0274f3 (0x3825 bytes) 000623 1782610028.218765 fallocate 0x02ec74 thru 0x033416 (0x47a3 bytes) 000624 1782610028.226953 punch from 0x0296bb to 0x033416 (0x9d5c bytes) 000625 1782610028.233781 fallocate 0x019986 thru 0x0240b9 (0xa734 bytes) 000626 1782610028.239296 trunc from 0x01f5f4 to 0x027a8c (0x8499 bytes) 000627 1782610028.256066 punch from 0x027ffa to 0x033416 (0xb41d bytes) 000628 1782610028.272092 trunc from 0x01d456 to 0x02b792 (0xe33d bytes) 000629 1782610028.283395 mapwrite 0x017d1a thru 0x0241c5 (0xc4ac bytes) 000630 1782610028.335717 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x33417): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33417): Mirror 17: 0x2e10346c (stale) Mirror 18: 0x2e10346c (stale) Mirror 19: 0x2e10346c (stale) Mirror 20: 0x2e10346c (stale) Mirror 21: 0x2e10346c (stale) Mirror 22: 0x2e10346c (stale) CRC-32 checksum value for chunk [0, 0x33417): Mirror 1: 0x2ea3fff2 Mirror 23: 0x2ea3fff2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33417: skipped 000632 1782610029.678436 trunc from 0x02f5ee to 0x032b90 (0x35a3 bytes) 000633 1782610029.736987 write 0x036879 thru 0x03ffff (0x9787 bytes) 000634 1782610029.746146 trunc from 0x040000 to 0x011057 (0x2efa8 bytes) 000635 1782610029.801958 mapwrite 0x0041aa thru 0x00ad36 (0x6b8d bytes) 000636 1782610029.862742 mapread 0x001503 thru 0x00c11d (0xac1b bytes) 000637 1782610029.866072 trunc from 0x011058 to 0x0032a0 (0xddb7 bytes) 000638 1782610029.887282 trunc from 0x0032a1 to 0x00a3c1 (0x7121 bytes) 000639 1782610029.910089 mapwrite 0x03d7f5 thru 0x03fda1 (0x25ad bytes) 000640 1782610029.983997 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fda2): Mirror 17: 0x706be140 (stale) Mirror 18: 0x706be140 (stale) Mirror 19: 0x706be140 (stale) Mirror 20: 0x706be140 (stale) Mirror 21: 0x706be140 (stale) Mirror 23: 0x252d87c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fda2): Mirror 17: 0x706be140 (stale) Mirror 18: 0x706be140 (stale) Mirror 19: 0x706be140 (stale) Mirror 20: 0x706be140 (stale) Mirror 21: 0x706be140 (stale) Mirror 23: 0x252d87c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fda2: skipped 000641 1782610030.910173 mapwrite 0x00df6b thru 0x012be6 (0x4c7c bytes) 000642 1782610030.989161 punch from 0x003920 to 0x0065c2 (0x2ca3 bytes) 000643 1782610030.996137 trunc from 0x03fda2 to 0x013190 (0x2cc11 bytes) 000644 1782610031.031439 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x13191): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13191): Mirror 17: 0xd6fc4ae5 (stale) Mirror 18: 0xd6fc4ae5 (stale) Mirror 19: 0xd6fc4ae5 (stale) Mirror 20: 0xd6fc4ae5 (stale) Mirror 21: 0xd6fc4ae5 (stale) Mirror 23: 0xd6fc4ae5 (stale) CRC-32 checksum value for chunk [0, 0x13191): Mirror 1: 0x76c7c591 Mirror 24: 0x76c7c591 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13191: skipped 000645 1782610032.301361 punch from 0x0123d7 to 0x012a56 (0x680 bytes) 000646 1782610032.382065 write 0x005c41 thru 0x00c40f (0x67cf bytes) 000647 1782610032.446335 punch from 0x00259d to 0x01110f (0xeb73 bytes) 000648 1782610032.467290 fallocate 0x027f31 thru 0x032d51 (0xae21 bytes) 000650 1782610032.474291 trunc from 0x013191 to 0x024825 (0x11695 bytes) 000651 1782610032.535286 trunc from 0x01be3a to 0x01de27 (0x1fee bytes) 000653 1782610032.557529 trunc from 0x024826 to 0x033e2d (0xf608 bytes) 000654 1782610032.581636 write 0x03a27c thru 0x03c074 (0x1df9 bytes) 000655 1782610032.585840 trunc from 0x03c075 to 0x01fef2 (0x1c182 bytes) 000656 1782610032.627839 mapread 0x00ed71 thru 0x010056 (0x12e6 bytes) 000657 1782610032.687107 mapwrite 0x032088 thru 0x0339ee (0x1967 bytes) 000658 1782610032.800894 write 0x02e58b thru 0x03d6ba (0xf130 bytes) 000659 1782610032.810388 mapwrite 0x02f807 thru 0x03209d (0x2897 bytes) 000660 1782610032.846236 fallocate 0x0019b9 thru 0x0071b1 (0x57f9 bytes) 000661 1782610032.882582 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 17: 0x189c826f (stale) Mirror 18: 0x189c826f (stale) Mirror 19: 0x189c826f (stale) Mirror 20: 0x189c826f (stale) Mirror 21: 0x189c826f (stale) Mirror 23: 0xb4c98b3f (stale) Mirror 24: 0x796242a8 (stale) CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 1: 0xc8f87202 Mirror 25: 0xc8f87202 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6bb: skipped 000662 1782610034.315906 mapwrite 0x019a30 thru 0x022d44 (0x9315 bytes) 000663 1782610034.504810 trunc from 0x01d4ed to 0x026640 (0x9154 bytes) 000664 1782610034.520696 punch from 0x008617 to 0x0170d6 (0xeac0 bytes) 000665 1782610034.527176 punch from 0x02e576 to 0x02f6f4 (0x117f bytes) 000666 1782610034.532299 punch from 0x030fcc to 0x03ad66 (0x9d9b bytes) 000667 1782610034.550008 read 0x03a6ba thru 0x03d6ba (0x3001 bytes) 000668 1782610034.566372 write 0x012bc4 thru 0x0173dc (0x4819 bytes) 000669 1782610034.585759 punch from 0x030674 to 0x0330bc (0x2a49 bytes) 000670 1782610034.603001 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 17: 0x189c826f (stale) Mirror 18: 0x189c826f (stale) Mirror 19: 0x189c826f (stale) Mirror 20: 0x189c826f (stale) Mirror 23: 0xb4c98b3f (stale) Mirror 24: 0x796242a8 (stale) Mirror 25: 0xc8f87202 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 17: 0x189c826f (stale) Mirror 18: 0x189c826f (stale) Mirror 19: 0x189c826f (stale) Mirror 20: 0x189c826f (stale) Mirror 23: 0xb4c98b3f (stale) Mirror 24: 0x796242a8 (stale) Mirror 25: 0xc8f87202 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6bb: skipped 000672 1782610035.346556 write 0x023c63 thru 0x027402 (0x37a0 bytes) 000673 1782610035.365835 write 0x000b1f thru 0x003a2e (0x2f10 bytes) 000674 1782610035.375291 trunc from 0x00f8e9 to 0x010387 (0xa9f bytes) 000676 1782610035.380417 trunc from 0x01a99b to 0x028807 (0xde6d bytes) 000678 1782610035.396758 mapwrite 0x01de18 thru 0x01ecd2 (0xebb bytes) 000679 1782610035.422902 mapread 0x03872f thru 0x03d6ba (0x4f8c bytes) 000681 1782610035.437372 mapread 0x0110f2 thru 0x019fc6 (0x8ed5 bytes) 000682 1782610035.459831 punch from 0x01b99d to 0x020cb1 (0x5315 bytes) 000683 1782610035.475161 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 17: 0x189c826f (stale) Mirror 18: 0x189c826f (stale) Mirror 19: 0x189c826f (stale) Mirror 23: 0xb4c98b3f (stale) Mirror 24: 0x796242a8 (stale) Mirror 25: 0xc8f87202 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 17: 0x189c826f (stale) Mirror 18: 0x189c826f (stale) Mirror 19: 0x189c826f (stale) Mirror 23: 0xb4c98b3f (stale) Mirror 24: 0x796242a8 (stale) Mirror 25: 0xc8f87202 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6bb: skipped 000684 1782610035.985834 trunc from 0x03d6bb to 0x000c69 (0x3ca51 bytes) 000685 1782610036.020099 mapwrite 0x02ea5e thru 0x034e8b (0x642e bytes) 000687 1782610036.105822 trunc from 0x009db2 to 0x0127ef (0x8a3e bytes) 000688 1782610036.111247 punch from 0x00a9a1 to 0x01a01b (0xf67b bytes) 000689 1782610036.118068 read 0x033c01 thru 0x034e8b (0x128b bytes) 000690 1782610036.119066 punch from 0x02a0ad to 0x02cb9b (0x2aef bytes) 000691 1782610036.128277 fallocate 0x02b849 thru 0x03a313 (0xeacb bytes) 000692 1782610036.143657 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34e8c): Mirror 18: 0x2ca8c2cd (stale) Mirror 19: 0x2ca8c2cd (stale) Mirror 23: 0x934c9438 (stale) Mirror 24: 0x58fe0861 (stale) Mirror 25: 0x1947ca8a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e8c): Mirror 18: 0x2ca8c2cd (stale) Mirror 19: 0x2ca8c2cd (stale) Mirror 23: 0x934c9438 (stale) Mirror 24: 0x58fe0861 (stale) Mirror 25: 0x1947ca8a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e8c: skipped 000693 1782610036.762209 trunc from 0x034e8c to 0x034686 (0x805 bytes) 000694 1782610036.794008 mapwrite 0x01a8c3 thru 0x0264fc (0xbc3a bytes) 000695 1782610036.860835 read 0x01d040 thru 0x01e590 (0x1551 bytes) 000696 1782610036.862143 fallocate 0x0214d4 thru 0x030190 (0xecbd bytes) 000697 1782610036.869267 mapread 0x02868c thru 0x0300fb (0x7a70 bytes) 000698 1782610036.887864 mapwrite 0x0389ba thru 0x03cf3b (0x4582 bytes) 000699 1782610036.934276 read 0x005d09 thru 0x00c117 (0x640f bytes) 000700 1782610036.947854 mapread 0x01b983 thru 0x01f3b9 (0x3a37 bytes) 000701 1782610036.949384 punch from 0x02bb09 to 0x02ee71 (0x3369 bytes) 000703 1782610036.956360 read 0x010756 thru 0x01819c (0x7a47 bytes) 000704 1782610036.963108 MIRROR_RESYNC 6 mirrors 000705 1782610038.930680 trunc from 0x03cf3c to 0x012644 (0x2a8f7 bytes) 000706 1782610038.986898 write 0x027925 thru 0x027dd1 (0x4ad bytes) 000707 1782610038.988177 read 0x022e24 thru 0x02362a (0x807 bytes) 000708 1782610038.999281 trunc from 0x027dd2 to 0x016775 (0x1165c bytes) 000709 1782610039.041490 mapread 0x010a8c thru 0x016775 (0x5cea bytes) 000710 1782610039.070273 mapwrite 0x0105d3 thru 0x013855 (0x3283 bytes) 000711 1782610039.088743 fallocate 0x007caa thru 0x014942 (0xcc99 bytes) 000712 1782610039.094231 trunc from 0x000a57 to 0x0012e1 (0x88b bytes) 000713 1782610039.099689 read 0x005e55 thru 0x00e12a (0x82d6 bytes) 000714 1782610039.112346 trunc from 0x016776 to 0x0110fc (0x5679 bytes) 000715 1782610039.134283 MIRROR_RESYNC 6 mirrors 000716 1782610040.583636 trunc from 0x0110fd to 0x01ed34 (0xdc38 bytes) 000717 1782610040.654930 fallocate 0x015c17 thru 0x0215b3 (0xb99d bytes) 000718 1782610040.664708 mapread 0x002297 thru 0x00e792 (0xc4fc bytes) 000719 1782610040.689595 fallocate 0x0319cc thru 0x034afd (0x3132 bytes) 000720 1782610040.699871 mapwrite 0x020711 thru 0x029ed3 (0x97c3 bytes) 000721 1782610040.784807 mapread 0x021034 thru 0x029ed3 (0x8ea0 bytes) 000722 1782610040.794051 MIRROR_RESYNC 6 mirrors 000723 1782610042.178792 mapwrite 0x031eca thru 0x0322fd (0x434 bytes) 000724 1782610042.290201 fallocate 0x02e69f thru 0x030c53 (0x25b5 bytes) 000725 1782610042.300214 mapwrite 0x020290 thru 0x02d118 (0xce89 bytes) 000726 1782610042.378953 trunc from 0x00ec5f to 0x011533 (0x28d5 bytes) 000727 1782610042.386218 read 0x01e3c3 thru 0x0289bf (0xa5fd bytes) 000728 1782610042.387730 fallocate 0x02733b thru 0x035fcf (0xec95 bytes) 000729 1782610042.397732 trunc from 0x0322fe to 0x0154ae (0x1ce4f bytes) 000730 1782610042.425944 trunc from 0x00263d to 0x00daf4 (0xb4b8 bytes) 000731 1782610042.433152 write 0x01027b thru 0x01973d (0x94c3 bytes) 000732 1782610042.441293 punch from 0x00cdb5 to 0x00d946 (0xb92 bytes) 000733 1782610042.446170 write 0x03ea3f thru 0x03ffff (0x15c1 bytes) 000735 1782610042.449258 trunc from 0x01b28c to 0x028bb8 (0xd92d bytes) 000736 1782610042.456124 trunc from 0x040000 to 0x026915 (0x196ea bytes) 000737 1782610042.489735 fallocate 0x024fd5 thru 0x030642 (0xb66e bytes) 000739 1782610042.497655 fallocate 0x007a0f thru 0x013ce6 (0xc2d8 bytes) 000740 1782610042.503552 mapread 0x02d86e thru 0x030642 (0x2dd5 bytes) 000742 1782610042.525728 trunc from 0x030643 to 0x01e9d0 (0x11c72 bytes) 000743 1782610042.551748 mapread 0x002b2b thru 0x00ffd6 (0xd4ac bytes) 000744 1782610042.563431 punch from 0x001085 to 0x00f515 (0xe491 bytes) 000746 1782610042.570020 mapread 0x0054b6 thru 0x00788b (0x23d6 bytes) 000748 1782610042.587693 trunc from 0x01e9d1 to 0x023f39 (0x5569 bytes) 000749 1782610042.607454 read 0x005c09 thru 0x00d79f (0x7b97 bytes) 000750 1782610042.615290 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23f3a): Mirror 19: 0xaacabc23 (stale) Mirror 23: 0xaacabc23 (stale) Mirror 24: 0xaacabc23 (stale) Mirror 25: 0xaacabc23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f3a): Mirror 19: 0xaacabc23 (stale) Mirror 23: 0xaacabc23 (stale) Mirror 24: 0xaacabc23 (stale) Mirror 25: 0xaacabc23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f3a: skipped 000751 1782610043.218684 punch from 0x004f63 to 0x0140db (0xf179 bytes) 000752 1782610043.230044 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x23f3a): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f3a): Mirror 19: 0xaacabc23 (stale) Mirror 23: 0xaacabc23 (stale) Mirror 24: 0xaacabc23 (stale) Mirror 25: 0xaacabc23 (stale) CRC-32 checksum value for chunk [0, 0x23f3a): Mirror 1: 0x47d7f0cc Mirror 26: 0x47d7f0cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f3a: skipped 000753 1782610044.231000 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x23f3a): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f3a): Mirror 19: 0xaacabc23 (stale) Mirror 23: 0xaacabc23 (stale) Mirror 24: 0xaacabc23 (stale) Mirror 25: 0xaacabc23 (stale) CRC-32 checksum value for chunk [0, 0x23f3a): Mirror 1: 0x47d7f0cc Mirror 26: 0x47d7f0cc Mirror 27: 0x47d7f0cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f3a: skipped 000754 1782610045.363870 mapwrite 0x0165fb thru 0x025cbc (0xf6c2 bytes) 000755 1782610045.596024 read 0x019bc8 thru 0x02430e (0xa747 bytes) 000757 1782610045.604690 trunc from 0x025cbd to 0x02e1c9 (0x850d bytes) 000758 1782610045.668365 write 0x01e726 thru 0x02326e (0x4b49 bytes) 000759 1782610045.676638 write 0x03b8ef thru 0x03ffff (0x4711 bytes) 000760 1782610045.680423 read 0x02930d thru 0x029c28 (0x91c bytes) 000761 1782610045.708127 write 0x0172ff thru 0x01b95f (0x4661 bytes) 000762 1782610045.710389 write 0x02c185 thru 0x02e43b (0x22b7 bytes) 000763 1782610045.713863 read 0x0178fb thru 0x019c30 (0x2336 bytes) 000764 1782610045.714798 punch from 0x004938 to 0x0058bd (0xf86 bytes) 000765 1782610045.729130 read 0x014461 thru 0x016f76 (0x2b16 bytes) 000767 1782610045.731979 mapread 0x0073c0 thru 0x009a66 (0x26a7 bytes) 000768 1782610045.733252 mapwrite 0x018860 thru 0x01fa78 (0x7219 bytes) 000769 1782610045.766085 write 0x01ecc4 thru 0x024e7c (0x61b9 bytes) 000770 1782610045.767524 read 0x02f463 thru 0x03f152 (0xfcf0 bytes) 000772 1782610045.769750 mapwrite 0x00dff4 thru 0x0181cc (0xa1d9 bytes) 000773 1782610045.802998 write 0x0099d0 thru 0x00ea58 (0x5089 bytes) 000774 1782610045.808248 punch from 0x001411 to 0x003c54 (0x2844 bytes) 000775 1782610045.816071 write 0x02d602 thru 0x03a786 (0xd185 bytes) 000776 1782610045.819019 mapread 0x03d741 thru 0x03ffff (0x28bf bytes) 000777 1782610045.827884 MIRROR_RESYNC 7 mirrors 000778 1782610047.748895 trunc from 0x040000 to 0x004341 (0x3bcbe bytes) 000779 1782610047.805211 mapwrite 0x038638 thru 0x03a30f (0x1cd8 bytes) 000780 1782610047.902010 mapwrite 0x022749 thru 0x02ddd3 (0xb68b bytes) 000781 1782610047.980057 trunc from 0x034f06 to 0x03a30f (0x540a bytes) 000782 1782610048.001884 write 0x0031bf thru 0x00c44c (0x928e bytes) 000783 1782610048.025988 mapwrite 0x0136b6 thru 0x01ae08 (0x7753 bytes) 000784 1782610048.076779 trunc from 0x02ca04 to 0x035a7f (0x907c bytes) 000785 1782610048.097075 mapwrite 0x014816 thru 0x022aa2 (0xe28d bytes) 000787 1782610048.144121 mapwrite 0x019047 thru 0x01a99a (0x1954 bytes) 000788 1782610048.160739 punch from 0x039b74 to 0x03a30f (0x79c bytes) 000790 1782610048.168101 punch from 0x00db1b to 0x018259 (0xa73f bytes) 000791 1782610048.174384 mapwrite 0x01b7dc thru 0x029664 (0xde89 bytes) 000792 1782610048.215765 mapread 0x01558d thru 0x01a629 (0x509d bytes) 000793 1782610048.231443 punch from 0x002b1a to 0x00467d (0x1b64 bytes) 000794 1782610048.239186 punch from 0x003538 to 0x009d7f (0x6848 bytes) 000795 1782610048.253823 mapread 0x00f184 thru 0x0155c9 (0x6446 bytes) 000796 1782610048.271869 MIRROR_RESYNC 7 mirrors 000797 1782610050.160659 trunc from 0x03a310 to 0x010442 (0x29ecd bytes) 000798 1782610050.204752 mapwrite 0x03a3a2 thru 0x03ffff (0x5c5e bytes) 000799 1782610050.277663 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xfb15c1a6 (stale) Mirror 23: 0xfb15c1a6 (stale) Mirror 24: 0xfb15c1a6 (stale) Mirror 26: 0xfb15c1a6 (stale) Mirror 27: 0xfb15c1a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xfb15c1a6 (stale) Mirror 23: 0xfb15c1a6 (stale) Mirror 24: 0xfb15c1a6 (stale) Mirror 26: 0xfb15c1a6 (stale) Mirror 27: 0xfb15c1a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000800 1782610050.906668 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xfb15c1a6 (stale) Mirror 23: 0xfb15c1a6 (stale) Mirror 24: 0xfb15c1a6 (stale) Mirror 26: 0xfb15c1a6 (stale) Mirror 27: 0xfb15c1a6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xde156a96 Mirror 28: 0xde156a96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000801 1782610052.050981 punch from 0x00da8d to 0x0163a2 (0x8916 bytes) 000802 1782610052.116008 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xfb15c1a6 (stale) Mirror 23: 0xfb15c1a6 (stale) Mirror 24: 0xfb15c1a6 (stale) Mirror 26: 0xfb15c1a6 (stale) Mirror 27: 0xfb15c1a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xfb15c1a6 (stale) Mirror 23: 0xfb15c1a6 (stale) Mirror 24: 0xfb15c1a6 (stale) Mirror 26: 0xfb15c1a6 (stale) Mirror 27: 0xfb15c1a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000803 1782610052.825384 mapread 0x01bf96 thru 0x024bd8 (0x8c43 bytes) 000804 1782610052.848296 trunc from 0x01c816 to 0x027c52 (0xb43d bytes) 000805 1782610052.853682 write 0x02fe6b thru 0x033298 (0x342e bytes) 000806 1782610052.884861 mapread 0x0251d7 thru 0x02a7c7 (0x55f1 bytes) 000808 1782610052.914915 mapread 0x033ed9 thru 0x036dfd (0x2f25 bytes) 000809 1782610052.938984 fallocate 0x00b0ca thru 0x00b376 (0x2ad bytes) 000810 1782610052.958218 mapread 0x02d750 thru 0x039b72 (0xc423 bytes) 000811 1782610052.962243 write 0x02c3df thru 0x03676f (0xa391 bytes) 000812 1782610052.965420 mapwrite 0x0255c2 thru 0x030991 (0xb3d0 bytes) 000813 1782610052.993855 trunc from 0x040000 to 0x015cfd (0x2a302 bytes) 000814 1782610053.016639 trunc from 0x003b77 to 0x009243 (0x56cd bytes) 000816 1782610053.027280 trunc from 0x003917 to 0x00cdc9 (0x94b3 bytes) 000817 1782610053.037030 trunc from 0x015cfe to 0x013399 (0x2964 bytes) 000818 1782610053.064534 read 0x00ea74 thru 0x00f94b (0xed8 bytes) 000820 1782610053.078899 trunc from 0x009320 to 0x009e61 (0xb42 bytes) 000822 1782610053.092696 punch from 0x008a2b to 0x013399 (0xa96f bytes) 000823 1782610053.104238 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1339a): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1339a): Mirror 19: 0x2a2001a8 (stale) Mirror 23: 0x2a2001a8 (stale) Mirror 24: 0x2a2001a8 (stale) Mirror 26: 0x2a2001a8 (stale) Mirror 27: 0x2a2001a8 (stale) CRC-32 checksum value for chunk [0, 0x1339a): Mirror 1: 0xb59fea26 Mirror 28: 0xb59fea26 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1339a: skipped 000824 1782610054.018091 trunc from 0x01339a to 0x012ec8 (0x4d1 bytes) 000825 1782610054.125174 punch from 0x003524 to 0x00facd (0xc5aa bytes) 000826 1782610054.139161 MIRROR_RESYNC 7 mirrors 000828 1782610055.735706 punch from 0x00d4e0 to 0x012ec8 (0x59e9 bytes) 000829 1782610055.781711 write 0x032eaa thru 0x03ffff (0xd156 bytes) 000830 1782610055.784182 punch from 0x008b6e to 0x0108bf (0x7d52 bytes) 000831 1782610055.789283 punch from 0x0259f0 to 0x02a1c9 (0x47da bytes) 000832 1782610055.793806 mapwrite 0x02d2fc thru 0x0388aa (0xb5af bytes) 000833 1782610055.834829 punch from 0x01eecb to 0x025b27 (0x6c5d bytes) 000834 1782610055.839281 trunc from 0x040000 to 0x01f7da (0x20825 bytes) 000836 1782610055.860096 read 0x001d38 thru 0x002aab (0xd74 bytes) 000837 1782610055.866206 trunc from 0x01abd9 to 0x01b070 (0x498 bytes) 000839 1782610055.872651 mapwrite 0x00b50c thru 0x00c584 (0x1079 bytes) 000840 1782610055.903922 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1f7db): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f7db): Mirror 19: 0x884ee0de (stale) Mirror 23: 0x884ee0de (stale) Mirror 24: 0x884ee0de (stale) Mirror 26: 0x884ee0de (stale) Mirror 27: 0x884ee0de (stale) Mirror 28: 0x884ee0de (stale) CRC-32 checksum value for chunk [0, 0x1f7db): Mirror 1: 0x6a839ca5 Mirror 29: 0x6a839ca5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f7db: skipped 000841 1782610057.206270 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1f7db): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f7db): Mirror 19: 0x884ee0de (stale) Mirror 23: 0x884ee0de (stale) Mirror 24: 0x884ee0de (stale) Mirror 26: 0x884ee0de (stale) Mirror 27: 0x884ee0de (stale) Mirror 28: 0x884ee0de (stale) CRC-32 checksum value for chunk [0, 0x1f7db): Mirror 1: 0x6a839ca5 Mirror 29: 0x6a839ca5 Mirror 30: 0x6a839ca5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f7db: skipped 000843 1782610058.725535 punch from 0x00b725 to 0x012c7b (0x7557 bytes) 000844 1782610058.773857 mapread 0x00b0ea thru 0x00e5b5 (0x34cc bytes) 000845 1782610058.805016 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f7db): Mirror 19: 0x884ee0de (stale) Mirror 23: 0x884ee0de (stale) Mirror 24: 0x884ee0de (stale) Mirror 27: 0x884ee0de (stale) Mirror 28: 0x884ee0de (stale) Mirror 29: 0x6a839ca5 (stale) Mirror 30: 0x6a839ca5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f7db): Mirror 19: 0x884ee0de (stale) Mirror 23: 0x884ee0de (stale) Mirror 24: 0x884ee0de (stale) Mirror 27: 0x884ee0de (stale) Mirror 28: 0x884ee0de (stale) Mirror 29: 0x6a839ca5 (stale) Mirror 30: 0x6a839ca5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f7db: skipped 000846 1782610059.382019 trunc from 0x00eabc to 0x015be9 (0x712e bytes) 000847 1782610059.389094 mapwrite 0x02da6a thru 0x0391b5 (0xb74c bytes) 000848 1782610059.467119 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x391b6): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x391b6): Mirror 19: 0x907769c5 (stale) Mirror 23: 0x907769c5 (stale) Mirror 24: 0x907769c5 (stale) Mirror 27: 0x907769c5 (stale) Mirror 28: 0x907769c5 (stale) Mirror 29: 0x1baa98a7 (stale) Mirror 30: 0x1baa98a7 (stale) CRC-32 checksum value for chunk [0, 0x391b6): Mirror 1: 0x9010012b Mirror 31: 0x9010012b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x391b6: skipped 000850 1782610061.065834 mapwrite 0x03bb46 thru 0x03ffff (0x44ba bytes) 000851 1782610061.196585 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0xe20eea22 (stale) Mirror 27: 0xe20eea22 (stale) Mirror 28: 0xe20eea22 (stale) Mirror 29: 0x4d177132 (stale) Mirror 30: 0x4d177132 (stale) Mirror 31: 0x7f9cab0f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc4c58d1e Mirror 32: 0xc4c58d1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000852 1782610062.337561 write 0x00a6a4 thru 0x00caea (0x2447 bytes) 000853 1782610062.389636 trunc from 0x040000 to 0x021634 (0x1e9cb bytes) 000854 1782610062.429912 write 0x003252 thru 0x005d3f (0x2aee bytes) 000855 1782610062.446928 fallocate 0x02a756 thru 0x034c02 (0xa4ad bytes) 000856 1782610062.465470 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x21635): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21635): Mirror 19: 0x25c3c85f (stale) Mirror 23: 0x25c3c85f (stale) Mirror 24: 0x25c3c85f (stale) Mirror 27: 0x25c3c85f (stale) Mirror 28: 0x25c3c85f (stale) Mirror 29: 0x69f470af (stale) Mirror 30: 0x69f470af (stale) Mirror 31: 0x4cc06990 (stale) Mirror 32: 0x4cc06990 (stale) CRC-32 checksum value for chunk [0, 0x21635): Mirror 1: 0x4acdd25f Mirror 33: 0x4acdd25f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21635: skipped 000857 1782610063.736622 write 0x030ee7 thru 0x03ca66 (0xbb80 bytes) 000858 1782610063.790533 trunc from 0x03ca67 to 0x037e33 (0x4c33 bytes) 000859 1782610063.810746 fallocate 0x00f7f1 thru 0x016da3 (0x75b3 bytes) 000861 1782610063.818173 write 0x013a8e thru 0x018e25 (0x5398 bytes) 000862 1782610063.829235 trunc from 0x037e34 to 0x002121 (0x35d12 bytes) 000863 1782610063.848348 trunc from 0x002122 to 0x02145d (0x1f33c bytes) 000864 1782610063.861917 read 0x001d99 thru 0x00f8fe (0xdb66 bytes) 000865 1782610063.878909 fallocate 0x001dd1 thru 0x00f4f9 (0xd729 bytes) 000866 1782610063.883781 trunc from 0x020f62 to 0x02145d (0x4fc bytes) 000867 1782610063.896880 fallocate 0x032794 thru 0x0361c3 (0x3a30 bytes) 000868 1782610063.903642 trunc from 0x02145e to 0x0194be (0x7f9f bytes) 000869 1782610063.920539 mapread 0x010dc2 thru 0x013f28 (0x3167 bytes) 000870 1782610063.952966 MIRROR_RESYNC 11 mirrors 000871 1782610065.583529 mapread 0x004b35 thru 0x00bcd0 (0x719c bytes) 000872 1782610065.607086 MIRROR_EXTEND to 12 mirrors 000873 1782610066.700043 mapread 0x000351 thru 0x00bc3a (0xb8ea bytes) 000874 1782610066.728884 trunc from 0x0194bf to 0x025719 (0xc25b bytes) 000876 1782610066.857680 write 0x00b8d9 thru 0x01851f (0xcc47 bytes) 000877 1782610066.894020 mapread 0x01c6d7 thru 0x025719 (0x9043 bytes) 000878 1782610066.924828 write 0x00521e thru 0x009a44 (0x4827 bytes) 000879 1782610066.933122 mapread 0x021ead thru 0x024a77 (0x2bcb bytes) 000880 1782610066.935120 punch from 0x022f7a to 0x025719 (0x27a0 bytes) 000881 1782610066.940068 write 0x00cf85 thru 0x00d262 (0x2de bytes) 000882 1782610066.941389 mapwrite 0x035f0a thru 0x03c5a7 (0x669e bytes) 000883 1782610066.997949 mapwrite 0x0112eb thru 0x01f8cf (0xe5e5 bytes) 000884 1782610067.020233 read 0x036094 thru 0x03ae94 (0x4e01 bytes) 000885 1782610067.024515 MIRROR_RESYNC 12 mirrors 000887 1782610070.891086 fallocate 0x034f77 thru 0x03f69e (0xa728 bytes) 000888 1782610070.932028 mapwrite 0x01379f thru 0x01cfc8 (0x982a bytes) 000889 1782610070.968536 mapwrite 0x01117e thru 0x011c95 (0xb18 bytes) 000890 1782610070.980445 read 0x032833 thru 0x03c5a7 (0x9d75 bytes) 000891 1782610070.989424 read 0x009d9e thru 0x01510b (0xb36e bytes) 000892 1782610071.000630 read 0x02bba1 thru 0x030776 (0x4bd6 bytes) 000893 1782610071.005657 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c5a8): Mirror 19: 0xe2d08dc1 (stale) Mirror 23: 0xe2d08dc1 (stale) Mirror 24: 0xe2d08dc1 (stale) Mirror 28: 0xe2d08dc1 (stale) Mirror 29: 0xe2d08dc1 (stale) Mirror 30: 0xe2d08dc1 (stale) Mirror 31: 0xe2d08dc1 (stale) Mirror 32: 0xe2d08dc1 (stale) Mirror 33: 0xe2d08dc1 (stale) Mirror 34: 0xe2d08dc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c5a8): Mirror 19: 0xe2d08dc1 (stale) Mirror 23: 0xe2d08dc1 (stale) Mirror 24: 0xe2d08dc1 (stale) Mirror 28: 0xe2d08dc1 (stale) Mirror 29: 0xe2d08dc1 (stale) Mirror 30: 0xe2d08dc1 (stale) Mirror 31: 0xe2d08dc1 (stale) Mirror 32: 0xe2d08dc1 (stale) Mirror 33: 0xe2d08dc1 (stale) Mirror 34: 0xe2d08dc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c5a8: skipped 000894 1782610071.655703 write 0x001179 thru 0x007c35 (0x6abd bytes) 000895 1782610071.671814 read 0x036b60 thru 0x03a75c (0x3bfd bytes) 000896 1782610071.679803 fallocate 0x02124e thru 0x02d7c0 (0xc573 bytes) 000897 1782610071.684955 fallocate 0x037822 thru 0x03ffff (0x87de bytes) 000898 1782610071.690058 trunc from 0x03c5a8 to 0x01092c (0x2bc7b bytes) 000899 1782610071.707527 mapwrite 0x00c144 thru 0x011865 (0x5722 bytes) 000900 1782610071.760076 mapwrite 0x03aff7 thru 0x03ffff (0x5009 bytes) 000901 1782610071.800602 fallocate 0x030b0d thru 0x03d0b8 (0xc5ac bytes) 000902 1782610071.809733 fallocate 0x02c209 thru 0x03a8d6 (0xe6ce bytes) 000903 1782610071.814952 trunc from 0x03ca01 to 0x03ffff (0x35ff bytes) 000905 1782610071.824812 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x83742dc4 (stale) Mirror 23: 0x83742dc4 (stale) Mirror 24: 0x83742dc4 (stale) Mirror 28: 0x83742dc4 (stale) Mirror 29: 0x83742dc4 (stale) Mirror 30: 0x83742dc4 (stale) Mirror 31: 0x83742dc4 (stale) Mirror 32: 0x83742dc4 (stale) Mirror 33: 0x83742dc4 (stale) Mirror 34: 0x83742dc4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b2df49 Mirror 35: 0x9b2df49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000906 1782610073.207650 fallocate 0x00f250 thru 0x0194d8 (0xa289 bytes) 000907 1782610073.277082 read 0x0294ac thru 0x034d45 (0xb89a bytes) 000908 1782610073.297428 mapwrite 0x02707a thru 0x032dbe (0xbd45 bytes) 000909 1782610073.349063 fallocate 0x03e021 thru 0x03ffff (0x1fdf bytes) 000910 1782610073.375028 write 0x00db66 thru 0x016a75 (0x8f10 bytes) 000911 1782610073.441993 read 0x015dc1 thru 0x01f27f (0x94bf bytes) 000912 1782610073.476417 MIRROR_RESYNC 12 mirrors 000913 1782610077.643094 mapread 0x02172f thru 0x0232bd (0x1b8f bytes) 000914 1782610077.678219 punch from 0x01460b to 0x01a7a4 (0x619a bytes) 000915 1782610077.743505 trunc from 0x03ab2e to 0x03ffff (0x54d2 bytes) 000916 1782610077.749106 read 0x0200b5 thru 0x0274ca (0x7416 bytes) 000917 1782610077.764779 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x37b6cc4e (stale) Mirror 24: 0x37b6cc4e (stale) Mirror 28: 0x37b6cc4e (stale) Mirror 29: 0x37b6cc4e (stale) Mirror 30: 0x37b6cc4e (stale) Mirror 31: 0x37b6cc4e (stale) Mirror 32: 0x37b6cc4e (stale) Mirror 33: 0x37b6cc4e (stale) Mirror 34: 0x37b6cc4e (stale) Mirror 35: 0x37b6cc4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x37b6cc4e (stale) Mirror 24: 0x37b6cc4e (stale) Mirror 28: 0x37b6cc4e (stale) Mirror 29: 0x37b6cc4e (stale) Mirror 30: 0x37b6cc4e (stale) Mirror 31: 0x37b6cc4e (stale) Mirror 32: 0x37b6cc4e (stale) Mirror 33: 0x37b6cc4e (stale) Mirror 34: 0x37b6cc4e (stale) Mirror 35: 0x37b6cc4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000918 1782610078.415369 fallocate 0x0208f8 thru 0x025972 (0x507b bytes) 000919 1782610078.420947 trunc from 0x040000 to 0x0359db (0xa624 bytes) 000920 1782610078.440747 read 0x034a02 thru 0x0359db (0xfda bytes) 000921 1782610078.447728 mapwrite 0x034230 thru 0x03915a (0x4f2b bytes) 000923 1782610078.517553 trunc from 0x00f169 to 0x0171e1 (0x8079 bytes) 000924 1782610078.525028 fallocate 0x000fa7 thru 0x00805f (0x70b9 bytes) 000925 1782610078.530986 fallocate 0x0181d5 thru 0x01b901 (0x372d bytes) 000926 1782610078.546822 punch from 0x003309 to 0x005a71 (0x2769 bytes) 000927 1782610078.560056 mapwrite 0x03fd34 thru 0x03ffff (0x2cc bytes) 000928 1782610078.624703 write 0x00a6d9 thru 0x00be49 (0x1771 bytes) 000929 1782610078.653784 MIRROR_RESYNC 11 mirrors 000930 1782610082.214072 mapwrite 0x012e4a thru 0x0153c2 (0x2579 bytes) 000931 1782610082.386971 punch from 0x03460d to 0x03b2ea (0x6cde bytes) 000932 1782610082.401783 read 0x012ec3 thru 0x01e1a3 (0xb2e1 bytes) 000933 1782610082.434595 MIRROR_RESYNC 11 mirrors 000934 1782610087.274990 mapread 0x03e5b9 thru 0x03ffff (0x1a47 bytes) 000935 1782610087.285399 punch from 0x009022 to 0x012a30 (0x9a0f bytes) 000936 1782610087.331368 write 0x0339d5 thru 0x03ffff (0xc62b bytes) 000937 1782610087.343431 fallocate 0x00b3c8 thru 0x018065 (0xcc9e bytes) 000938 1782610087.350007 fallocate 0x015596 thru 0x01899f (0x340a bytes) 000939 1782610087.355085 trunc from 0x03e0cf to 0x03ffff (0x1f31 bytes) 000940 1782610087.374386 mapread 0x020e99 thru 0x026375 (0x54dd bytes) 000941 1782610087.390401 mapread 0x02f046 thru 0x02fecd (0xe88 bytes) 000942 1782610087.399102 trunc from 0x0008b6 to 0x00c780 (0xbecb bytes) 000943 1782610087.404482 write 0x03f492 thru 0x03ffff (0xb6e bytes) 000944 1782610087.410613 trunc from 0x02a5cd to 0x039c38 (0xf66c bytes) 000945 1782610087.427537 MIRROR_RESYNC 11 mirrors 000946 1782610090.518974 trunc from 0x040000 to 0x003b34 (0x3c4cb bytes) 000947 1782610090.569978 write 0x00d936 thru 0x01284d (0x4f18 bytes) 000948 1782610090.575617 MIRROR_RESYNC 11 mirrors 000949 1782610092.370842 mapwrite 0x01260f thru 0x017a82 (0x5474 bytes) 000950 1782610092.518852 trunc from 0x002a4d to 0x00bf3f (0x94f3 bytes) 000952 1782610092.528396 punch from 0x017953 to 0x017a82 (0x130 bytes) 000953 1782610092.536702 trunc from 0x017a83 to 0x017312 (0x770 bytes) 000955 1782610092.558374 trunc from 0x017313 to 0x034d11 (0x1d9ff bytes) 000956 1782610092.581930 punch from 0x00563a to 0x009132 (0x3af9 bytes) 000957 1782610092.596635 write 0x02e49a thru 0x03a70b (0xc272 bytes) 000958 1782610092.612126 trunc from 0x02c63c to 0x02ec0e (0x25d3 bytes) 000959 1782610092.631481 punch from 0x03a0a0 to 0x03a70b (0x66c bytes) 000960 1782610092.647299 MIRROR_RESYNC 11 mirrors 000961 1782610095.814367 write 0x016311 thru 0x01a221 (0x3f11 bytes) 000962 1782610095.870299 MIRROR_RESYNC 11 mirrors 000963 1782610098.614711 punch from 0x017ea1 to 0x0216f5 (0x9855 bytes) 000964 1782610098.650963 mapread 0x0086ea thru 0x00f8ce (0x71e5 bytes) 000965 1782610098.687369 fallocate 0x00b483 thru 0x00f7b2 (0x4330 bytes) 000966 1782610098.696584 fallocate 0x030f34 thru 0x03d822 (0xc8ef bytes) 000967 1782610098.703458 trunc from 0x03a70c to 0x038f07 (0x1804 bytes) 000968 1782610098.753943 fallocate 0x03f7d2 thru 0x03ffff (0x82e bytes) 000970 1782610098.767270 mapread 0x00a021 thru 0x015636 (0xb616 bytes) 000971 1782610098.792086 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x68f922f3 (stale) Mirror 24: 0x68f922f3 (stale) Mirror 28: 0x68f922f3 (stale) Mirror 29: 0x68f922f3 (stale) Mirror 30: 0x68f922f3 (stale) Mirror 31: 0x68f922f3 (stale) Mirror 32: 0x68f922f3 (stale) Mirror 33: 0x68f922f3 (stale) Mirror 34: 0x68f922f3 (stale) Mirror 35: 0x68f922f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2c232c3 Mirror 36: 0x2c232c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000972 1782610100.005513 write 0x0341b0 thru 0x0385bf (0x4410 bytes) 000973 1782610100.094632 mapwrite 0x009d5e thru 0x016e14 (0xd0b7 bytes) 000974 1782610100.152532 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x2c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x68f922f3 (stale) Mirror 28: 0x68f922f3 (stale) Mirror 29: 0x68f922f3 (stale) Mirror 30: 0x68f922f3 (stale) Mirror 31: 0x68f922f3 (stale) Mirror 32: 0x68f922f3 (stale) Mirror 33: 0x68f922f3 (stale) Mirror 34: 0x68f922f3 (stale) Mirror 35: 0x68f922f3 (stale) Mirror 36: 0x2c232c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x68f922f3 (stale) Mirror 28: 0x68f922f3 (stale) Mirror 29: 0x68f922f3 (stale) Mirror 30: 0x68f922f3 (stale) Mirror 31: 0x68f922f3 (stale) Mirror 32: 0x68f922f3 (stale) Mirror 33: 0x68f922f3 (stale) Mirror 34: 0x68f922f3 (stale) Mirror 35: 0x68f922f3 (stale) Mirror 36: 0x2c232c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000975 1782610100.990947 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x68f922f3 (stale) Mirror 28: 0x68f922f3 (stale) Mirror 29: 0x68f922f3 (stale) Mirror 30: 0x68f922f3 (stale) Mirror 31: 0x68f922f3 (stale) Mirror 32: 0x68f922f3 (stale) Mirror 33: 0x68f922f3 (stale) Mirror 34: 0x68f922f3 (stale) Mirror 35: 0x68f922f3 (stale) Mirror 36: 0x2c232c3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdb6039fd Mirror 37: 0xdb6039fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000976 1782610102.433127 trunc from 0x040000 to 0x015887 (0x2a778 bytes) 000977 1782610102.491561 punch from 0x001ac9 to 0x0084e0 (0x6a18 bytes) 000978 1782610102.497189 write 0x02108f thru 0x0257f9 (0x476b bytes) 000979 1782610102.498912 trunc from 0x0257fa to 0x011d77 (0x13a82 bytes) 000980 1782610102.525670 trunc from 0x011d78 to 0x010c84 (0x10f3 bytes) 000981 1782610102.552463 trunc from 0x00c04b to 0x010c84 (0x4c3a bytes) 000982 1782610102.564771 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x10c85): Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10c85): Mirror 24: 0x9ca69398 (stale) Mirror 28: 0x9ca69398 (stale) Mirror 29: 0x9ca69398 (stale) Mirror 30: 0x9ca69398 (stale) Mirror 31: 0x9ca69398 (stale) Mirror 32: 0x9ca69398 (stale) Mirror 33: 0x9ca69398 (stale) Mirror 34: 0x9ca69398 (stale) Mirror 35: 0x9ca69398 (stale) Mirror 36: 0x9ca69398 (stale) Mirror 37: 0x736e943b (stale) CRC-32 checksum value for chunk [0, 0x10c85): Mirror 1: 0xee73c5a6 Mirror 38: 0xee73c5a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10c85: skipped 000983 1782610103.848012 mapwrite 0x02ad52 thru 0x034077 (0x9326 bytes) 000984 1782610104.053225 read 0x02a1d9 thru 0x034077 (0x9e9f bytes) 000987 1782610104.057269 write 0x027eeb thru 0x029c00 (0x1d16 bytes) 000988 1782610104.063712 write 0x001434 thru 0x00e115 (0xcce2 bytes) 000989 1782610104.094186 mapread 0x021f7f thru 0x02330c (0x138e bytes) 000990 1782610104.131764 mapread 0x02dc4b thru 0x034077 (0x642d bytes) 000991 1782610104.132969 trunc from 0x034078 to 0x038342 (0x42cb bytes) 000992 1782610104.164954 fallocate 0x01196a thru 0x016050 (0x46e7 bytes) 000993 1782610104.182710 punch from 0x00ac06 to 0x0198d3 (0xecce bytes) 000994 1782610104.258829 write 0x010c92 thru 0x01fbb0 (0xef1f bytes) 000995 1782610104.273697 fallocate 0x02f5f3 thru 0x0318c5 (0x22d3 bytes) 000996 1782610104.278560 mapread 0x02e571 thru 0x038342 (0x9dd2 bytes) 000997 1782610104.305955 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x38343): Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38343): Mirror 24: 0x56ca9f74 (stale) Mirror 28: 0x56ca9f74 (stale) Mirror 29: 0x56ca9f74 (stale) Mirror 30: 0x56ca9f74 (stale) Mirror 31: 0x56ca9f74 (stale) Mirror 32: 0x56ca9f74 (stale) Mirror 33: 0x56ca9f74 (stale) Mirror 34: 0x56ca9f74 (stale) Mirror 35: 0x56ca9f74 (stale) Mirror 36: 0x9b182905 (stale) Mirror 37: 0xb877d039 (stale) Mirror 38: 0x830a8265 (stale) CRC-32 checksum value for chunk [0, 0x38343): Mirror 1: 0x63d71978 Mirror 39: 0x63d71978 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38343: skipped 000998 1782610105.812161 mapread 0x018736 thru 0x027923 (0xf1ee bytes) 001000 1782610105.922737 trunc from 0x038343 to 0x0176e7 (0x20c5b bytes) All operations completed A-OK!