== sanity-flr test 70a: flr mode fsx test ================ 18:44:30 (1781217870) Seed set to 7872 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003 1781217873.158819 mapwrite 0x00c824 thru 0x0133cd (0x6baa bytes) 000004 1781217873.444099 mapread 0x0035b8 thru 0x00d59e (0x9fe7 bytes) 000005 1781217873.489634 write 0x02ecd1 thru 0x036b3a (0x7e6a bytes) 000008 1781217873.512215 mapread 0x02cc6b thru 0x036b3a (0x9ed0 bytes) truncating to largest ever: 0x338e7 000010 1781217873.536132 trunc from 0x036b3b to 0x0338e6 (0x3254 bytes) 000011 1781217873.570521 write 0x00fe17 thru 0x01ad17 (0xaf01 bytes) 000013 1781217873.598367 mapwrite 0x025282 thru 0x029c9a (0x4a19 bytes) 000015 1781217873.902102 write 0x0241bd thru 0x02fcd9 (0xbb1d bytes) 000017 1781217873.965417 MIRROR_EXTEND to 2 mirrors 000018 1781217875.289796 trunc from 0x0338e7 to 0x00c720 (0x271c6 bytes) 000020 1781217875.528318 MIRROR_RESYNC 2 mirrors 000021 1781217876.801979 mapread 0x003a79 thru 0x00c720 (0x8ca8 bytes) 000022 1781217876.851457 MIRROR_RESYNC 2 mirrors 000024 1781217877.144086 mapread 0x00c410 thru 0x00c720 (0x311 bytes) 000025 1781217877.156029 MIRROR_RESYNC 2 mirrors 000027 1781217877.525889 write 0x03d38f thru 0x03ffff (0x2c71 bytes) 000028 1781217877.646919 mapread 0x005152 thru 0x005d48 (0xbf7 bytes) 000029 1781217877.675113 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb2ab0f59 Mirror 3: 0xb2ab0f59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000031 1781217878.860285 mapwrite 0x0083ab thru 0x011994 (0x95ea bytes) 000032 1781217879.059511 MIRROR_RESYNC 3 mirrors 000034 1781217880.175789 mapwrite 0x01c657 thru 0x020493 (0x3e3d bytes) 000035 1781217880.328940 MIRROR_RESYNC 3 mirrors 000037 1781217881.604976 read 0x0124f5 thru 0x01d9e2 (0xb4ee bytes) 000039 1781217881.620370 mapwrite 0x011bd8 thru 0x01236a (0x793 bytes) 000040 1781217881.825503 mapwrite 0x03ff3b thru 0x03ffff (0xc5 bytes) 000042 1781217881.962436 mapwrite 0x00a531 thru 0x011230 (0x6d00 bytes) 000043 1781217882.121493 mapwrite 0x033ee4 thru 0x0357c5 (0x18e2 bytes) 000045 1781217882.362528 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb104486f (stale) Mirror 3: 0xb104486f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2ff9fa42 Mirror 4: 0x2ff9fa42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000046 1781217884.193140 mapread 0x02075f thru 0x0300a6 (0xf948 bytes) 000048 1781217884.276308 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb104486f (stale) Mirror 3: 0xb104486f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2ff9fa42 Mirror 4: 0x2ff9fa42 Mirror 5: 0x2ff9fa42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000049 1781217885.793946 mapread 0x03addf thru 0x03ffff (0x5221 bytes) 000051 1781217885.833624 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb104486f (stale) Mirror 3: 0xb104486f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb104486f (stale) Mirror 3: 0xb104486f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2ff9fa42 Mirror 4: 0x2ff9fa42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000054 1781217886.811075 write 0x018d8a thru 0x01908e (0x305 bytes) 000055 1781217886.952783 write 0x00e297 thru 0x01a391 (0xc0fb bytes) 000058 1781217886.987178 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb104486f (stale) Mirror 4: 0x2ff9fa42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb104486f (stale) Mirror 4: 0x2ff9fa42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000062 1781217887.641480 mapwrite 0x0258df thru 0x031f39 (0xc65b bytes) 000063 1781217887.763689 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2ff9fa42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2ff9fa42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000066 1781217888.141676 mapwrite 0x034b3a thru 0x03fd08 (0xb1cf bytes) 000073 1781217888.299744 write 0x030286 thru 0x0384b1 (0x822c bytes) 000074 1781217888.305382 mapwrite 0x00c82d thru 0x010140 (0x3914 bytes) 000076 1781217888.385710 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2ff9fa42 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x50ca94e Mirror 5: 0x50ca94e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000078 1781217890.128810 read 0x00c27c thru 0x014362 (0x80e7 bytes) 000079 1781217890.142065 mapwrite 0x01296e thru 0x01739e (0x4a31 bytes) 000080 1781217890.544448 mapwrite 0x0090b0 thru 0x018ac0 (0xfa11 bytes) 000081 1781217890.620295 mapread 0x03ac1e thru 0x03ffff (0x53e2 bytes) 000082 1781217890.639695 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2ff9fa42 (stale) Mirror 5: 0x50ca94e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa46d0675 Mirror 6: 0xa46d0675 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000083 1781217891.786904 trunc from 0x040000 to 0x014ea7 (0x2b158 bytes) 000084 1781217891.952596 mapwrite 0x00a4fe thru 0x00df4a (0x3a4d bytes) 000085 1781217892.087193 mapwrite 0x03635c thru 0x03d5b7 (0x725c bytes) 000086 1781217892.199208 read 0x028c32 thru 0x031273 (0x8642 bytes) 000087 1781217892.212333 trunc from 0x03d5b8 to 0x032a71 (0xab46 bytes) 000088 1781217892.246769 mapwrite 0x035293 thru 0x03ffff (0xad6d bytes) 000093 1781217892.423140 trunc from 0x040000 to 0x017c5e (0x283a1 bytes) 000099 1781217892.448841 trunc from 0x017c5f to 0x009e15 (0xde49 bytes) 000101 1781217892.473161 mapread 0x001791 thru 0x003ac0 (0x2330 bytes) 000102 1781217892.483367 read 0x002446 thru 0x007dd7 (0x5992 bytes) 000103 1781217892.490119 MIRROR_RESYNC 4 mirrors 000108 1781217893.633661 trunc from 0x009e16 to 0x021f53 (0x1813e bytes) 000110 1781217893.757802 trunc from 0x021f54 to 0x00ed19 (0x1323a bytes) 000112 1781217893.803384 read 0x00be4c thru 0x00ed19 (0x2ece bytes) 000114 1781217893.816192 mapread 0x00d32f thru 0x00ed19 (0x19eb bytes) 000115 1781217893.817396 read 0x001202 thru 0x003b60 (0x295f bytes) 000116 1781217893.841517 mapread 0x00c071 thru 0x00ed19 (0x2ca9 bytes) 000117 1781217893.857428 MIRROR_RESYNC 4 mirrors 000118 1781217895.186368 mapwrite 0x036036 thru 0x03ffff (0x9fca bytes) 000119 1781217895.659997 read 0x02c668 thru 0x02cff7 (0x990 bytes) 000121 1781217895.669318 mapwrite 0x0309c5 thru 0x03642d (0x5a69 bytes) 000123 1781217895.788935 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe5872ea5 (stale) Mirror 5: 0xe5872ea5 (stale) Mirror 6: 0xe5872ea5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6057631f Mirror 7: 0x6057631f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000126 1781217897.180024 read 0x020713 thru 0x02a20e (0x9afc bytes) 000127 1781217897.201406 write 0x029c3a thru 0x02cf43 (0x330a bytes) 000128 1781217897.373149 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe5872ea5 (stale) Mirror 5: 0xe5872ea5 (stale) Mirror 6: 0xe5872ea5 (stale) Mirror 7: 0x6057631f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x55fa8613 Mirror 8: 0x55fa8613 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000130 1781217898.965052 mapread 0x035726 thru 0x0362b9 (0xb94 bytes) 000132 1781217898.984146 mapwrite 0x03e707 thru 0x03ffff (0x18f9 bytes) truncating to largest ever: 0x3f5c4 000135 1781217899.209593 trunc from 0x040000 to 0x03f5c3 (0xa3c bytes) 000140 1781217899.268826 MIRROR_RESYNC 6 mirrors 000141 1781217900.729346 write 0x00bd12 thru 0x014631 (0x8920 bytes) 000142 1781217900.874654 mapwrite 0x009d2d thru 0x014654 (0xa928 bytes) 000143 1781217901.108805 trunc from 0x03f5c4 to 0x03e76c (0xe57 bytes) 000145 1781217901.202681 MIRROR_RESYNC 6 mirrors 000147 1781217902.818842 mapwrite 0x00524c thru 0x00db9e (0x8953 bytes) 000148 1781217903.094016 read 0x02b4fd thru 0x03a83d (0xf341 bytes) 000150 1781217903.106666 read 0x000d3e thru 0x00945f (0x8722 bytes) 000152 1781217903.123508 trunc from 0x03e76d to 0x02b593 (0x131d9 bytes) 000154 1781217903.162957 write 0x03be4b thru 0x03ffff (0x41b5 bytes) 000158 1781217903.173351 mapwrite 0x03b891 thru 0x03ffff (0x476f bytes) 000160 1781217903.261714 mapread 0x011a4f thru 0x011e8b (0x43d bytes) 000161 1781217903.266754 mapread 0x0336d6 thru 0x03dd65 (0xa690 bytes) 000162 1781217903.317404 mapread 0x005320 thru 0x0102b3 (0xaf94 bytes) 000168 1781217903.328930 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1eabb164 (stale) Mirror 5: 0x1eabb164 (stale) Mirror 6: 0x1eabb164 (stale) Mirror 7: 0x1eabb164 (stale) Mirror 8: 0x1eabb164 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8d7c7e24 Mirror 9: 0x8d7c7e24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000169 1781217904.258691 write 0x031da0 thru 0x0354a7 (0x3708 bytes) 000171 1781217904.365384 trunc from 0x040000 to 0x021b58 (0x1e4a7 bytes) 000172 1781217904.414803 mapwrite 0x01a236 thru 0x0214ab (0x7276 bytes) 000173 1781217904.502719 trunc from 0x021b59 to 0x0203cd (0x178b bytes) 000175 1781217904.525994 mapwrite 0x01780e thru 0x026023 (0xe816 bytes) 000177 1781217904.643242 trunc from 0x026024 to 0x031514 (0xb4f1 bytes) 000179 1781217904.667586 write 0x028de0 thru 0x036706 (0xd927 bytes) 000180 1781217904.691387 mapwrite 0x018ac6 thru 0x021f60 (0x949b bytes) 000183 1781217904.843266 mapread 0x00f989 thru 0x01b0c1 (0xb739 bytes) 000184 1781217904.883808 mapwrite 0x03e116 thru 0x03ffff (0x1eea bytes) 000185 1781217905.082075 write 0x034729 thru 0x03efdb (0xa8b3 bytes) 000186 1781217905.085276 write 0x01d037 thru 0x01ff8f (0x2f59 bytes) 000187 1781217905.108077 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1eabb164 (stale) Mirror 6: 0x1eabb164 (stale) Mirror 7: 0x1eabb164 (stale) Mirror 8: 0x1eabb164 (stale) Mirror 9: 0x8d7c7e24 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1eabb164 (stale) Mirror 6: 0x1eabb164 (stale) Mirror 7: 0x1eabb164 (stale) Mirror 8: 0x1eabb164 (stale) Mirror 9: 0x8d7c7e24 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000189 1781217905.957206 trunc from 0x040000 to 0x036de0 (0x921f bytes) 000190 1781217905.988522 write 0x038ee6 thru 0x03ffff (0x711a bytes) 000192 1781217906.011233 read 0x01a9a2 thru 0x01f6b9 (0x4d18 bytes) 000193 1781217906.028194 write 0x0018bd thru 0x00b365 (0x9aa9 bytes) 000194 1781217906.044365 read 0x001955 thru 0x0078d8 (0x5f84 bytes) 000196 1781217906.047581 mapwrite 0x014380 thru 0x01cb47 (0x87c8 bytes) 000198 1781217906.150912 read 0x02498d thru 0x02ef7f (0xa5f3 bytes) 000199 1781217906.152655 mapwrite 0x034277 thru 0x03a300 (0x608a bytes) 000200 1781217906.228844 write 0x023e2d thru 0x031107 (0xd2db bytes) 000204 1781217906.236162 mapwrite 0x006a6c thru 0x00f1a4 (0x8739 bytes) 000206 1781217906.343033 write 0x02d6b9 thru 0x03988c (0xc1d4 bytes) 000208 1781217906.348125 write 0x01d643 thru 0x02be61 (0xe81f bytes) 000210 1781217906.357884 trunc from 0x040000 to 0x028895 (0x1776a bytes) 000211 1781217906.412454 read 0x01091f thru 0x014e3d (0x451f bytes) 000212 1781217906.425098 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x28896): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28896): Mirror 4: 0x68053735 (stale) Mirror 6: 0x68053735 (stale) Mirror 7: 0x68053735 (stale) Mirror 8: 0x68053735 (stale) Mirror 9: 0x3e5c7f7a (stale) CRC-32 checksum value for chunk [0, 0x28896): Mirror 1: 0xc8b7081f Mirror 10: 0xc8b7081f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28896: skipped 000213 1781217907.795944 trunc from 0x028896 to 0x01f165 (0x9730 bytes) 000214 1781217907.948512 read 0x01dd61 thru 0x01e425 (0x6c5 bytes) 000215 1781217907.960604 mapwrite 0x01720d thru 0x018491 (0x1285 bytes) 000216 1781217908.049311 mapwrite 0x0127ec thru 0x0182ee (0x5b03 bytes) 000217 1781217908.122521 mapwrite 0x03d0ff thru 0x03ffff (0x2f01 bytes) 000218 1781217908.286102 mapwrite 0x00737e thru 0x00b889 (0x450c bytes) 000220 1781217908.356351 mapread 0x01a8bf thru 0x0290d2 (0xe814 bytes) 000222 1781217908.385558 mapwrite 0x007fce thru 0x01724e (0xf281 bytes) 000228 1781217908.557554 mapread 0x01b1c5 thru 0x02a25b (0xf097 bytes) 000229 1781217908.587835 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1eabb164 (stale) Mirror 6: 0x1eabb164 (stale) Mirror 7: 0x1eabb164 (stale) Mirror 8: 0x1eabb164 (stale) Mirror 9: 0x8d7c7e24 (stale) Mirror 10: 0x644adf95 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x524de411 Mirror 11: 0x524de411 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000230 1781217910.327345 write 0x0158c4 thru 0x01d5e7 (0x7d24 bytes) 000231 1781217910.447683 mapwrite 0x01c832 thru 0x02b45a (0xec29 bytes) 000232 1781217910.562044 mapread 0x03aa09 thru 0x03dd70 (0x3368 bytes) 000233 1781217910.604755 mapread 0x0270b5 thru 0x02ee46 (0x7d92 bytes) 000234 1781217910.606425 mapread 0x02cf6d thru 0x035902 (0x8996 bytes) 000235 1781217910.623879 mapwrite 0x02432d thru 0x02ac29 (0x68fd bytes) 000236 1781217910.743184 mapwrite 0x0237af thru 0x024b57 (0x13a9 bytes) 000237 1781217910.797248 mapwrite 0x021820 thru 0x023d6b (0x254c bytes) 000238 1781217910.855683 mapread 0x00a032 thru 0x011bc6 (0x7b95 bytes) 000239 1781217910.887149 MIRROR_RESYNC 8 mirrors 000240 1781217912.641829 mapread 0x020204 thru 0x02a297 (0xa094 bytes) 000241 1781217912.669155 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) 000242 1781217913.280083 write 0x03176a thru 0x03b8a2 (0xa139 bytes) 000243 1781217913.458472 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xafd683ce (stale) Mirror 6: 0xafd683ce (stale) Mirror 7: 0xafd683ce (stale) Mirror 8: 0xafd683ce (stale) Mirror 10: 0xafd683ce (stale) Mirror 11: 0xafd683ce (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x70690a62 Mirror 12: 0x70690a62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000244 1781217915.273302 read 0x0162cb thru 0x01a79d (0x44d3 bytes) 000251 1781217915.300756 read 0x030649 thru 0x03aac0 (0xa478 bytes) 000252 1781217915.348099 mapread 0x033383 thru 0x03603c (0x2cba bytes) 000254 1781217915.349479 mapwrite 0x020b25 thru 0x028566 (0x7a42 bytes) 000255 1781217915.710391 write 0x00b2b9 thru 0x00faa1 (0x47e9 bytes) 000256 1781217915.732020 mapread 0x020cd1 thru 0x020edb (0x20b bytes) 000258 1781217915.745632 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xafd683ce (stale) Mirror 6: 0xafd683ce (stale) Mirror 7: 0xafd683ce (stale) Mirror 8: 0xafd683ce (stale) Mirror 10: 0xafd683ce (stale) Mirror 11: 0xafd683ce (stale) Mirror 12: 0x70690a62 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x73882c23 Mirror 13: 0x73882c23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000259 1781217917.413463 mapwrite 0x035a2e thru 0x03d5b8 (0x7b8b bytes) 000261 1781217917.614578 mapread 0x0317df thru 0x03d6dd (0xbeff bytes) 000262 1781217917.617001 trunc from 0x040000 to 0x031c8d (0xe372 bytes) 000265 1781217917.665781 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x31c8e): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c8e): Mirror 4: 0x39982cf0 (stale) Mirror 6: 0x39982cf0 (stale) Mirror 7: 0x39982cf0 (stale) Mirror 8: 0x39982cf0 (stale) Mirror 10: 0x39982cf0 (stale) Mirror 11: 0x39982cf0 (stale) Mirror 12: 0x6eeef04c (stale) Mirror 13: 0x1cab961c (stale) CRC-32 checksum value for chunk [0, 0x31c8e): Mirror 1: 0x1cab961c Mirror 14: 0x1cab961c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c8e: skipped 000268 1781217919.001294 mapwrite 0x018e73 thru 0x02699b (0xdb29 bytes) 000269 1781217919.260797 mapwrite 0x035ef0 thru 0x03ffff (0xa110 bytes) 000270 1781217919.371538 trunc from 0x040000 to 0x0141b8 (0x2be47 bytes) 000271 1781217919.390165 trunc from 0x0141b9 to 0x02dcc0 (0x19b08 bytes) 000272 1781217919.421424 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2dcc1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dcc1): Mirror 4: 0xe8b28af6 (stale) Mirror 6: 0xe8b28af6 (stale) Mirror 7: 0xe8b28af6 (stale) Mirror 8: 0xe8b28af6 (stale) Mirror 10: 0xe8b28af6 (stale) Mirror 11: 0xe8b28af6 (stale) Mirror 12: 0xe8b28af6 (stale) Mirror 13: 0x2923c309 (stale) Mirror 14: 0x2923c309 (stale) CRC-32 checksum value for chunk [0, 0x2dcc1): Mirror 1: 0x594159a3 Mirror 15: 0x594159a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dcc1: skipped 000274 1781217920.565692 trunc from 0x02dcc1 to 0x0127c1 (0x1b4ff bytes) 000275 1781217920.662205 mapwrite 0x00856b thru 0x010a52 (0x84e8 bytes) 000277 1781217920.741643 write 0x03eebe thru 0x03ffff (0x1142 bytes) 000279 1781217920.744570 trunc from 0x040000 to 0x009291 (0x36d6e bytes) 000280 1781217920.805470 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9292): Mirror 4: 0xc9b711a8 (stale) Mirror 6: 0xc9b711a8 (stale) Mirror 7: 0xc9b711a8 (stale) Mirror 8: 0xc9b711a8 (stale) Mirror 10: 0xc9b711a8 (stale) Mirror 11: 0xc9b711a8 (stale) Mirror 12: 0xc9b711a8 (stale) Mirror 13: 0xc9b711a8 (stale) Mirror 14: 0xc9b711a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9292): Mirror 4: 0xc9b711a8 (stale) Mirror 6: 0xc9b711a8 (stale) Mirror 7: 0xc9b711a8 (stale) Mirror 8: 0xc9b711a8 (stale) Mirror 10: 0xc9b711a8 (stale) Mirror 11: 0xc9b711a8 (stale) Mirror 12: 0xc9b711a8 (stale) Mirror 13: 0xc9b711a8 (stale) Mirror 14: 0xc9b711a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9292: skipped 000281 1781217921.592451 mapread 0x0029a5 thru 0x003d75 (0x13d1 bytes) 000282 1781217921.618287 mapwrite 0x02dc1b thru 0x039adc (0xbec2 bytes) 000283 1781217921.881683 write 0x02d9fb thru 0x02edb7 (0x13bd bytes) 000285 1781217921.887516 mapread 0x0034ec thru 0x009790 (0x62a5 bytes) 000286 1781217921.909624 mapwrite 0x031b4e thru 0x03de92 (0xc345 bytes) 000288 1781217922.121805 mapread 0x02338e thru 0x02405a (0xccd bytes) 000291 1781217922.142248 trunc from 0x03de93 to 0x0313a7 (0xcaeb bytes) 000292 1781217922.169097 mapwrite 0x005868 thru 0x007f53 (0x26ec bytes) 000293 1781217922.224309 mapwrite 0x03a20f thru 0x03ffff (0x5df1 bytes) 000297 1781217922.356779 write 0x02d4a4 thru 0x03a48e (0xcfeb bytes) 000298 1781217922.378806 MIRROR_RESYNC 10 mirrors 000299 1781217925.385044 write 0x0002ed thru 0x0087a0 (0x84b4 bytes) 000301 1781217925.608572 mapread 0x013b46 thru 0x01fd63 (0xc21e bytes) 000302 1781217925.666649 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x59c0b9bc (stale) Mirror 7: 0x59c0b9bc (stale) Mirror 8: 0x59c0b9bc (stale) Mirror 10: 0x59c0b9bc (stale) Mirror 11: 0x59c0b9bc (stale) Mirror 12: 0x59c0b9bc (stale) Mirror 13: 0x59c0b9bc (stale) Mirror 14: 0x59c0b9bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x59c0b9bc (stale) Mirror 7: 0x59c0b9bc (stale) Mirror 8: 0x59c0b9bc (stale) Mirror 10: 0x59c0b9bc (stale) Mirror 11: 0x59c0b9bc (stale) Mirror 12: 0x59c0b9bc (stale) Mirror 13: 0x59c0b9bc (stale) Mirror 14: 0x59c0b9bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000304 1781217926.667354 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x59c0b9bc (stale) Mirror 7: 0x59c0b9bc (stale) Mirror 8: 0x59c0b9bc (stale) Mirror 10: 0x59c0b9bc (stale) Mirror 11: 0x59c0b9bc (stale) Mirror 12: 0x59c0b9bc (stale) Mirror 13: 0x59c0b9bc (stale) Mirror 14: 0x59c0b9bc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb2dab882 Mirror 15: 0xb2dab882 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000305 1781217928.438643 mapread 0x00bb49 thru 0x0181e9 (0xc6a1 bytes) 000306 1781217928.482295 mapread 0x0194ff thru 0x024116 (0xac18 bytes) 000308 1781217928.495809 write 0x025fbf thru 0x029b1e (0x3b60 bytes) 000309 1781217928.605517 trunc from 0x040000 to 0x0041c7 (0x3be38 bytes) 000310 1781217928.637007 read 0x003774 thru 0x0041c7 (0xa54 bytes) 000313 1781217928.652736 MIRROR_RESYNC 10 mirrors 000315 1781217930.999172 write 0x00f5ca thru 0x01aa02 (0xb439 bytes) 000316 1781217931.138538 trunc from 0x01aa03 to 0x01c7e6 (0x1de4 bytes) 000317 1781217931.200380 mapwrite 0x000e36 thru 0x00d2c3 (0xc48e bytes) 000319 1781217931.488169 write 0x03fadf thru 0x03ffff (0x521 bytes) 000321 1781217931.490298 trunc from 0x040000 to 0x00e84e (0x317b1 bytes) 000323 1781217931.544192 mapread 0x00211c thru 0x00e84e (0xc733 bytes) 000325 1781217931.564406 trunc from 0x00e84f to 0x02f0f6 (0x208a8 bytes) 000327 1781217931.640454 mapread 0x01aa7d thru 0x025b9c (0xb120 bytes) 000328 1781217931.688088 read 0x019094 thru 0x01bc89 (0x2bf6 bytes) 000329 1781217931.696426 read 0x0198d0 thru 0x025b0d (0xc23e bytes) 000331 1781217931.698263 mapread 0x01e0e9 thru 0x02aa78 (0xc990 bytes) 000332 1781217931.701475 mapread 0x015f06 thru 0x01ee4b (0x8f46 bytes) 000333 1781217931.703830 write 0x01aea8 thru 0x02a371 (0xf4ca bytes) 000334 1781217931.715626 write 0x02a333 thru 0x03582f (0xb4fd bytes) 000335 1781217931.722685 read 0x02569e thru 0x02dea4 (0x8807 bytes) 000337 1781217931.726279 mapwrite 0x0388e4 thru 0x03e4ba (0x5bd7 bytes) 000340 1781217931.879682 trunc from 0x03e4bb to 0x0283ee (0x160cc bytes) 000341 1781217931.914717 mapwrite 0x02f398 thru 0x03407b (0x4ce4 bytes) 000342 1781217932.048268 write 0x01b21c thru 0x01ea41 (0x3826 bytes) 000343 1781217932.049701 write 0x016305 thru 0x01c211 (0x5f0d bytes) 000346 1781217932.061432 mapread 0x032e7c thru 0x033c92 (0xe17 bytes) 000347 1781217932.063795 write 0x03ea93 thru 0x03ffff (0x156d bytes) 000348 1781217932.066371 trunc from 0x040000 to 0x033ce3 (0xc31c bytes) 000349 1781217932.100018 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33ce4): Mirror 4: 0x1ab9a4e1 (stale) Mirror 7: 0x1ab9a4e1 (stale) Mirror 8: 0x1ab9a4e1 (stale) Mirror 10: 0x1ab9a4e1 (stale) Mirror 11: 0x1ab9a4e1 (stale) Mirror 12: 0x1ab9a4e1 (stale) Mirror 14: 0x1ab9a4e1 (stale) Mirror 15: 0x1ab9a4e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33ce4): Mirror 4: 0x1ab9a4e1 (stale) Mirror 7: 0x1ab9a4e1 (stale) Mirror 8: 0x1ab9a4e1 (stale) Mirror 10: 0x1ab9a4e1 (stale) Mirror 11: 0x1ab9a4e1 (stale) Mirror 12: 0x1ab9a4e1 (stale) Mirror 14: 0x1ab9a4e1 (stale) Mirror 15: 0x1ab9a4e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33ce4: skipped 000352 1781217932.830409 mapread 0x003e09 thru 0x0050b0 (0x12a8 bytes) 000353 1781217932.883008 mapread 0x0257e3 thru 0x033ce3 (0xe501 bytes) 000354 1781217932.923600 write 0x03def6 thru 0x03ffff (0x210a bytes) 000355 1781217932.926770 mapwrite 0x03d797 thru 0x03ffff (0x2869 bytes) 000356 1781217933.022757 MIRROR_RESYNC 9 mirrors 000361 1781217935.119339 trunc from 0x040000 to 0x03205e (0xdfa1 bytes) 000362 1781217935.291969 trunc from 0x03205f to 0x00e481 (0x23bdd bytes) 000363 1781217935.329782 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xe482): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe482): Mirror 4: 0xc9a90228 (stale) Mirror 7: 0xc9a90228 (stale) Mirror 8: 0xc9a90228 (stale) Mirror 10: 0xc9a90228 (stale) Mirror 11: 0xc9a90228 (stale) Mirror 12: 0xc9a90228 (stale) Mirror 14: 0xc9a90228 (stale) Mirror 15: 0xc9a90228 (stale) CRC-32 checksum value for chunk [0, 0xe482): Mirror 1: 0xc9a90228 Mirror 16: 0xc9a90228 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe482: skipped 000364 1781217936.644895 mapwrite 0x02574d thru 0x02b656 (0x5f0a bytes) 000365 1781217936.930537 mapwrite 0x000bb9 thru 0x0091c0 (0x8608 bytes) 000366 1781217937.027592 write 0x01430a thru 0x01cec7 (0x8bbe bytes) 000367 1781217937.047519 MIRROR_RESYNC 10 mirrors 000368 1781217939.202748 read 0x00a00f thru 0x0161fb (0xc1ed bytes) 000369 1781217939.234611 trunc from 0x02b657 to 0x02cd50 (0x16fa bytes) 000370 1781217939.359331 trunc from 0x02cd51 to 0x030dba (0x406a bytes) 000374 1781217939.445881 mapread 0x02698b thru 0x0276d3 (0xd49 bytes) 000376 1781217939.468620 write 0x021f57 thru 0x028284 (0x632e bytes) 000379 1781217939.497234 write 0x01e758 thru 0x0296c4 (0xaf6d bytes) 000380 1781217939.500954 trunc from 0x030dbb to 0x00441c (0x2c99e bytes) 000381 1781217939.536664 MIRROR_RESYNC 10 mirrors 000384 1781217942.012101 write 0x01322c thru 0x02267c (0xf451 bytes) 000385 1781217942.224044 write 0x028688 thru 0x032236 (0x9baf bytes) 000386 1781217942.238396 write 0x01b008 thru 0x027680 (0xc679 bytes) 000388 1781217942.257896 read 0x021c97 thru 0x0299f6 (0x7d60 bytes) 000389 1781217942.259182 mapwrite 0x00868f thru 0x015e4c (0xd7be bytes) 000390 1781217942.405371 mapread 0x005404 thru 0x00fdf8 (0xa9f5 bytes) 000392 1781217942.413043 trunc from 0x032237 to 0x023f32 (0xe304 bytes) 000393 1781217942.484279 mapwrite 0x03aa95 thru 0x03e1a3 (0x370f bytes) 000394 1781217942.674284 mapwrite 0x03df29 thru 0x03ffff (0x20d7 bytes) 000396 1781217942.847137 write 0x014fe4 thru 0x01f640 (0xa65d bytes) 000397 1781217942.851003 trunc from 0x040000 to 0x016dd8 (0x29227 bytes) 000400 1781217942.899830 mapread 0x00a839 thru 0x00c855 (0x201d bytes) 000402 1781217942.910645 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x16dd9): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16dd9): Mirror 4: 0x56615182 (stale) Mirror 7: 0x56615182 (stale) Mirror 8: 0x56615182 (stale) Mirror 10: 0x56615182 (stale) Mirror 11: 0x56615182 (stale) Mirror 12: 0x56615182 (stale) Mirror 14: 0x56615182 (stale) Mirror 15: 0x56615182 (stale) Mirror 16: 0x56615182 (stale) CRC-32 checksum value for chunk [0, 0x16dd9): Mirror 1: 0xfd8dff5 Mirror 17: 0xfd8dff5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16dd9: skipped 000403 1781217944.662991 write 0x02c6e6 thru 0x0346b4 (0x7fcf bytes) 000404 1781217944.814443 mapread 0x00ef67 thru 0x01539a (0x6434 bytes) 000405 1781217944.861148 read 0x007614 thru 0x0102d0 (0x8cbd bytes) 000406 1781217944.875798 mapread 0x0190a8 thru 0x01f224 (0x617d bytes) 000408 1781217944.902591 mapread 0x00f132 thru 0x01be60 (0xcd2f bytes) 000410 1781217944.915264 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x346b5): Mirror 7: 0x1f68fb7c (stale) Mirror 8: 0x1f68fb7c (stale) Mirror 10: 0x1f68fb7c (stale) Mirror 11: 0x1f68fb7c (stale) Mirror 12: 0x1f68fb7c (stale) Mirror 14: 0x1f68fb7c (stale) Mirror 15: 0x1f68fb7c (stale) Mirror 16: 0x1f68fb7c (stale) Mirror 17: 0x445ff3c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x346b5): Mirror 7: 0x1f68fb7c (stale) Mirror 8: 0x1f68fb7c (stale) Mirror 10: 0x1f68fb7c (stale) Mirror 11: 0x1f68fb7c (stale) Mirror 12: 0x1f68fb7c (stale) Mirror 14: 0x1f68fb7c (stale) Mirror 15: 0x1f68fb7c (stale) Mirror 16: 0x1f68fb7c (stale) Mirror 17: 0x445ff3c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x346b5: skipped 000412 1781217945.688038 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x346b5): Mirror 7: 0x1f68fb7c (stale) Mirror 8: 0x1f68fb7c (stale) Mirror 10: 0x1f68fb7c (stale) Mirror 11: 0x1f68fb7c (stale) Mirror 12: 0x1f68fb7c (stale) Mirror 14: 0x1f68fb7c (stale) Mirror 16: 0x1f68fb7c (stale) Mirror 17: 0x445ff3c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x346b5): Mirror 7: 0x1f68fb7c (stale) Mirror 8: 0x1f68fb7c (stale) Mirror 10: 0x1f68fb7c (stale) Mirror 11: 0x1f68fb7c (stale) Mirror 12: 0x1f68fb7c (stale) Mirror 14: 0x1f68fb7c (stale) Mirror 16: 0x1f68fb7c (stale) Mirror 17: 0x445ff3c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x346b5: skipped 000413 1781217946.313826 mapwrite 0x0182b0 thru 0x01d741 (0x5492 bytes) 000417 1781217946.425538 mapwrite 0x0181e6 thru 0x01ac6b (0x2a86 bytes) 000418 1781217946.517237 trunc from 0x0346b5 to 0x025f76 (0xe73e bytes) 000419 1781217946.573225 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25f77): Mirror 7: 0x8367f4c3 (stale) Mirror 8: 0x8367f4c3 (stale) Mirror 11: 0x8367f4c3 (stale) Mirror 12: 0x8367f4c3 (stale) Mirror 14: 0x8367f4c3 (stale) Mirror 16: 0x8367f4c3 (stale) Mirror 17: 0x6e9c4407 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25f77): Mirror 7: 0x8367f4c3 (stale) Mirror 8: 0x8367f4c3 (stale) Mirror 11: 0x8367f4c3 (stale) Mirror 12: 0x8367f4c3 (stale) Mirror 14: 0x8367f4c3 (stale) Mirror 16: 0x8367f4c3 (stale) Mirror 17: 0x6e9c4407 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25f77: skipped 000420 1781217947.113656 trunc from 0x025f77 to 0x0062bb (0x1fcbb bytes) 000422 1781217947.168663 write 0x0355b3 thru 0x03d85e (0x82ac bytes) 000424 1781217947.177054 trunc from 0x03d85f to 0x009d82 (0x33adc bytes) 000426 1781217947.218283 trunc from 0x009d83 to 0x033c39 (0x29eb7 bytes) 000427 1781217947.257953 trunc from 0x033c3a to 0x022cd5 (0x10f64 bytes) 000428 1781217947.295428 trunc from 0x022cd6 to 0x03194e (0xec79 bytes) 000431 1781217947.339384 mapwrite 0x019dbc thru 0x01b4e4 (0x1729 bytes) 000432 1781217947.454641 mapwrite 0x036908 thru 0x03ffff (0x96f8 bytes) 000435 1781217947.588378 read 0x035767 thru 0x03ffff (0xa899 bytes) 000436 1781217947.590161 trunc from 0x040000 to 0x027577 (0x18a88 bytes) 000437 1781217947.635475 write 0x000bcf thru 0x002a7d (0x1eaf bytes) 000438 1781217947.666343 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x27578): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27578): Mirror 7: 0xc4fce42c (stale) Mirror 8: 0xc4fce42c (stale) Mirror 11: 0xc4fce42c (stale) Mirror 12: 0xc4fce42c (stale) Mirror 14: 0xc4fce42c (stale) Mirror 16: 0xc4fce42c (stale) Mirror 17: 0xc0d7ca90 (stale) CRC-32 checksum value for chunk [0, 0x27578): Mirror 1: 0x8f3a0921 Mirror 18: 0x8f3a0921 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27578: skipped 000443 1781217949.251947 mapread 0x00fc7e thru 0x01d8c2 (0xdc45 bytes) 000444 1781217949.335193 read 0x008292 thru 0x00b6e2 (0x3451 bytes) 000447 1781217949.360274 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27578): Mirror 7: 0xc4fce42c (stale) Mirror 8: 0xc4fce42c (stale) Mirror 11: 0xc4fce42c (stale) Mirror 12: 0xc4fce42c (stale) Mirror 16: 0xc4fce42c (stale) Mirror 17: 0xc0d7ca90 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27578): Mirror 7: 0xc4fce42c (stale) Mirror 8: 0xc4fce42c (stale) Mirror 11: 0xc4fce42c (stale) Mirror 12: 0xc4fce42c (stale) Mirror 16: 0xc4fce42c (stale) Mirror 17: 0xc0d7ca90 (stale) CRC-32 checksum value for chunk [0, 0x27578): Mirror 1: 0x8f3a0921 Mirror 18: 0x8f3a0921 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27578: skipped 000449 1781217950.416777 mapread 0x023650 thru 0x024c86 (0x1637 bytes) 000450 1781217950.462108 write 0x030056 thru 0x03ba9e (0xba49 bytes) 000454 1781217950.649629 write 0x01b891 thru 0x02a625 (0xed95 bytes) 000455 1781217950.688797 read 0x02aa44 thru 0x036873 (0xbe30 bytes) 000456 1781217950.708009 trunc from 0x03ba9f to 0x016fea (0x24ab4 bytes) 000457 1781217950.748292 read 0x014d38 thru 0x016334 (0x15fd bytes) 000458 1781217950.750850 mapread 0x00b56c thru 0x016fea (0xba7f bytes) 000459 1781217950.768698 write 0x01e669 thru 0x02cf8c (0xe924 bytes) 000460 1781217950.778643 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2cf8d): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cf8d): Mirror 7: 0x9ff84823 (stale) Mirror 8: 0x9ff84823 (stale) Mirror 11: 0x9ff84823 (stale) Mirror 12: 0x9ff84823 (stale) Mirror 16: 0x9ff84823 (stale) Mirror 17: 0xc7c98523 (stale) Mirror 18: 0xa47295b8 (stale) CRC-32 checksum value for chunk [0, 0x2cf8d): Mirror 1: 0x737385b3 Mirror 19: 0x737385b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cf8d: skipped 000462 1781217952.427550 trunc from 0x02cf8d to 0x02c7ab (0x7e1 bytes) 000464 1781217952.643585 mapwrite 0x003855 thru 0x01288b (0xf037 bytes) 000465 1781217952.907482 trunc from 0x02c7ac to 0x02f17d (0x29d2 bytes) 000466 1781217952.960783 write 0x01381c thru 0x020578 (0xcd5d bytes) 000467 1781217952.985897 trunc from 0x02f17e to 0x018805 (0x16978 bytes) 000468 1781217953.037151 MIRROR_RESYNC 9 mirrors 000469 1781217955.274519 read 0x016e99 thru 0x018805 (0x196d bytes) 000470 1781217955.292606 trunc from 0x018806 to 0x024988 (0xc183 bytes) 000471 1781217955.487664 read 0x01bf4e thru 0x024988 (0x8a3b bytes) 000473 1781217955.511053 mapread 0x001c2b thru 0x00f853 (0xdc29 bytes) 000476 1781217955.518487 mapread 0x021fb6 thru 0x024988 (0x29d3 bytes) 000478 1781217955.522256 write 0x0332a6 thru 0x03793b (0x4696 bytes) 000479 1781217955.526390 trunc from 0x03793c to 0x011e77 (0x25ac4 bytes) 000481 1781217955.572441 mapread 0x009cf7 thru 0x011e77 (0x8181 bytes) 000482 1781217955.575508 mapwrite 0x02ad60 thru 0x036476 (0xb717 bytes) 000483 1781217955.776287 write 0x0284ec thru 0x02d8d6 (0x53eb bytes) 000484 1781217955.778367 read 0x01cc9f thru 0x025e08 (0x916a bytes) 000485 1781217955.824307 mapread 0x01eb56 thru 0x021dee (0x3299 bytes) 000486 1781217955.827238 read 0x02fbcf thru 0x036476 (0x68a8 bytes) 000487 1781217955.828145 write 0x01cb88 thru 0x01fe9f (0x3318 bytes) 000490 1781217955.834728 mapwrite 0x0353fb thru 0x03596a (0x570 bytes) 000495 1781217955.960362 read 0x00fd47 thru 0x01f63a (0xf8f4 bytes) 000496 1781217955.962785 write 0x012ce6 thru 0x01be9a (0x91b5 bytes) 000497 1781217955.976253 MIRROR_RESYNC 9 mirrors 000500 1781217958.096241 MIRROR_RESYNC 9 mirrors 000502 1781217959.110545 read 0x027e33 thru 0x02ba0e (0x3bdc bytes) 000503 1781217959.137556 trunc from 0x036477 to 0x0321bc (0x42ba bytes) 000504 1781217959.338499 read 0x00b09b thru 0x018823 (0xd789 bytes) 000506 1781217959.378500 write 0x00166f thru 0x0088dc (0x726e bytes) 000508 1781217959.387301 write 0x02d911 thru 0x03cebd (0xf5ad bytes) 000511 1781217959.401926 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cebe): Mirror 7: 0x5a1e5783 (stale) Mirror 8: 0x5a1e5783 (stale) Mirror 11: 0x5a1e5783 (stale) Mirror 12: 0x5a1e5783 (stale) Mirror 16: 0x5a1e5783 (stale) Mirror 17: 0x5a1e5783 (stale) Mirror 18: 0x5a1e5783 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cebe): Mirror 7: 0x5a1e5783 (stale) Mirror 8: 0x5a1e5783 (stale) Mirror 11: 0x5a1e5783 (stale) Mirror 12: 0x5a1e5783 (stale) Mirror 16: 0x5a1e5783 (stale) Mirror 17: 0x5a1e5783 (stale) Mirror 18: 0x5a1e5783 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cebe: skipped 000512 1781217960.132960 mapwrite 0x00d6da thru 0x0186df (0xb006 bytes) 000514 1781217960.320726 read 0x0181e3 thru 0x01bb1f (0x393d bytes) 000515 1781217960.330623 MIRROR_RESYNC 8 mirrors 000516 1781217961.984347 mapread 0x00824d thru 0x011363 (0x9117 bytes) 000519 1781217962.050528 trunc from 0x03cebe to 0x03da5f (0xba2 bytes) 000523 1781217962.259221 mapread 0x03c33d thru 0x03da5f (0x1723 bytes) 000524 1781217962.290690 mapread 0x034940 thru 0x03c560 (0x7c21 bytes) 000526 1781217962.311827 write 0x0261aa thru 0x0283a0 (0x21f7 bytes) 000527 1781217962.336393 write 0x00b7bb thru 0x018612 (0xce58 bytes) 000529 1781217962.376353 trunc from 0x03da60 to 0x021247 (0x1c818 bytes) 000530 1781217962.425674 mapread 0x0110bb thru 0x01560e (0x4554 bytes) 000532 1781217962.434007 write 0x0205e4 thru 0x02f257 (0xec74 bytes) 000533 1781217962.446309 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2f258): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f258): Mirror 7: 0x8399ed3b (stale) Mirror 8: 0x8399ed3b (stale) Mirror 11: 0x8399ed3b (stale) Mirror 12: 0x8399ed3b (stale) Mirror 16: 0x8399ed3b (stale) Mirror 17: 0x8399ed3b (stale) Mirror 18: 0x8399ed3b (stale) CRC-32 checksum value for chunk [0, 0x2f258): Mirror 1: 0xc7e91687 Mirror 19: 0xc7e91687 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f258: skipped 000534 1781217963.822036 mapread 0x012e1a thru 0x01ca8b (0x9c72 bytes) 000536 1781217963.874481 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f258): Mirror 8: 0x8399ed3b (stale) Mirror 11: 0x8399ed3b (stale) Mirror 12: 0x8399ed3b (stale) Mirror 16: 0x8399ed3b (stale) Mirror 17: 0x8399ed3b (stale) Mirror 18: 0x8399ed3b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f258): Mirror 8: 0x8399ed3b (stale) Mirror 11: 0x8399ed3b (stale) Mirror 12: 0x8399ed3b (stale) Mirror 16: 0x8399ed3b (stale) Mirror 17: 0x8399ed3b (stale) Mirror 18: 0x8399ed3b (stale) CRC-32 checksum value for chunk [0, 0x2f258): Mirror 1: 0xc7e91687 Mirror 19: 0xc7e91687 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f258: skipped 000538 1781217964.841565 write 0x036a55 thru 0x03f53c (0x8ae8 bytes) 000539 1781217964.918789 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f53d): Mirror 11: 0xf3fb88a4 (stale) Mirror 12: 0xf3fb88a4 (stale) Mirror 16: 0xf3fb88a4 (stale) Mirror 17: 0xf3fb88a4 (stale) Mirror 18: 0xf3fb88a4 (stale) Mirror 19: 0x3fe1d868 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f53d): Mirror 11: 0xf3fb88a4 (stale) Mirror 12: 0xf3fb88a4 (stale) Mirror 16: 0xf3fb88a4 (stale) Mirror 17: 0xf3fb88a4 (stale) Mirror 18: 0xf3fb88a4 (stale) Mirror 19: 0x3fe1d868 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f53d: skipped 000540 1781217965.390210 write 0x0233ea thru 0x02dcde (0xa8f5 bytes) 000541 1781217965.417195 trunc from 0x03f53d to 0x018127 (0x27415 bytes) 000543 1781217965.447041 write 0x01f2e1 thru 0x02b573 (0xc293 bytes) 000548 1781217965.460244 mapread 0x02b16f thru 0x02b573 (0x405 bytes) 000552 1781217965.464682 trunc from 0x02b574 to 0x00b1e3 (0x20390 bytes) 000553 1781217965.482802 mapread 0x004da4 thru 0x00b1e3 (0x6440 bytes) 000554 1781217965.495175 read 0x000aa3 thru 0x00b1e3 (0xa741 bytes) 000555 1781217965.504745 mapwrite 0x037c53 thru 0x03ffff (0x83ad bytes) 000556 1781217965.643248 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xa08d4add (stale) Mirror 12: 0xa08d4add (stale) Mirror 16: 0xa08d4add (stale) Mirror 17: 0xa08d4add (stale) Mirror 18: 0xa08d4add (stale) Mirror 19: 0x15e6c7c6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x43679084 Mirror 20: 0x43679084 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000557 1781217966.987245 write 0x019f0e thru 0x022ca4 (0x8d97 bytes) 000559 1781217967.177743 trunc from 0x040000 to 0x03c433 (0x3bcc bytes) 000564 1781217967.253894 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3c434): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c434): Mirror 11: 0x8b143ad8 (stale) Mirror 12: 0x8b143ad8 (stale) Mirror 16: 0x8b143ad8 (stale) Mirror 17: 0x8b143ad8 (stale) Mirror 18: 0x8b143ad8 (stale) Mirror 19: 0x2bb66434 (stale) Mirror 20: 0xf60021be (stale) CRC-32 checksum value for chunk [0, 0x3c434): Mirror 1: 0x424b3e0 Mirror 21: 0x424b3e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c434: skipped 000565 1781217969.627363 mapread 0x0210ef thru 0x02bfdc (0xaeee bytes) 000567 1781217969.699196 mapread 0x003b3e thru 0x008886 (0x4d49 bytes) 000568 1781217969.726890 mapread 0x01c5ed thru 0x01efe5 (0x29f9 bytes) 000569 1781217969.756184 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c434): Mirror 11: 0x8b143ad8 (stale) Mirror 12: 0x8b143ad8 (stale) Mirror 16: 0x8b143ad8 (stale) Mirror 17: 0x8b143ad8 (stale) Mirror 18: 0x8b143ad8 (stale) Mirror 20: 0xf60021be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c434): Mirror 11: 0x8b143ad8 (stale) Mirror 12: 0x8b143ad8 (stale) Mirror 16: 0x8b143ad8 (stale) Mirror 17: 0x8b143ad8 (stale) Mirror 18: 0x8b143ad8 (stale) Mirror 20: 0xf60021be (stale) CRC-32 checksum value for chunk [0, 0x3c434): Mirror 1: 0x424b3e0 Mirror 21: 0x424b3e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c434: skipped 000570 1781217971.159004 trunc from 0x03c434 to 0x03abe5 (0x184e bytes) 000571 1781217971.383289 write 0x0036ea thru 0x00ff2b (0xc842 bytes) 000572 1781217971.408598 mapread 0x03197a thru 0x03abe5 (0x926c bytes) 000575 1781217971.444540 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3abe6): Mirror 11: 0xd5aec8ce (stale) Mirror 16: 0xd5aec8ce (stale) Mirror 17: 0xd5aec8ce (stale) Mirror 18: 0xd5aec8ce (stale) Mirror 20: 0x7c601ba1 (stale) Mirror 21: 0xf8f952f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3abe6): Mirror 11: 0xd5aec8ce (stale) Mirror 16: 0xd5aec8ce (stale) Mirror 17: 0xd5aec8ce (stale) Mirror 18: 0xd5aec8ce (stale) Mirror 20: 0x7c601ba1 (stale) Mirror 21: 0xf8f952f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3abe6: skipped 000576 1781217972.438801 trunc from 0x03abe6 to 0x019309 (0x218dc bytes) 000577 1781217972.470156 mapread 0x0162e7 thru 0x017e7b (0x1b95 bytes) 000578 1781217972.503756 write 0x024550 thru 0x032096 (0xdb47 bytes) 000581 1781217972.527221 MIRROR_RESYNC 7 mirrors 000584 1781217975.210836 read 0x00bde2 thru 0x0163fc (0xa61b bytes) 000585 1781217975.227978 write 0x026567 thru 0x02804f (0x1ae9 bytes) 000589 1781217975.396993 mapread 0x024f90 thru 0x02be6a (0x6edb bytes) 000590 1781217975.415779 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32097): Mirror 11: 0xa6d43a44 (stale) Mirror 16: 0xa6d43a44 (stale) Mirror 18: 0xa6d43a44 (stale) Mirror 20: 0xa6d43a44 (stale) Mirror 21: 0xa6d43a44 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32097): Mirror 11: 0xa6d43a44 (stale) Mirror 16: 0xa6d43a44 (stale) Mirror 18: 0xa6d43a44 (stale) Mirror 20: 0xa6d43a44 (stale) Mirror 21: 0xa6d43a44 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32097: skipped 000591 1781217975.989284 trunc from 0x032097 to 0x02247d (0xfc19 bytes) 000594 1781217976.059041 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2247e): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2247e): Mirror 11: 0xd08fe7e4 (stale) Mirror 16: 0xd08fe7e4 (stale) Mirror 18: 0xd08fe7e4 (stale) Mirror 20: 0xd08fe7e4 (stale) Mirror 21: 0xd08fe7e4 (stale) CRC-32 checksum value for chunk [0, 0x2247e): Mirror 1: 0xd08fe7e4 Mirror 22: 0xd08fe7e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2247e: skipped 000595 1781217977.327585 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2247e): Mirror 11: 0xd08fe7e4 (stale) Mirror 16: 0xd08fe7e4 (stale) Mirror 18: 0xd08fe7e4 (stale) Mirror 21: 0xd08fe7e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2247e): Mirror 11: 0xd08fe7e4 (stale) Mirror 16: 0xd08fe7e4 (stale) Mirror 18: 0xd08fe7e4 (stale) Mirror 21: 0xd08fe7e4 (stale) CRC-32 checksum value for chunk [0, 0x2247e): Mirror 1: 0xd08fe7e4 Mirror 22: 0xd08fe7e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2247e: skipped 000598 1781217978.051238 trunc from 0x02247e to 0x025556 (0x30d9 bytes) 000599 1781217978.168676 mapwrite 0x01a568 thru 0x02a1c7 (0xfc60 bytes) 000603 1781217978.281011 read 0x02290c thru 0x02513d (0x2832 bytes) 000604 1781217978.282622 mapread 0x01bdd3 thru 0x02885f (0xca8d bytes) 000605 1781217978.284290 mapwrite 0x03b41d thru 0x03c18e (0xd72 bytes) 000609 1781217978.375293 mapwrite 0x002435 thru 0x00ce8f (0xaa5b bytes) 000611 1781217978.446961 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c18f): Mirror 11: 0xdb0c1f56 (stale) Mirror 16: 0xdb0c1f56 (stale) Mirror 21: 0xdb0c1f56 (stale) Mirror 22: 0x8af0df2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c18f): Mirror 11: 0xdb0c1f56 (stale) Mirror 16: 0xdb0c1f56 (stale) Mirror 21: 0xdb0c1f56 (stale) Mirror 22: 0x8af0df2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c18f: skipped 000612 1781217979.271782 trunc from 0x03c18f to 0x03bd83 (0x40b bytes) 000613 1781217979.321468 read 0x00c070 thru 0x016741 (0xa6d2 bytes) 000614 1781217979.340478 mapread 0x0182eb thru 0x025494 (0xd1aa bytes) 000615 1781217979.395147 read 0x023adf thru 0x02739c (0x38be bytes) 000619 1781217979.407413 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bd84): Mirror 11: 0xb0db97a (stale) Mirror 21: 0xb0db97a (stale) Mirror 22: 0xfff6a2ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd84): Mirror 11: 0xb0db97a (stale) Mirror 21: 0xb0db97a (stale) Mirror 22: 0xfff6a2ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd84: skipped 000621 1781217980.176501 write 0x009c94 thru 0x0176ba (0xda27 bytes) 000622 1781217980.195721 MIRROR_RESYNC 4 mirrors 000624 1781217982.038988 write 0x033e71 thru 0x03bcd0 (0x7e60 bytes) 000625 1781217982.225164 write 0x0212ed thru 0x0232e5 (0x1ff9 bytes) 000626 1781217982.267185 trunc from 0x03bd84 to 0x021d86 (0x19ffd bytes) 000627 1781217982.293320 write 0x00faf3 thru 0x01b72b (0xbc39 bytes) 000628 1781217982.307500 write 0x019e7d thru 0x022205 (0x8389 bytes) 000629 1781217982.310012 write 0x017d9c thru 0x023c64 (0xbec9 bytes) 000632 1781217982.313323 trunc from 0x023c65 to 0x00b544 (0x18720 bytes) 000633 1781217982.332271 read 0x0090d0 thru 0x00b544 (0x2475 bytes) 000634 1781217982.334752 mapwrite 0x0211e8 thru 0x030a27 (0xf840 bytes) 000637 1781217982.523125 trunc from 0x030a28 to 0x03e954 (0xdf2d bytes) 000638 1781217982.561378 trunc from 0x03e955 to 0x02058e (0x1e3c6 bytes) 000639 1781217982.599514 read 0x0118ee thru 0x01e1d8 (0xc8eb bytes) 000641 1781217982.651406 trunc from 0x02058f to 0x0238fc (0x336e bytes) 000642 1781217982.728055 mapread 0x019aa3 thru 0x0238fc (0x9e5a bytes) 000646 1781217982.754122 write 0x0000f6 thru 0x006ab2 (0x69bd bytes) 000651 1781217982.767140 trunc from 0x0238fd to 0x01ad6e (0x8b8e bytes) 000653 1781217982.794629 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ad6f): Mirror 11: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad6f): Mirror 11: 0x8c8d725e (stale) Mirror 21: 0x8c8d725e (stale) Mirror 22: 0x8c8d725e (stale) CRC-32 checksum value for chunk [0, 0x1ad6f): Mirror 1: 0xe17bdc14 Mirror 23: 0xe17bdc14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad6f: skipped 000656 1781217984.442196 mapread 0x008bcc thru 0x016484 (0xd8b9 bytes) 000657 1781217984.495298 read 0x010ae9 thru 0x015f02 (0x541a bytes) 000658 1781217984.497114 mapread 0x011746 thru 0x01ad6e (0x9629 bytes) 000662 1781217984.510771 read 0x00db92 thru 0x0102d0 (0x273f bytes) 000663 1781217984.516240 mapread 0x00caad thru 0x0117fa (0x4d4e bytes) 000664 1781217984.520546 mapread 0x01131c thru 0x019e49 (0x8b2e bytes) 000666 1781217984.543518 read 0x000b98 thru 0x0072f9 (0x6762 bytes) 000670 1781217984.555085 mapread 0x010edd thru 0x01ad6e (0x9e92 bytes) 000671 1781217984.559260 mapread 0x015bf4 thru 0x01868c (0x2a99 bytes) 000672 1781217984.564009 mapwrite 0x009eb1 thru 0x017353 (0xd4a3 bytes) 000673 1781217985.145250 read 0x009f62 thru 0x017137 (0xd1d6 bytes) 000675 1781217985.146826 write 0x005c2d thru 0x010de0 (0xb1b4 bytes) 000676 1781217985.174617 mapwrite 0x00416f thru 0x00c399 (0x822b bytes) 000678 1781217985.290080 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ad6f): Mirror 21: 0x8c8d725e (stale) Mirror 22: 0x8c8d725e (stale) Mirror 23: 0xe17bdc14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad6f): Mirror 21: 0x8c8d725e (stale) Mirror 22: 0x8c8d725e (stale) Mirror 23: 0xe17bdc14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad6f: skipped 000681 1781217986.168756 write 0x017233 thru 0x0237d2 (0xc5a0 bytes) 000683 1781217986.232084 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x237d3): Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x237d3): Mirror 21: 0x11f43f03 (stale) Mirror 22: 0x11f43f03 (stale) Mirror 23: 0x8c49f801 (stale) CRC-32 checksum value for chunk [0, 0x237d3): Mirror 1: 0x9693e0a3 Mirror 24: 0x9693e0a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x237d3: skipped 000685 1781217987.922380 mapread 0x009840 thru 0x0107e7 (0x6fa8 bytes) 000687 1781217987.967537 trunc from 0x0237d3 to 0x0167b1 (0xd021 bytes) 000692 1781217988.150597 read 0x0024e9 thru 0x00626f (0x3d87 bytes) 000698 1781217988.180101 mapwrite 0x025823 thru 0x028259 (0x2a37 bytes) 000704 1781217988.378557 mapwrite 0x013b44 thru 0x015dbd (0x227a bytes) 000705 1781217988.481407 mapwrite 0x026fd2 thru 0x029c5f (0x2c8e bytes) 000707 1781217988.546249 trunc from 0x029c60 to 0x029e24 (0x1c5 bytes) 000708 1781217988.567057 read 0x013ef9 thru 0x017e2d (0x3f35 bytes) 000710 1781217988.568913 write 0x02fd89 thru 0x030e01 (0x1079 bytes) 000713 1781217988.571636 read 0x020a08 thru 0x02ac4b (0xa244 bytes) 000714 1781217988.580462 write 0x01d5e1 thru 0x021355 (0x3d75 bytes) 000716 1781217988.583103 mapread 0x02f367 thru 0x030e01 (0x1a9b bytes) 000717 1781217988.585268 write 0x016d36 thru 0x01e653 (0x791e bytes) 000718 1781217988.594026 MIRROR_RESYNC 5 mirrors 000720 1781217989.817167 trunc from 0x030e02 to 0x02158a (0xf877 bytes) 000722 1781217989.932839 write 0x00bed1 thru 0x010b23 (0x4c53 bytes) 000723 1781217989.945401 mapread 0x00a91f thru 0x010a3e (0x6120 bytes) 000724 1781217989.960494 trunc from 0x02158b to 0x02d7a6 (0xc21c bytes) 000725 1781217989.986280 mapwrite 0x029d98 thru 0x02ad1c (0xf85 bytes) 000726 1781217990.042314 write 0x016759 thru 0x01b8b8 (0x5160 bytes) 000728 1781217990.052131 mapread 0x02a88e thru 0x02d450 (0x2bc3 bytes) 000732 1781217990.061426 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d7a7): Mirror 21: 0xd4a75182 (stale) Mirror 23: 0xd4a75182 (stale) Mirror 24: 0xd4a75182 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d7a7): Mirror 21: 0xd4a75182 (stale) Mirror 23: 0xd4a75182 (stale) Mirror 24: 0xd4a75182 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d7a7: skipped 000733 1781217990.632075 mapwrite 0x039bca thru 0x03e62c (0x4a63 bytes) 000735 1781217990.779294 mapread 0x01507d thru 0x01d61a (0x859e bytes) 000737 1781217990.789378 write 0x02eea8 thru 0x02ff2e (0x1087 bytes) 000738 1781217990.803446 read 0x01e4c3 thru 0x020cb3 (0x27f1 bytes) 000739 1781217990.815085 read 0x0279df thru 0x033bbf (0xc1e1 bytes) 000740 1781217990.816181 trunc from 0x03e62d to 0x038c47 (0x59e5 bytes) 000741 1781217990.853654 mapread 0x00e32b thru 0x013d1b (0x59f1 bytes) 000742 1781217990.856730 mapwrite 0x0294f2 thru 0x0318c4 (0x83d3 bytes) 000743 1781217990.932622 trunc from 0x038c48 to 0x023526 (0x15721 bytes) 000744 1781217990.962388 mapwrite 0x03770a thru 0x03ffff (0x88f6 bytes) 000745 1781217991.098197 mapread 0x0080af thru 0x00b91d (0x386f bytes) 000747 1781217991.161631 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0x338f9c2a (stale) Mirror 24: 0x338f9c2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0x338f9c2a (stale) Mirror 24: 0x338f9c2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000749 1781217991.677010 mapread 0x03b794 thru 0x03e1cc (0x2a39 bytes) 000754 1781217991.726563 trunc from 0x040000 to 0x004d67 (0x3b298 bytes) 000756 1781217991.801555 read 0x00018e thru 0x004d67 (0x4bda bytes) 000758 1781217991.827949 read 0x0020b8 thru 0x0042cd (0x2216 bytes) 000759 1781217991.839723 mapwrite 0x035847 thru 0x03d915 (0x80cf bytes) 000760 1781217991.966042 mapwrite 0x01d4b5 thru 0x028e33 (0xb97f bytes) 000761 1781217992.062807 trunc from 0x03d916 to 0x03e948 (0x1033 bytes) 000762 1781217992.106813 mapwrite 0x003022 thru 0x0044f9 (0x14d8 bytes) 000763 1781217992.183428 trunc from 0x03e949 to 0x00de58 (0x30af0 bytes) 000765 1781217992.238843 mapwrite 0x023a4b thru 0x02d142 (0x96f8 bytes) 000766 1781217992.601408 read 0x0072c0 thru 0x007ef8 (0xc39 bytes) 000767 1781217992.602431 mapread 0x0068e7 thru 0x010b92 (0xa2ac bytes) 000768 1781217992.669999 mapwrite 0x03bf23 thru 0x03ffff (0x40dd bytes) 000769 1781217992.866936 mapread 0x0392f6 thru 0x03ffff (0x6d0a bytes) 000773 1781217992.878724 write 0x03545e thru 0x03727d (0x1e20 bytes) 000777 1781217992.884365 write 0x02ded4 thru 0x03d7d7 (0xf904 bytes) 000779 1781217992.899822 MIRROR_RESYNC 3 mirrors 000783 1781217994.038158 mapread 0x02f3fe thru 0x037763 (0x8366 bytes) 000784 1781217994.059836 mapread 0x020192 thru 0x026715 (0x6584 bytes) 000789 1781217994.073081 mapwrite 0x00252d thru 0x00cd38 (0xa80c bytes) 000791 1781217994.343023 trunc from 0x040000 to 0x0138cf (0x2c730 bytes) 000792 1781217994.414250 write 0x01fa6a thru 0x029052 (0x95e9 bytes) 000793 1781217994.425034 mapread 0x01ffb6 thru 0x029052 (0x909d bytes) 000794 1781217994.429164 write 0x026a8f thru 0x02e99b (0x7f0d bytes) 000795 1781217994.432802 trunc from 0x02e99c to 0x035806 (0x6e6b bytes) 000796 1781217994.470184 write 0x01c1fa thru 0x025f19 (0x9d20 bytes) 000798 1781217994.516560 read 0x006af8 thru 0x012c2c (0xc135 bytes) 000799 1781217994.528223 mapread 0x02dd9a thru 0x02dded (0x54 bytes) 000800 1781217994.529698 write 0x0311e2 thru 0x037a31 (0x6850 bytes) 000802 1781217994.558564 trunc from 0x037a32 to 0x03c5a3 (0x4b72 bytes) truncating to largest ever: 0x3f9fe 000803 1781217994.580157 trunc from 0x03c5a4 to 0x03f9fd (0x345a bytes) 000804 1781217994.617670 mapread 0x029451 thru 0x03751c (0xe0cc bytes) 000808 1781217994.635518 trunc from 0x03f9fe to 0x00631d (0x396e0 bytes) 000809 1781217994.660398 mapwrite 0x03f732 thru 0x03ffff (0x8ce bytes) 000810 1781217994.862163 write 0x02821b thru 0x036e9e (0xec84 bytes) 000811 1781217994.906030 MIRROR_RESYNC 3 mirrors 000814 1781217996.554994 read 0x000cac thru 0x00fdbe (0xf113 bytes) 000816 1781217996.583138 trunc from 0x040000 to 0x01ae63 (0x2519c bytes) 000818 1781217996.737590 write 0x02b7ad thru 0x039c30 (0xe484 bytes) 000820 1781217996.747952 MIRROR_RESYNC 3 mirrors 000821 1781217998.092365 mapread 0x021cbd thru 0x028501 (0x6845 bytes) 000822 1781217998.128002 MIRROR_RESYNC 3 mirrors 000826 1781217999.187646 write 0x02f5e1 thru 0x03127c (0x1c9c bytes) 000827 1781217999.404579 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39c31): Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c31): Mirror 23: 0x83331f04 (stale) Mirror 24: 0x83331f04 (stale) CRC-32 checksum value for chunk [0, 0x39c31): Mirror 1: 0xa24ace8d Mirror 25: 0xa24ace8d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c31: skipped 000828 1781218000.812220 read 0x00908b thru 0x010261 (0x71d7 bytes) 000831 1781218000.845810 trunc from 0x039c31 to 0x00823f (0x319f1 bytes) 000832 1781218001.051828 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x8240): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8240): Mirror 23: 0x14328b4b (stale) Mirror 24: 0x14328b4b (stale) Mirror 25: 0x14328b4b (stale) CRC-32 checksum value for chunk [0, 0x8240): Mirror 1: 0x14328b4b Mirror 26: 0x14328b4b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8240: skipped 000833 1781218002.538642 mapread 0x00527c thru 0x00823f (0x2fc4 bytes) 000835 1781218002.565691 write 0x013fac thru 0x02101d (0xd072 bytes) 000836 1781218002.671264 mapread 0x00101e thru 0x005c82 (0x4c65 bytes) 000837 1781218002.687141 mapwrite 0x034bf6 thru 0x03ffff (0xb40a bytes) 000840 1781218002.886261 trunc from 0x040000 to 0x03bb00 (0x44ff bytes) 000841 1781218002.935175 trunc from 0x03bb01 to 0x00fd58 (0x2bda8 bytes) 000842 1781218002.984499 read 0x00ab0e thru 0x00de36 (0x3329 bytes) 000843 1781218002.992159 MIRROR_RESYNC 5 mirrors 000846 1781218004.572177 write 0x017b87 thru 0x0195d0 (0x1a4a bytes) 000847 1781218004.672525 write 0x00ef9f thru 0x01a161 (0xb1c3 bytes) 000850 1781218004.684028 read 0x000ab8 thru 0x002dfb (0x2344 bytes) 000852 1781218004.708580 read 0x015d74 thru 0x01a161 (0x43ee bytes) 000853 1781218004.711587 trunc from 0x01a162 to 0x00bb1c (0xe645 bytes) 000854 1781218004.756986 mapwrite 0x0338e0 thru 0x03ffff (0xc720 bytes) 000855 1781218004.885830 read 0x01bdae thru 0x01f695 (0x38e8 bytes) 000856 1781218004.887789 mapread 0x027feb thru 0x0365bd (0xe5d3 bytes) 000857 1781218004.891951 trunc from 0x040000 to 0x03440f (0xbbf0 bytes) 000858 1781218004.913918 trunc from 0x034410 to 0x01ddeb (0x16624 bytes) 000860 1781218004.942083 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ddec): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ddec): Mirror 23: 0xb552acb8 (stale) Mirror 24: 0xb552acb8 (stale) Mirror 25: 0xb552acb8 (stale) Mirror 26: 0xb552acb8 (stale) CRC-32 checksum value for chunk [0, 0x1ddec): Mirror 1: 0xb552acb8 Mirror 27: 0xb552acb8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ddec: skipped 000861 1781218006.211305 mapwrite 0x006c79 thru 0x007a1f (0xda7 bytes) 000862 1781218006.400319 trunc from 0x01ddec to 0x035257 (0x1746c bytes) 000866 1781218006.475488 mapwrite 0x03aafc thru 0x03ffff (0x5504 bytes) 000868 1781218006.677733 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x131:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x3ced1cae (stale) Mirror 25: 0x3ced1cae (stale) Mirror 26: 0x3ced1cae (stale) Mirror 27: 0x3ced1cae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x3ced1cae (stale) Mirror 25: 0x3ced1cae (stale) Mirror 26: 0x3ced1cae (stale) Mirror 27: 0x3ced1cae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000869 1781218007.201180 mapwrite 0x0110bf thru 0x01b3b9 (0xa2fb bytes) 000870 1781218007.279827 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0x3ced1cae (stale) Mirror 25: 0x3ced1cae (stale) Mirror 26: 0x3ced1cae (stale) Mirror 27: 0x3ced1cae (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x53e07980 Mirror 28: 0x53e07980 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000871 1781218008.396540 trunc from 0x040000 to 0x01fde6 (0x20219 bytes) 000873 1781218008.607089 read 0x015482 thru 0x01fde6 (0xa965 bytes) 000876 1781218008.624543 trunc from 0x01fde7 to 0x032e4b (0x13065 bytes) 000877 1781218008.669837 trunc from 0x032e4c to 0x032686 (0x7c5 bytes) 000880 1781218008.699059 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x32687): Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32687): Mirror 24: 0x2e7eacd4 (stale) Mirror 25: 0x2e7eacd4 (stale) Mirror 26: 0x2e7eacd4 (stale) Mirror 27: 0x2e7eacd4 (stale) Mirror 28: 0x44190e0 (stale) CRC-32 checksum value for chunk [0, 0x32687): Mirror 1: 0x44190e0 Mirror 29: 0x44190e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32687: skipped 000884 1781218009.904793 trunc from 0x032687 to 0x02706e (0xb618 bytes) 000885 1781218010.016191 mapwrite 0x02765f thru 0x02e651 (0x6ff3 bytes) 000888 1781218010.205490 read 0x02d569 thru 0x02e651 (0x10e9 bytes) 000889 1781218010.209538 read 0x014e9b thru 0x019184 (0x42ea bytes) 000890 1781218010.225455 trunc from 0x02e652 to 0x00c6cb (0x21f86 bytes) 000891 1781218010.252539 mapwrite 0x017db8 thru 0x01f232 (0x747b bytes) 000892 1781218010.410990 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1f233): Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f233): Mirror 24: 0x9d12ac04 (stale) Mirror 25: 0x9d12ac04 (stale) Mirror 26: 0x9d12ac04 (stale) Mirror 27: 0x9d12ac04 (stale) Mirror 28: 0xa6cf3747 (stale) Mirror 29: 0xa6cf3747 (stale) CRC-32 checksum value for chunk [0, 0x1f233): Mirror 1: 0x6d794c97 Mirror 30: 0x6d794c97 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f233: skipped 000893 1781218011.420841 mapwrite 0x03fc5a thru 0x03ffff (0x3a6 bytes) 000899 1781218011.644684 write 0x022018 thru 0x022f5c (0xf45 bytes) 000901 1781218011.653190 write 0x01a192 thru 0x027143 (0xcfb2 bytes) 000903 1781218011.677207 MIRROR_RESYNC 8 mirrors 000904 1781218013.961011 write 0x021ccc thru 0x026687 (0x49bc bytes) 000905 1781218014.080536 write 0x020ea6 thru 0x024b38 (0x3c93 bytes) 000907 1781218014.109102 mapread 0x00a3f0 thru 0x01163c (0x724d bytes) 000910 1781218014.143380 MIRROR_RESYNC 8 mirrors 000911 1781218016.024923 read 0x01a2d5 thru 0x01e44e (0x417a bytes) 000913 1781218016.036634 trunc from 0x040000 to 0x03b207 (0x4df8 bytes) 000914 1781218016.153807 write 0x0034dc thru 0x012e67 (0xf98c bytes) 000917 1781218016.171774 read 0x011305 thru 0x0199e0 (0x86dc bytes) 000920 1781218016.186942 write 0x0389ad thru 0x03cf3a (0x458e bytes) 000922 1781218016.190834 read 0x027231 thru 0x036603 (0xf3d3 bytes) 000926 1781218016.196472 write 0x000e00 thru 0x00863a (0x783b bytes) 000928 1781218016.200685 write 0x022514 thru 0x026b97 (0x4684 bytes) 000929 1781218016.203479 mapread 0x02083b thru 0x020924 (0xea bytes) 000931 1781218016.211052 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3cf3b): Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cf3b): Mirror 24: 0xa690f54c (stale) Mirror 25: 0xa690f54c (stale) Mirror 26: 0xa690f54c (stale) Mirror 27: 0xa690f54c (stale) Mirror 28: 0xa690f54c (stale) Mirror 29: 0xa690f54c (stale) Mirror 30: 0xa690f54c (stale) CRC-32 checksum value for chunk [0, 0x3cf3b): Mirror 1: 0x5f73ba75 Mirror 31: 0x5f73ba75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cf3b: skipped 000932 1781218017.620437 mapwrite 0x0133cb thru 0x01770f (0x4345 bytes) 000934 1781218018.004700 write 0x02f8ad thru 0x03db34 (0xe288 bytes) 000936 1781218018.035551 trunc from 0x03db35 to 0x01d773 (0x203c1 bytes) 000937 1781218018.100125 read 0x01b418 thru 0x01d773 (0x235c bytes) 000938 1781218018.107036 mapwrite 0x017e7f thru 0x01ff37 (0x80b9 bytes) 000940 1781218018.190835 read 0x00a1e3 thru 0x00eef1 (0x4d0f bytes) 000941 1781218018.206170 mapread 0x01ad9a thru 0x01dbe9 (0x2e50 bytes) 000943 1781218018.208781 mapwrite 0x00a05d thru 0x0178b8 (0xd85c bytes) 000944 1781218018.290518 MIRROR_RESYNC 9 mirrors 000945 1781218020.551835 write 0x025e0f thru 0x0271ef (0x13e1 bytes) 000946 1781218020.798477 trunc from 0x0271f0 to 0x02bd50 (0x4b61 bytes) 000947 1781218020.858257 mapread 0x0031df thru 0x009f80 (0x6da2 bytes) 000948 1781218020.921332 mapwrite 0x012d30 thru 0x01814c (0x541d bytes) 000949 1781218021.058752 mapwrite 0x0347b2 thru 0x03e176 (0x99c5 bytes) 000950 1781218021.177326 write 0x01060d thru 0x0122b4 (0x1ca8 bytes) 000951 1781218021.180463 read 0x025ad6 thru 0x034d17 (0xf242 bytes) 000952 1781218021.199630 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3e177): Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e177): Mirror 24: 0x1d193c13 (stale) Mirror 25: 0x1d193c13 (stale) Mirror 26: 0x1d193c13 (stale) Mirror 27: 0x1d193c13 (stale) Mirror 28: 0x1d193c13 (stale) Mirror 29: 0x1d193c13 (stale) Mirror 30: 0x1d193c13 (stale) Mirror 31: 0x1d193c13 (stale) CRC-32 checksum value for chunk [0, 0x3e177): Mirror 1: 0xb3ec639d Mirror 32: 0xb3ec639d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e177: skipped 000953 1781218022.820952 mapwrite 0x00ab1d thru 0x019693 (0xeb77 bytes) 000954 1781218023.059749 write 0x021575 thru 0x0234b3 (0x1f3f bytes) 000955 1781218023.071469 read 0x005338 thru 0x008087 (0x2d50 bytes) 000956 1781218023.078298 MIRROR_RESYNC 10 mirrors 000957 1781218025.724249 read 0x014f31 thru 0x019bd6 (0x4ca6 bytes) 000958 1781218025.746710 read 0x033085 thru 0x03e176 (0xb0f2 bytes) 000960 1781218025.779788 mapwrite 0x00df8c thru 0x00fefb (0x1f70 bytes) 000962 1781218026.107033 trunc from 0x03e177 to 0x03a882 (0x38f4 bytes) 000963 1781218026.169378 trunc from 0x03a883 to 0x03d461 (0x2bdf bytes) 000965 1781218026.211591 mapwrite 0x020847 thru 0x02d310 (0xcaca bytes) 000966 1781218026.542090 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d462): Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d462): Mirror 24: 0xea21b071 (stale) Mirror 25: 0xea21b071 (stale) Mirror 26: 0xea21b071 (stale) Mirror 27: 0xea21b071 (stale) Mirror 28: 0xea21b071 (stale) Mirror 29: 0xea21b071 (stale) Mirror 30: 0xea21b071 (stale) Mirror 31: 0xea21b071 (stale) Mirror 32: 0xea21b071 (stale) CRC-32 checksum value for chunk [0, 0x3d462): Mirror 1: 0xccca9be3 Mirror 33: 0xccca9be3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d462: skipped 000967 1781218028.111572 mapwrite 0x03dc0a thru 0x03ffff (0x23f6 bytes) 000968 1781218028.442323 mapwrite 0x00ac79 thru 0x015ba4 (0xaf2c bytes) 000969 1781218028.619836 read 0x00f11d thru 0x01db21 (0xea05 bytes) 000971 1781218028.628088 mapwrite 0x01ec58 thru 0x0271c1 (0x856a bytes) 000972 1781218028.699178 read 0x028698 thru 0x029a43 (0x13ac bytes) 000973 1781218028.700740 mapread 0x03f7b6 thru 0x03ffff (0x84a bytes) 000977 1781218028.707431 trunc from 0x040000 to 0x00aa92 (0x3556d bytes) 000978 1781218028.741306 mapwrite 0x031ef8 thru 0x036dee (0x4ef7 bytes) 000979 1781218028.882672 mapwrite 0x03ba49 thru 0x03ffff (0x45b7 bytes) 000983 1781218029.073544 read 0x02552f thru 0x032c96 (0xd768 bytes) 000984 1781218029.078467 trunc from 0x040000 to 0x022f69 (0x1d096 bytes) 000985 1781218029.161680 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x22f6a): Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22f6a): Mirror 24: 0x44e7e78f (stale) Mirror 25: 0x44e7e78f (stale) Mirror 26: 0x44e7e78f (stale) Mirror 27: 0x44e7e78f (stale) Mirror 28: 0x44e7e78f (stale) Mirror 29: 0x44e7e78f (stale) Mirror 30: 0x44e7e78f (stale) Mirror 31: 0x44e7e78f (stale) Mirror 32: 0x44e7e78f (stale) Mirror 33: 0x8bf232ad (stale) CRC-32 checksum value for chunk [0, 0x22f6a): Mirror 1: 0x80b637a1 Mirror 34: 0x80b637a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22f6a: skipped 000986 1781218030.685446 trunc from 0x022f6a to 0x01e758 (0x4811 bytes) 000987 1781218030.856146 read 0x00500a thru 0x006388 (0x137f bytes) 000990 1781218030.872296 trunc from 0x01e759 to 0x03ab2f (0x1c3d7 bytes) 000991 1781218030.915399 mapwrite 0x028c53 thru 0x0382d5 (0xf683 bytes) 000992 1781218031.099647 write 0x0073b7 thru 0x008c64 (0x18ae bytes) 000993 1781218031.155230 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3ab30): Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab30): Mirror 24: 0x36286517 (stale) Mirror 25: 0x36286517 (stale) Mirror 26: 0x36286517 (stale) Mirror 27: 0x36286517 (stale) Mirror 28: 0x36286517 (stale) Mirror 29: 0x36286517 (stale) Mirror 30: 0x36286517 (stale) Mirror 31: 0x36286517 (stale) Mirror 32: 0x36286517 (stale) Mirror 33: 0xc5dcc57f (stale) Mirror 34: 0xad69f7b3 (stale) CRC-32 checksum value for chunk [0, 0x3ab30): Mirror 1: 0x30ec2e36 Mirror 35: 0x30ec2e36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab30: skipped 000994 1781218033.039384 write 0x018056 thru 0x0202b2 (0x825d bytes) 000995 1781218033.246950 read 0x0146d1 thru 0x022145 (0xda75 bytes) 000996 1781218033.282991 trunc from 0x03ab30 to 0x00dc75 (0x2ceba bytes) 000997 1781218033.344937 write 0x032ce3 thru 0x039f82 (0x72a0 bytes) 000999 1781218033.348349 trunc from 0x039f83 to 0x030a55 (0x952d bytes) 001000 1781218033.407810 mapwrite 0x023593 thru 0x026004 (0x2a72 bytes) All operations completed A-OK!