== sanity-flr test 70a: flr mode fsx test ================ 13:54:30 (1788198870) Seed set to 8873 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1b02e 000002 1788198873.691110 trunc from 00000000 to 0x01b02d (0x1b02e bytes) 000003 1788198873.732430 mapwrite 0x005d03 thru 0x011881 (0xbb7f bytes) 000004 1788198874.010556 write 0x01ae3a thru 0x0259d1 (0xab98 bytes) 000005 1788198874.032360 mapread 0x0253e6 thru 0x0259d1 (0x5ec bytes) 000007 1788198874.038577 trunc from 0x0259d2 to 0x01a105 (0xb8cc bytes) 000009 1788198874.075125 punch from 0x004c7f to 0x01070d (0xba8f bytes) 000010 1788198874.108341 read 0x007d0c thru 0x012ed0 (0xb1c5 bytes) truncating to largest ever: 0x242ae 000012 1788198874.134572 trunc from 0x01a106 to 0x0242ad (0xa1a8 bytes) 000013 1788198874.179764 MIRROR_EXTEND to 2 mirrors 000016 1788198875.598299 write 0x028987 thru 0x036943 (0xdfbd bytes) 000017 1788198875.670550 punch from 0x01017b to 0x01c3dc (0xc262 bytes) 000018 1788198875.683341 trunc from 0x036944 to 0x01f410 (0x17533 bytes) truncating to largest ever: 0x2db66 000019 1788198875.718276 trunc from 0x01f411 to 0x02db65 (0xe755 bytes) 000020 1788198875.765006 write 0x007161 thru 0x00ce41 (0x5ce1 bytes) 000021 1788198875.782421 write 0x01d879 thru 0x021654 (0x3ddc bytes) 000022 1788198875.803271 read 0x028775 thru 0x02c0b5 (0x3941 bytes) truncating to largest ever: 0x30b0d 000026 1788198875.814614 trunc from 0x02db66 to 0x030b0c (0x2fa7 bytes) 000027 1788198875.831368 punch from 0x030676 to 0x030b0c (0x497 bytes) 000028 1788198875.852115 read 0x00e61b thru 0x014f10 (0x68f6 bytes) 000030 1788198875.867924 mapwrite 0x03dc02 thru 0x03ffff (0x23fe bytes) 000032 1788198876.033494 punch from 0x03ba88 to 0x03c456 (0x9cf bytes) 000034 1788198876.044537 write 0x02ead2 thru 0x037133 (0x8662 bytes) 000037 1788198876.049310 trunc from 0x040000 to 0x0114ee (0x2eb11 bytes) 000038 1788198876.094951 write 0x023c5e thru 0x03088e (0xcc31 bytes) 000039 1788198876.098238 read 0x02c8f5 thru 0x03088e (0x3f9a bytes) 000040 1788198876.099726 punch from 0x013403 to 0x014b07 (0x1705 bytes) 000042 1788198876.129514 read 0x00e4ec thru 0x016c38 (0x874d bytes) 000045 1788198876.166951 mapwrite 0x000437 thru 0x000fc2 (0xb8c bytes) truncating to largest ever: 0x39af2 000046 1788198876.260777 trunc from 0x03088f to 0x039af1 (0x9263 bytes) 000048 1788198876.286613 mapwrite 0x02eaeb thru 0x02ff5d (0x1473 bytes) 000049 1788198876.340830 punch from 0x038a33 to 0x039af1 (0x10bf bytes) 000050 1788198876.356630 punch from 0x024a01 to 0x02c4e1 (0x7ae1 bytes) 000051 1788198876.366937 read 0x030467 thru 0x0380f4 (0x7c8e bytes) 000053 1788198876.387125 trunc from 0x039af2 to 0x033efc (0x5bf5 bytes) 000054 1788198876.416640 trunc from 0x033efd to 0x00397d (0x3057f bytes) 000055 1788198876.462813 trunc from 0x00397e to 0x009af2 (0x6175 bytes) 000057 1788198876.490741 write 0x02273d thru 0x029e08 (0x76cc bytes) 000058 1788198876.492325 write 0x012799 thru 0x01744e (0x4cb6 bytes) 000061 1788198876.512840 punch from 0x00733e to 0x00be87 (0x4b4a bytes) 000063 1788198876.533575 trunc from 0x029e09 to 0x020391 (0x9a77 bytes) 000064 1788198876.589025 read 0x018c47 thru 0x01dab0 (0x4e6a bytes) 000065 1788198876.613734 read 0x017167 thru 0x018af0 (0x198a bytes) 000067 1788198876.617330 write 0x03a127 thru 0x03ffff (0x5ed9 bytes) 000068 1788198876.621097 mapwrite 0x01b445 thru 0x022681 (0x723d bytes) 000069 1788198876.748188 write 0x003687 thru 0x00d4d3 (0x9e4d bytes) 000070 1788198876.761425 mapread 0x02cb35 thru 0x02fa71 (0x2f3d bytes) 000071 1788198876.762436 write 0x019bd2 thru 0x027f5a (0xe389 bytes) 000072 1788198876.763803 punch from 0x029862 to 0x02efc5 (0x5764 bytes) 000073 1788198876.814555 trunc from 0x040000 to 0x0332c3 (0xcd3c bytes) 000074 1788198876.837940 write 0x02829c thru 0x02ef2f (0x6c94 bytes) 000075 1788198876.870600 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x332c4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x332c4): Mirror 2: 0x9a42df68 (stale) CRC-32 checksum value for chunk [0, 0x332c4): Mirror 1: 0x910f6113 Mirror 3: 0x910f6113 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x332c4: skipped 000077 1788198878.185283 mapwrite 0x02ed96 thru 0x037574 (0x87df bytes) 000078 1788198878.488892 mapwrite 0x03c722 thru 0x03de55 (0x1734 bytes) 000080 1788198878.684798 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3de56): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de56): Mirror 2: 0xaacef890 (stale) Mirror 3: 0xc92106b4 (stale) CRC-32 checksum value for chunk [0, 0x3de56): Mirror 1: 0x714ecb9c Mirror 4: 0x714ecb9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de56: skipped 000081 1788198880.699110 punch from 0x0203c8 to 0x022773 (0x23ac bytes) 000083 1788198880.813130 MIRROR_RESYNC 4 mirrors 000084 1788198882.454346 mapwrite 0x010d35 thru 0x01ed0f (0xdfdb bytes) 000086 1788198882.779539 write 0x0017a7 thru 0x00c48f (0xace9 bytes) 000088 1788198882.796809 punch from 0x0376b6 to 0x03de55 (0x67a0 bytes) 000089 1788198882.838138 read 0x02fc91 thru 0x03b2a6 (0xb616 bytes) 000090 1788198882.864729 read 0x009c1c thru 0x0193e8 (0xf7cd bytes) 000092 1788198882.872816 write 0x025315 thru 0x02f1c1 (0x9ead bytes) 000093 1788198882.894769 mapwrite 0x000e1d thru 0x00e51f (0xd703 bytes) 000094 1788198883.060177 write 0x0252db thru 0x0338f0 (0xe616 bytes) 000095 1788198883.081024 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3de56): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de56): Mirror 2: 0x5c717057 (stale) Mirror 3: 0x5c717057 (stale) Mirror 4: 0x5c717057 (stale) CRC-32 checksum value for chunk [0, 0x3de56): Mirror 1: 0x632b31e9 Mirror 5: 0x632b31e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de56: skipped 000096 1788198885.665846 mapwrite 0x03cc88 thru 0x03ffff (0x3378 bytes) 000097 1788198885.976843 punch from 0x033482 to 0x03b72c (0x82ab bytes) 000098 1788198885.998069 punch from 0x03438f to 0x03ffff (0xbc71 bytes) 000099 1788198886.009366 write 0x02acfb thru 0x039645 (0xe94b bytes) 000100 1788198886.037870 trunc from 0x040000 to 0x00fb9b (0x30464 bytes) 000101 1788198886.115814 punch from 0x004017 to 0x00dccb (0x9cb5 bytes) 000102 1788198886.136157 write 0x036568 thru 0x03959c (0x3035 bytes) 000103 1788198886.138350 mapread 0x01ff1c thru 0x02c4d9 (0xc5be bytes) 000104 1788198886.158327 trunc from 0x03959d to 0x01d02f (0x1c56d bytes) 000107 1788198886.171100 mapread 0x00a32a thru 0x013f26 (0x9bfd bytes) 000110 1788198886.182479 trunc from 0x01d030 to 0x032944 (0x15915 bytes) 000113 1788198886.194586 mapread 0x0275cc thru 0x031bce (0xa603 bytes) 000114 1788198886.203713 read 0x02cddc thru 0x032944 (0x5b69 bytes) 000115 1788198886.207418 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x32945): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32945): Mirror 2: 0xb57207d0 (stale) Mirror 3: 0xb57207d0 (stale) Mirror 4: 0xb57207d0 (stale) Mirror 5: 0xc48ff395 (stale) CRC-32 checksum value for chunk [0, 0x32945): Mirror 1: 0xa579218c Mirror 6: 0xa579218c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32945: skipped 000116 1788198887.809486 mapwrite 0x011ebf thru 0x014c6c (0x2dae bytes) 000118 1788198888.025030 mapread 0x021455 thru 0x024eb3 (0x3a5f bytes) 000120 1788198888.037685 mapread 0x00d6db thru 0x01c51d (0xee43 bytes) 000121 1788198888.039034 mapread 0x0126ab thru 0x01d4d9 (0xae2f bytes) 000122 1788198888.040904 write 0x01b83d thru 0x026c19 (0xb3dd bytes) 000124 1788198888.043268 mapread 0x026919 thru 0x02920e (0x28f6 bytes) 000125 1788198888.044823 punch from 0x0172f9 to 0x01e555 (0x725d bytes) 000126 1788198888.062169 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x32945): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32945): Mirror 2: 0xb57207d0 (stale) Mirror 3: 0xb57207d0 (stale) Mirror 4: 0xb57207d0 (stale) Mirror 5: 0xc48ff395 (stale) Mirror 6: 0xa579218c (stale) CRC-32 checksum value for chunk [0, 0x32945): Mirror 1: 0x61a3f94f Mirror 7: 0x61a3f94f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32945: skipped 000127 1788198889.143472 read 0x004b8a thru 0x00c3ba (0x7831 bytes) 000128 1788198889.162006 MIRROR_RESYNC 7 mirrors 000129 1788198891.606253 write 0x012a2f thru 0x0186d2 (0x5ca4 bytes) 000130 1788198891.838116 mapwrite 0x032d86 thru 0x03527e (0x24f9 bytes) 000131 1788198892.055073 read 0x018577 thru 0x0277c3 (0xf24d bytes) 000132 1788198892.071963 read 0x009da5 thru 0x011735 (0x7991 bytes) 000134 1788198892.083229 punch from 0x033612 to 0x03527e (0x1c6d bytes) 000135 1788198892.095794 MIRROR_RESYNC 7 mirrors 000136 1788198893.691401 mapread 0x028cdf thru 0x031a31 (0x8d53 bytes) 000138 1788198893.751103 punch from 0x00b943 to 0x00ef31 (0x35ef bytes) 000140 1788198893.939173 write 0x008338 thru 0x00ef66 (0x6c2f bytes) 000142 1788198893.985339 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3527f): Mirror 2: 0x799d5caf (stale) Mirror 4: 0x799d5caf (stale) Mirror 5: 0x799d5caf (stale) Mirror 6: 0x799d5caf (stale) Mirror 7: 0x799d5caf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3527f): Mirror 2: 0x799d5caf (stale) Mirror 4: 0x799d5caf (stale) Mirror 5: 0x799d5caf (stale) Mirror 6: 0x799d5caf (stale) Mirror 7: 0x799d5caf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3527f: skipped 000143 1788198894.519048 mapwrite 0x01645c thru 0x02478f (0xe334 bytes) 000145 1788198894.646088 punch from 0x01e421 to 0x020b4b (0x272b bytes) 000146 1788198894.652412 mapwrite 0x0054ad thru 0x0127b1 (0xd305 bytes) truncating to largest ever: 0x3adca 000147 1788198894.707854 trunc from 0x03527f to 0x03adc9 (0x5b4b bytes) 000149 1788198894.742422 write 0x01dbfc thru 0x02b4f0 (0xd8f5 bytes) 000150 1788198894.748586 trunc from 0x03adca to 0x020613 (0x1a7b6 bytes) 000152 1788198894.802113 read 0x01e044 thru 0x020613 (0x25d0 bytes) 000155 1788198894.806926 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x20614): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20614): Mirror 2: 0xcf8cf8a0 (stale) Mirror 4: 0xcf8cf8a0 (stale) Mirror 5: 0xcf8cf8a0 (stale) Mirror 6: 0xcf8cf8a0 (stale) Mirror 7: 0xcf8cf8a0 (stale) CRC-32 checksum value for chunk [0, 0x20614): Mirror 1: 0x3149f7e6 Mirror 8: 0x3149f7e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20614: skipped 000156 1788198896.038080 write 0x0131a6 thru 0x01fdb6 (0xcc11 bytes) 000157 1788198896.175112 mapwrite 0x03bdeb thru 0x03ffff (0x4215 bytes) 000159 1788198896.367088 trunc from 0x040000 to 0x016f66 (0x29099 bytes) 000160 1788198896.397339 MIRROR_RESYNC 7 mirrors 000161 1788198898.122268 write 0x00d48d thru 0x0194cb (0xc03f bytes) 000162 1788198898.195131 write 0x03967f thru 0x03ffff (0x6981 bytes) 000163 1788198898.197118 mapread 0x01e240 thru 0x02c677 (0xe438 bytes) 000165 1788198898.218091 punch from 0x00d79f to 0x00ea05 (0x1267 bytes) 000167 1788198898.233343 write 0x019605 thru 0x01b683 (0x207f bytes) 000168 1788198898.235062 trunc from 0x040000 to 0x019404 (0x26bfb bytes) 000170 1788198898.254983 write 0x0383b9 thru 0x03e8a5 (0x64ed bytes) 000171 1788198898.258417 punch from 0x03781c to 0x03bf51 (0x4736 bytes) 000172 1788198898.271618 write 0x0396c2 thru 0x03ffff (0x693e bytes) 000173 1788198898.277178 write 0x021a5e thru 0x02a057 (0x85fa bytes) 000174 1788198898.287326 write 0x02f205 thru 0x0372c7 (0x80c3 bytes) 000175 1788198898.297680 mapread 0x012ad6 thru 0x0148a9 (0x1dd4 bytes) 000176 1788198898.303005 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xee650da3 (stale) Mirror 4: 0xee650da3 (stale) Mirror 5: 0xee650da3 (stale) Mirror 6: 0xee650da3 (stale) Mirror 8: 0xee650da3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xee650da3 (stale) Mirror 4: 0xee650da3 (stale) Mirror 5: 0xee650da3 (stale) Mirror 6: 0xee650da3 (stale) Mirror 8: 0xee650da3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000177 1788198898.795492 mapwrite 0x03bee0 thru 0x03ffff (0x4120 bytes) 000179 1788198898.913773 trunc from 0x040000 to 0x023ac6 (0x1c539 bytes) 000180 1788198899.030174 punch from 0x015baa to 0x018969 (0x2dc0 bytes) 000182 1788198899.050109 punch from 0x000863 to 0x0034e1 (0x2c7f bytes) 000183 1788198899.089431 punch from 0x007b10 to 0x017a13 (0xff04 bytes) 000184 1788198899.116636 read 0x0184dc thru 0x018a23 (0x548 bytes) 000185 1788198899.122727 mapwrite 0x001dc9 thru 0x0046c9 (0x2901 bytes) 000186 1788198899.258556 read 0x01d003 thru 0x023ac6 (0x6ac4 bytes) 000187 1788198899.322884 MIRROR_RESYNC 6 mirrors 000188 1788198901.138763 mapwrite 0x009f96 thru 0x014ce3 (0xad4e bytes) 000189 1788198901.490847 mapread 0x00fc26 thru 0x015322 (0x56fd bytes) 000191 1788198901.495112 write 0x03b743 thru 0x03e33c (0x2bfa bytes) 000192 1788198901.497038 read 0x0032a6 thru 0x00b3d6 (0x8131 bytes) 000193 1788198901.503031 punch from 0x00eb7c to 0x01e006 (0xf48b bytes) 000195 1788198901.530134 read 0x0137b9 thru 0x0222f1 (0xeb39 bytes) 000196 1788198901.576011 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e33d): Mirror 4: 0xe4f818c9 (stale) Mirror 5: 0xe4f818c9 (stale) Mirror 6: 0xe4f818c9 (stale) Mirror 8: 0xe4f818c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e33d): Mirror 4: 0xe4f818c9 (stale) Mirror 5: 0xe4f818c9 (stale) Mirror 6: 0xe4f818c9 (stale) Mirror 8: 0xe4f818c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e33d: skipped 000197 1788198902.472594 read 0x010eb2 thru 0x01f284 (0xe3d3 bytes) 000199 1788198902.507764 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e33d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e33d): Mirror 4: 0xe4f818c9 (stale) Mirror 5: 0xe4f818c9 (stale) Mirror 6: 0xe4f818c9 (stale) Mirror 8: 0xe4f818c9 (stale) CRC-32 checksum value for chunk [0, 0x3e33d): Mirror 1: 0x19289ab2 Mirror 9: 0x19289ab2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e33d: skipped 000201 1788198903.886372 mapread 0x038c5e thru 0x03e33c (0x56df bytes) 000202 1788198903.956876 mapread 0x021806 thru 0x03130c (0xfb07 bytes) 000203 1788198904.023388 read 0x030780 thru 0x030f31 (0x7b2 bytes) 000204 1788198904.040551 mapwrite 0x007bb5 thru 0x00b100 (0x354c bytes) 000205 1788198904.382376 read 0x03d7f3 thru 0x03e33c (0xb4a bytes) 000208 1788198904.404979 read 0x031fb5 thru 0x039f2d (0x7f79 bytes) 000209 1788198904.406077 write 0x028437 thru 0x035a89 (0xd653 bytes) 000210 1788198904.407952 mapread 0x0315a5 thru 0x03acdc (0x9738 bytes) 000211 1788198904.423433 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e33d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e33d): Mirror 4: 0xe4f818c9 (stale) Mirror 5: 0xe4f818c9 (stale) Mirror 6: 0xe4f818c9 (stale) Mirror 8: 0xe4f818c9 (stale) Mirror 9: 0x19289ab2 (stale) CRC-32 checksum value for chunk [0, 0x3e33d): Mirror 1: 0xf963ac24 Mirror 10: 0xf963ac24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e33d: skipped 000213 1788198906.029291 trunc from 0x03e33d to 0x014454 (0x29ee8 bytes) 000216 1788198906.167004 trunc from 0x014455 to 0x026d45 (0x128f1 bytes) 000218 1788198906.207850 read 0x00cd17 thru 0x01a8c3 (0xdbad bytes) 000220 1788198906.224929 mapwrite 0x021760 thru 0x02d51a (0xbdbb bytes) 000222 1788198906.345760 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d51b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d51b): Mirror 4: 0xba46f20a (stale) Mirror 5: 0xba46f20a (stale) Mirror 6: 0xba46f20a (stale) Mirror 8: 0xba46f20a (stale) Mirror 9: 0x7d196f55 (stale) Mirror 10: 0xb4a62140 (stale) CRC-32 checksum value for chunk [0, 0x2d51b): Mirror 1: 0xf9d8ce4 Mirror 11: 0xf9d8ce4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d51b: skipped 000223 1788198907.706487 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2d51b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d51b): Mirror 4: 0xba46f20a (stale) Mirror 5: 0xba46f20a (stale) Mirror 6: 0xba46f20a (stale) Mirror 8: 0xba46f20a (stale) Mirror 9: 0x7d196f55 (stale) Mirror 10: 0xb4a62140 (stale) CRC-32 checksum value for chunk [0, 0x2d51b): Mirror 1: 0xf9d8ce4 Mirror 11: 0xf9d8ce4 Mirror 12: 0xf9d8ce4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d51b: skipped 000224 1788198908.950934 write 0x02abf0 thru 0x02f81e (0x4c2f bytes) 000225 1788198909.072973 write 0x03741c thru 0x03e4a9 (0x708e bytes) 000226 1788198909.074628 trunc from 0x03e4aa to 0x01fa67 (0x1ea42 bytes) 000228 1788198909.117350 trunc from 0x01fa68 to 0x017d7d (0x7cea bytes) 000229 1788198909.152744 punch from 0x0145ff to 0x015179 (0xb7b bytes) 000230 1788198909.186446 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x17d7e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17d7e): Mirror 4: 0xe638d129 (stale) Mirror 5: 0xe638d129 (stale) Mirror 6: 0xe638d129 (stale) Mirror 8: 0xe638d129 (stale) Mirror 9: 0xb5a7f673 (stale) Mirror 10: 0xb55cf5da (stale) Mirror 11: 0xb55cf5da (stale) Mirror 12: 0xb55cf5da (stale) CRC-32 checksum value for chunk [0, 0x17d7e): Mirror 1: 0xb55cf5da Mirror 13: 0xb55cf5da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17d7e: skipped 000231 1788198910.880443 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17d7e): Mirror 4: 0xe638d129 (stale) Mirror 5: 0xe638d129 (stale) Mirror 6: 0xe638d129 (stale) Mirror 8: 0xe638d129 (stale) Mirror 9: 0xb5a7f673 (stale) Mirror 11: 0xb55cf5da (stale) Mirror 12: 0xb55cf5da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17d7e): Mirror 4: 0xe638d129 (stale) Mirror 5: 0xe638d129 (stale) Mirror 6: 0xe638d129 (stale) Mirror 8: 0xe638d129 (stale) Mirror 9: 0xb5a7f673 (stale) Mirror 11: 0xb55cf5da (stale) Mirror 12: 0xb55cf5da (stale) CRC-32 checksum value for chunk [0, 0x17d7e): Mirror 1: 0xb55cf5da Mirror 13: 0xb55cf5da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17d7e: skipped 000234 1788198912.435396 read 0x013b5c thru 0x0163df (0x2884 bytes) 000235 1788198912.470458 read 0x002f5a thru 0x008931 (0x59d8 bytes) 000236 1788198912.501011 trunc from 0x017d7e to 0x028e53 (0x110d6 bytes) 000237 1788198912.635085 mapread 0x002241 thru 0x009a60 (0x7820 bytes) 000238 1788198912.718359 write 0x01374a thru 0x0181dc (0x4a93 bytes) 000239 1788198912.733931 read 0x00f0af thru 0x016a19 (0x796b bytes) 000240 1788198912.752683 mapread 0x01ad79 thru 0x02415c (0x93e4 bytes) 000241 1788198912.753847 trunc from 0x028e54 to 0x022c04 (0x624f bytes) 000242 1788198912.789837 mapread 0x0093aa thru 0x00b321 (0x1f78 bytes) 000243 1788198912.791430 mapread 0x001678 thru 0x005820 (0x41a9 bytes) 000244 1788198912.793910 punch from 0x01f527 to 0x022c04 (0x36de bytes) 000245 1788198912.812044 mapwrite 0x0327bd thru 0x03e8cd (0xc111 bytes) 000246 1788198912.907677 read 0x028203 thru 0x02eadc (0x68da bytes) 000247 1788198912.921083 MIRROR_RESYNC 9 mirrors 000248 1788198916.524377 read 0x027a0b thru 0x02a91a (0x2f10 bytes) 000249 1788198916.531371 mapwrite 0x01ba32 thru 0x01c656 (0xc25 bytes) 000250 1788198916.774812 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e8ce): Mirror 4: 0x76f1279b (stale) Mirror 5: 0x76f1279b (stale) Mirror 6: 0x76f1279b (stale) Mirror 8: 0x76f1279b (stale) Mirror 9: 0x76f1279b (stale) Mirror 11: 0x76f1279b (stale) Mirror 13: 0x76f1279b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e8ce): Mirror 4: 0x76f1279b (stale) Mirror 5: 0x76f1279b (stale) Mirror 6: 0x76f1279b (stale) Mirror 8: 0x76f1279b (stale) Mirror 9: 0x76f1279b (stale) Mirror 11: 0x76f1279b (stale) Mirror 13: 0x76f1279b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e8ce: skipped 000252 1788198917.434149 read 0x0028c4 thru 0x011390 (0xeacd bytes) 000253 1788198917.450798 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e8ce): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e8ce): Mirror 4: 0x76f1279b (stale) Mirror 5: 0x76f1279b (stale) Mirror 6: 0x76f1279b (stale) Mirror 8: 0x76f1279b (stale) Mirror 9: 0x76f1279b (stale) Mirror 11: 0x76f1279b (stale) Mirror 13: 0x76f1279b (stale) CRC-32 checksum value for chunk [0, 0x3e8ce): Mirror 1: 0xa3af4493 Mirror 14: 0xa3af4493 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e8ce: skipped 000254 1788198918.963783 punch from 0x00c088 to 0x0115dd (0x5556 bytes) 000255 1788198919.061767 write 0x00813f thru 0x008d5e (0xc20 bytes) 000256 1788198919.067915 trunc from 0x03e8ce to 0x02a02b (0x148a2 bytes) 000257 1788198919.089186 write 0x015a13 thru 0x01a2a3 (0x4891 bytes) 000258 1788198919.100028 read 0x022ad9 thru 0x026880 (0x3da8 bytes) 000259 1788198919.109627 trunc from 0x02a02c to 0x01da8c (0xc59f bytes) 000260 1788198919.131366 MIRROR_RESYNC 9 mirrors 000261 1788198921.425773 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) 000262 1788198921.809597 read 0x007834 thru 0x011ec5 (0xa692 bytes) 000263 1788198921.830804 mapread 0x00f168 thru 0x0158c8 (0x6761 bytes) 000268 1788198921.851603 mapwrite 0x000546 thru 0x0050b9 (0x4b74 bytes) 000270 1788198922.068839 trunc from 0x01da8d to 0x029bf0 (0xc164 bytes) 000271 1788198922.094853 mapwrite 0x0092ae thru 0x013bc8 (0xa91b bytes) 000273 1788198922.211923 punch from 0x00f395 to 0x016840 (0x74ac bytes) 000275 1788198922.223946 mapread 0x01b3db thru 0x01b631 (0x257 bytes) 000276 1788198922.239532 mapwrite 0x01cae8 thru 0x02b901 (0xee1a bytes) 000277 1788198922.341988 mapwrite 0x03b7ef thru 0x03ffff (0x4811 bytes) 000278 1788198922.440861 mapwrite 0x004a41 thru 0x012e2f (0xe3ef bytes) 000279 1788198922.515377 write 0x01f230 thru 0x02e79d (0xf56e bytes) 000280 1788198922.528308 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x67cb3a07 (stale) Mirror 6: 0x67cb3a07 (stale) Mirror 8: 0x67cb3a07 (stale) Mirror 9: 0x67cb3a07 (stale) Mirror 11: 0x67cb3a07 (stale) Mirror 13: 0x67cb3a07 (stale) Mirror 14: 0x67cb3a07 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfbe3a114 Mirror 15: 0xfbe3a114 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000281 1788198923.402620 mapwrite 0x001850 thru 0x00decb (0xc67c bytes) 000283 1788198923.649030 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x67cb3a07 (stale) Mirror 6: 0x67cb3a07 (stale) Mirror 8: 0x67cb3a07 (stale) Mirror 9: 0x67cb3a07 (stale) Mirror 11: 0x67cb3a07 (stale) Mirror 13: 0x67cb3a07 (stale) Mirror 14: 0x67cb3a07 (stale) Mirror 15: 0xfbe3a114 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x83991cc4 Mirror 16: 0x83991cc4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000284 1788198924.483254 punch from 0x008de8 to 0x00a4b7 (0x16d0 bytes) 000287 1788198924.584537 write 0x01ddda thru 0x020ae0 (0x2d07 bytes) 000290 1788198924.597163 mapwrite 0x01adab thru 0x026901 (0xbb57 bytes) 000291 1788198924.672660 read 0x030c49 thru 0x035018 (0x43d0 bytes) 000292 1788198924.682498 punch from 0x024e34 to 0x02ad01 (0x5ece bytes) 000293 1788198924.688099 read 0x0323fc thru 0x0324d2 (0xd7 bytes) 000295 1788198924.689660 mapwrite 0x0104ba thru 0x01b514 (0xb05b bytes) 000296 1788198924.750264 mapwrite 0x03a906 thru 0x03b887 (0xf82 bytes) 000297 1788198924.792675 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x67cb3a07 (stale) Mirror 6: 0x67cb3a07 (stale) Mirror 8: 0x67cb3a07 (stale) Mirror 9: 0x67cb3a07 (stale) Mirror 11: 0x67cb3a07 (stale) Mirror 13: 0x67cb3a07 (stale) Mirror 14: 0x67cb3a07 (stale) Mirror 15: 0xfbe3a114 (stale) Mirror 16: 0x83991cc4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe72d03f6 Mirror 17: 0xe72d03f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000298 1788198925.718914 mapread 0x01755f thru 0x021a36 (0xa4d8 bytes) 000299 1788198925.751705 mapread 0x03af58 thru 0x03ffff (0x50a8 bytes) 000302 1788198925.803053 mapread 0x03e1d0 thru 0x03ffff (0x1e30 bytes) 000303 1788198925.823471 mapwrite 0x01158c thru 0x01abf3 (0x9668 bytes) 000304 1788198926.025048 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x67cb3a07 (stale) Mirror 6: 0x67cb3a07 (stale) Mirror 8: 0x67cb3a07 (stale) Mirror 9: 0x67cb3a07 (stale) Mirror 11: 0x67cb3a07 (stale) Mirror 13: 0x67cb3a07 (stale) Mirror 14: 0x67cb3a07 (stale) Mirror 15: 0xfbe3a114 (stale) Mirror 16: 0x83991cc4 (stale) Mirror 17: 0xe72d03f6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa14a8627 Mirror 18: 0xa14a8627 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000305 1788198927.258440 trunc from 0x040000 to 0x007fa5 (0x3805a bytes) 000306 1788198927.381157 read 0x0037a6 thru 0x007fa5 (0x4800 bytes) 000307 1788198927.396112 write 0x02fab3 thru 0x02ff81 (0x4cf bytes) 000308 1788198927.401939 MIRROR_RESYNC 12 mirrors 000309 1788198932.079463 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) 000312 1788198932.898669 mapwrite 0x01ba9d thru 0x01bcbf (0x223 bytes) 000313 1788198933.254875 read 0x00f6cb thru 0x011fba (0x28f0 bytes) 000314 1788198933.262000 write 0x01e7c5 thru 0x026e76 (0x86b2 bytes) 000315 1788198933.273980 trunc from 0x02ff82 to 0x009781 (0x26800 bytes) 000316 1788198933.307941 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x9782): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9782): Mirror 5: 0x55b9013d (stale) Mirror 6: 0x55b9013d (stale) Mirror 8: 0x55b9013d (stale) Mirror 9: 0x55b9013d (stale) Mirror 11: 0x55b9013d (stale) Mirror 13: 0x55b9013d (stale) Mirror 14: 0x55b9013d (stale) Mirror 15: 0x55b9013d (stale) Mirror 17: 0x55b9013d (stale) Mirror 18: 0x55b9013d (stale) CRC-32 checksum value for chunk [0, 0x9782): Mirror 1: 0x55b9013d Mirror 19: 0x55b9013d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9782: skipped 000317 1788198934.592657 write 0x01e29e thru 0x02078d (0x24f0 bytes) 000318 1788198934.810390 write 0x0161f7 thru 0x01e155 (0x7f5f bytes) truncating to largest ever: 0x3bf2a 000319 1788198934.823751 trunc from 0x02078e to 0x03bf29 (0x1b79c bytes) 000322 1788198934.933682 mapwrite 0x0103af thru 0x0109e4 (0x636 bytes) 000324 1788198935.064022 punch from 0x013f2c to 0x018bde (0x4cb3 bytes) 000325 1788198935.070841 mapwrite 0x00f2a8 thru 0x01dc05 (0xe95e bytes) 000328 1788198935.275767 mapwrite 0x02a95e thru 0x034d4b (0xa3ee bytes) 000329 1788198935.479544 trunc from 0x03bf2a to 0x02c883 (0xf6a6 bytes) 000330 1788198935.534863 MIRROR_RESYNC 12 mirrors 000333 1788198938.644756 trunc from 0x02c884 to 0x02c196 (0x6ed bytes) 000334 1788198938.847442 MIRROR_RESYNC 12 mirrors 000335 1788198942.082356 MIRROR_EXTEND to 13 mirrors 000337 1788198943.433786 punch from 0x015fee to 0x019213 (0x3226 bytes) 000339 1788198943.588783 read 0x014fbf thru 0x01e807 (0x9849 bytes) 000340 1788198943.606044 punch from 0x01dfc9 to 0x02431f (0x6357 bytes) 000341 1788198943.613456 mapwrite 0x00cd7e thru 0x014569 (0x77ec bytes) 000343 1788198943.822983 mapread 0x02af1a thru 0x02c196 (0x127d bytes) 000344 1788198943.831903 mapread 0x01e37a thru 0x026c8b (0x8912 bytes) 000345 1788198943.862315 mapwrite 0x00d698 thru 0x0195f8 (0xbf61 bytes) 000346 1788198943.980068 write 0x01c588 thru 0x01d258 (0xcd1 bytes) 000347 1788198943.983965 write 0x0103d2 thru 0x017892 (0x74c1 bytes) 000348 1788198943.989183 read 0x018ffc thru 0x01cec4 (0x3ec9 bytes) 000349 1788198943.993929 read 0x01432d thru 0x020364 (0xc038 bytes) 000351 1788198943.995055 punch from 0x01699f to 0x018e52 (0x24b4 bytes) 000352 1788198944.041798 trunc from 0x02c197 to 0x02f73a (0x35a4 bytes) 000353 1788198944.068958 read 0x007c52 thru 0x00b71d (0x3acc bytes) 000354 1788198944.069687 trunc from 0x02f73b to 0x025457 (0xa2e3 bytes) 000355 1788198944.098939 MIRROR_RESYNC 13 mirrors 000356 1788198946.778871 read 0x01cd57 thru 0x025457 (0x8701 bytes) 000357 1788198946.811536 read 0x00bfdd thru 0x01a045 (0xe069 bytes) 000358 1788198946.894192 MIRROR_EXTEND to 14 mirrors 000359 1788198948.291635 MIRROR_RESYNC 14 mirrors 000360 1788198949.329950 punch from 0x01517d to 0x0238f5 (0xe779 bytes) 000363 1788198949.501875 mapread 0x01a178 thru 0x01b064 (0xeed bytes) 000364 1788198949.523283 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x25458): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25458): Mirror 5: 0x36aa96e9 (stale) Mirror 6: 0x36aa96e9 (stale) Mirror 8: 0x36aa96e9 (stale) Mirror 9: 0x36aa96e9 (stale) Mirror 11: 0x36aa96e9 (stale) Mirror 13: 0x36aa96e9 (stale) Mirror 14: 0x36aa96e9 (stale) Mirror 15: 0x36aa96e9 (stale) Mirror 17: 0x36aa96e9 (stale) Mirror 18: 0x36aa96e9 (stale) Mirror 19: 0x36aa96e9 (stale) Mirror 20: 0x36aa96e9 (stale) Mirror 21: 0x36aa96e9 (stale) CRC-32 checksum value for chunk [0, 0x25458): Mirror 1: 0xe4c85c4f Mirror 22: 0xe4c85c4f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25458: skipped 000365 1788198951.284359 mapread 0x01d8b7 thru 0x025457 (0x7ba1 bytes) 000366 1788198951.355491 read 0x0168b7 thru 0x016926 (0x70 bytes) 000369 1788198951.413848 mapread 0x0082bb thru 0x00ccd8 (0x4a1e bytes) 000370 1788198951.468583 read 0x024826 thru 0x025457 (0xc32 bytes) 000372 1788198951.501526 mapwrite 0x025b1d thru 0x025b8e (0x72 bytes) 000374 1788198951.788890 write 0x013dab thru 0x0224b4 (0xe70a bytes) 000377 1788198951.790597 read 0x00600c thru 0x013e8f (0xde84 bytes) 000378 1788198951.791060 mapwrite 0x03ec03 thru 0x03ffff (0x13fd bytes) 000381 1788198951.914918 mapwrite 0x0256b7 thru 0x028c8e (0x35d8 bytes) 000382 1788198951.963454 mapwrite 0x0373a5 thru 0x0373ac (0x8 bytes) 000383 1788198952.002068 punch from 0x00764d to 0x009b52 (0x2506 bytes) 000385 1788198952.009249 mapread 0x03efeb thru 0x03ffff (0x1015 bytes) 000387 1788198952.012030 read 0x030687 thru 0x032242 (0x1bbc bytes) 000388 1788198952.012984 trunc from 0x040000 to 0x03186e (0xe791 bytes) 000389 1788198952.035629 trunc from 0x03186f to 0x0330c3 (0x1855 bytes) 000390 1788198952.063092 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x330c4): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x330c4): Mirror 5: 0x96d47d17 (stale) Mirror 6: 0x96d47d17 (stale) Mirror 8: 0x96d47d17 (stale) Mirror 9: 0x96d47d17 (stale) Mirror 11: 0x96d47d17 (stale) Mirror 13: 0x96d47d17 (stale) Mirror 14: 0x96d47d17 (stale) Mirror 15: 0x96d47d17 (stale) Mirror 17: 0x96d47d17 (stale) Mirror 18: 0x96d47d17 (stale) Mirror 19: 0x96d47d17 (stale) Mirror 20: 0x96d47d17 (stale) Mirror 21: 0x96d47d17 (stale) Mirror 22: 0xeac670c6 (stale) CRC-32 checksum value for chunk [0, 0x330c4): Mirror 1: 0x9982d261 Mirror 23: 0x9982d261 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x330c4: skipped 000391 1788198953.555919 punch from 0x01dd3d to 0x029d26 (0xbfea bytes) 000392 1788198953.678680 read 0x004171 thru 0x00d0ce (0x8f5e bytes) 000395 1788198953.692592 MIRROR_SPLIT mirror 5 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x330c4): Mirror 5: 0x96d47d17 (stale) Mirror 6: 0x96d47d17 (stale) Mirror 8: 0x96d47d17 (stale) Mirror 9: 0x96d47d17 (stale) Mirror 13: 0x96d47d17 (stale) Mirror 14: 0x96d47d17 (stale) Mirror 15: 0x96d47d17 (stale) Mirror 17: 0x96d47d17 (stale) Mirror 18: 0x96d47d17 (stale) Mirror 19: 0x96d47d17 (stale) Mirror 20: 0x96d47d17 (stale) Mirror 21: 0x96d47d17 (stale) Mirror 22: 0xeac670c6 (stale) Mirror 23: 0x9982d261 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x330c4): Mirror 5: 0x96d47d17 (stale) Mirror 6: 0x96d47d17 (stale) Mirror 8: 0x96d47d17 (stale) Mirror 9: 0x96d47d17 (stale) Mirror 13: 0x96d47d17 (stale) Mirror 14: 0x96d47d17 (stale) Mirror 15: 0x96d47d17 (stale) Mirror 17: 0x96d47d17 (stale) Mirror 18: 0x96d47d17 (stale) Mirror 19: 0x96d47d17 (stale) Mirror 20: 0x96d47d17 (stale) Mirror 21: 0x96d47d17 (stale) Mirror 22: 0xeac670c6 (stale) Mirror 23: 0x9982d261 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x330c4: skipped 000398 1788198954.455873 punch from 0x00b956 to 0x010f05 (0x55b0 bytes) 000399 1788198954.461990 read 0x009b21 thru 0x017e96 (0xe376 bytes) 000400 1788198954.472078 punch from 0x009bc7 to 0x014c10 (0xb04a bytes) 000401 1788198954.476950 punch from 0x0225e2 to 0x02d16a (0xab89 bytes) 000402 1788198954.482400 mapwrite 0x02e40e thru 0x02f629 (0x121c bytes) 000405 1788198954.542716 trunc from 0x0330c4 to 0x01fc11 (0x134b2 bytes) 000410 1788198954.572391 punch from 0x005ee8 to 0x00883c (0x2955 bytes) 000411 1788198954.578721 mapread 0x002ed7 thru 0x003c0a (0xd34 bytes) 000412 1788198954.588545 mapread 0x01a8a7 thru 0x01fc11 (0x536b bytes) 000414 1788198954.609604 read 0x01da1a thru 0x01fc11 (0x21f8 bytes) 000419 1788198954.614603 mapwrite 0x025a1e thru 0x027209 (0x17ec bytes) 000420 1788198954.867183 punch from 0x014a95 to 0x018e13 (0x437f bytes) 000421 1788198954.885821 read 0x01afbe thru 0x01e37b (0x33be bytes) 000422 1788198954.886609 trunc from 0x02720a to 0x0126f0 (0x14b19 bytes) 000423 1788198954.941629 mapwrite 0x014c80 thru 0x016810 (0x1b91 bytes) 000424 1788198955.061842 read 0x00ef06 thru 0x016810 (0x790b bytes) 000426 1788198955.067462 mapread 0x00383e thru 0x00977a (0x5f3d bytes) 000430 1788198955.071843 write 0x007d7a thru 0x0110e3 (0x936a bytes) 000431 1788198955.074815 trunc from 0x016811 to 0x0025e4 (0x1422c bytes) 000432 1788198955.117592 write 0x03fde5 thru 0x03ffff (0x21b bytes) 000433 1788198955.119845 punch from 0x008a6f to 0x00d248 (0x47da bytes) 000434 1788198955.135314 mapread 0x032dae thru 0x03bfbd (0x9210 bytes) 000435 1788198955.161943 write 0x02b4f7 thru 0x03a021 (0xeb2b bytes) 000436 1788198955.169867 trunc from 0x040000 to 0x02f9be (0x10641 bytes) 000437 1788198955.200505 mapwrite 0x006348 thru 0x009708 (0x33c1 bytes) 000438 1788198955.248480 mapwrite 0x035376 thru 0x03aeb6 (0x5b41 bytes) 000439 1788198955.348974 mapread 0x002517 thru 0x010883 (0xe36d bytes) 000440 1788198955.350539 read 0x03675a thru 0x03aeb6 (0x475d bytes) 000441 1788198955.351832 mapread 0x00e914 thru 0x00fc84 (0x1371 bytes) 000443 1788198955.353982 read 0x02b06e thru 0x02c18d (0x1120 bytes) 000444 1788198955.355159 mapwrite 0x02fc59 thru 0x030a4d (0xdf5 bytes) 000445 1788198955.398937 punch from 0x03930b to 0x03aeb6 (0x1bac bytes) 000446 1788198955.404799 punch from 0x02c213 to 0x02f24e (0x303c bytes) 000447 1788198955.409948 read 0x007668 thru 0x00f263 (0x7bfc bytes) 000448 1788198955.410944 punch from 0x0249fb to 0x033178 (0xe77e bytes) 000450 1788198955.415526 write 0x017c04 thru 0x022408 (0xa805 bytes) 000452 1788198955.418008 mapread 0x020fea thru 0x02c20f (0xb226 bytes) 000453 1788198955.430447 MIRROR_SPLIT mirror 13 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aeb7): Mirror 5: 0x3bc37f83 (stale) Mirror 6: 0x3bc37f83 (stale) Mirror 8: 0x3bc37f83 (stale) Mirror 9: 0x3bc37f83 (stale) Mirror 13: 0x3bc37f83 (stale) Mirror 14: 0x3bc37f83 (stale) Mirror 15: 0x3bc37f83 (stale) Mirror 17: 0x3bc37f83 (stale) Mirror 18: 0x3bc37f83 (stale) Mirror 19: 0x3bc37f83 (stale) Mirror 20: 0x3bc37f83 (stale) Mirror 21: 0x3bc37f83 (stale) Mirror 23: 0x57422ad1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aeb7): Mirror 5: 0x3bc37f83 (stale) Mirror 6: 0x3bc37f83 (stale) Mirror 8: 0x3bc37f83 (stale) Mirror 9: 0x3bc37f83 (stale) Mirror 13: 0x3bc37f83 (stale) Mirror 14: 0x3bc37f83 (stale) Mirror 15: 0x3bc37f83 (stale) Mirror 17: 0x3bc37f83 (stale) Mirror 18: 0x3bc37f83 (stale) Mirror 19: 0x3bc37f83 (stale) Mirror 20: 0x3bc37f83 (stale) Mirror 21: 0x3bc37f83 (stale) Mirror 23: 0x57422ad1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aeb7: skipped 000454 1788198956.106307 read 0x001e86 thru 0x00ad84 (0x8eff bytes) 000455 1788198956.120180 write 0x024894 thru 0x026cf3 (0x2460 bytes) 000456 1788198956.134966 MIRROR_RESYNC 14 mirrors 000457 1788198958.307948 read 0x034f4a thru 0x03aeb6 (0x5f6d bytes) 000459 1788198958.318489 mapread 0x00955f thru 0x00ba8a (0x252c bytes) 000460 1788198958.336835 punch from 0x00c9b2 to 0x016d84 (0xa3d3 bytes) 000461 1788198958.451343 mapwrite 0x00e46d thru 0x018d7a (0xa90e bytes) 000462 1788198958.598612 trunc from 0x03aeb7 to 0x00ceab (0x2e00b bytes) 000464 1788198958.648678 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0xceac): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xceac): Mirror 5: 0xa2824977 (stale) Mirror 6: 0xa2824977 (stale) Mirror 8: 0xa2824977 (stale) Mirror 9: 0xa2824977 (stale) Mirror 13: 0xa2824977 (stale) Mirror 14: 0xa2824977 (stale) Mirror 15: 0xa2824977 (stale) Mirror 17: 0xa2824977 (stale) Mirror 18: 0xa2824977 (stale) Mirror 19: 0xa2824977 (stale) Mirror 20: 0xa2824977 (stale) Mirror 21: 0xa2824977 (stale) Mirror 23: 0xa2824977 (stale) CRC-32 checksum value for chunk [0, 0xceac): Mirror 1: 0xa2824977 Mirror 24: 0xa2824977 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xceac: skipped 000466 1788198960.558826 read 0x009a3d thru 0x00b219 (0x17dd bytes) 000467 1788198960.578621 read 0x0009a4 thru 0x008ac7 (0x8124 bytes) 000468 1788198960.602985 mapwrite 0x033618 thru 0x03a990 (0x7379 bytes) 000469 1788198960.816533 write 0x0203d2 thru 0x021230 (0xe5f bytes) 000470 1788198960.818950 mapwrite 0x020abf thru 0x029d06 (0x9248 bytes) 000471 1788198960.865066 punch from 0x01d94a to 0x02a0db (0xc792 bytes) 000474 1788198960.872818 punch from 0x0358de to 0x03a990 (0x50b3 bytes) 000475 1788198960.877996 write 0x01d54b thru 0x021870 (0x4326 bytes) 000476 1788198960.889623 read 0x03032d thru 0x03214a (0x1e1e bytes) 000477 1788198960.890430 read 0x027e4c thru 0x0353b8 (0xd56d bytes) 000478 1788198960.901750 trunc from 0x03a991 to 0x01813d (0x22853 bytes) 000479 1788198960.927603 trunc from 0x01813e to 0x032886 (0x1a749 bytes) 000480 1788198960.947322 trunc from 0x032887 to 0x03aaf0 (0x826a bytes) 000481 1788198960.964904 mapread 0x0060d3 thru 0x01534b (0xf279 bytes) 000482 1788198960.966258 trunc from 0x03aaf1 to 0x00e176 (0x2c97a bytes) 000485 1788198960.992404 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0xe177): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe177): Mirror 5: 0x1fa6f85e (stale) Mirror 6: 0x1fa6f85e (stale) Mirror 8: 0x1fa6f85e (stale) Mirror 9: 0x1fa6f85e (stale) Mirror 13: 0x1fa6f85e (stale) Mirror 14: 0x1fa6f85e (stale) Mirror 15: 0x1fa6f85e (stale) Mirror 17: 0x1fa6f85e (stale) Mirror 18: 0x1fa6f85e (stale) Mirror 19: 0x1fa6f85e (stale) Mirror 20: 0x1fa6f85e (stale) Mirror 21: 0x1fa6f85e (stale) Mirror 23: 0x1fa6f85e (stale) Mirror 24: 0x1fa6f85e (stale) CRC-32 checksum value for chunk [0, 0xe177): Mirror 1: 0x1fa6f85e Mirror 25: 0x1fa6f85e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe177: skipped 000486 1788198962.174132 mapwrite 0x024a79 thru 0x02c2e5 (0x786d bytes) 000487 1788198962.444982 write 0x019b12 thru 0x024a03 (0xaef2 bytes) 000488 1788198962.451012 mapread 0x027915 thru 0x02c2e5 (0x49d1 bytes) 000489 1788198962.453196 read 0x00d6eb thru 0x00ffa5 (0x28bb bytes) 000491 1788198962.460152 read 0x01d9dd thru 0x02550e (0x7b32 bytes) 000493 1788198962.461433 punch from 0x018311 to 0x01b1a4 (0x2e94 bytes) 000494 1788198962.474529 punch from 0x01a438 to 0x01e25f (0x3e28 bytes) 000495 1788198962.481690 punch from 0x022b01 to 0x02a96a (0x7e6a bytes) 000497 1788198962.488139 mapread 0x00cad8 thru 0x016603 (0x9b2c bytes) 000498 1788198962.509338 mapread 0x01783d thru 0x01e56b (0x6d2f bytes) 000499 1788198962.510664 mapread 0x002fdf thru 0x0036a1 (0x6c3 bytes) 000501 1788198962.515324 trunc from 0x02c2e6 to 0x005349 (0x26f9c bytes) 000505 1788198962.565168 mapwrite 0x03fe52 thru 0x03ffff (0x1ae bytes) 000506 1788198962.657411 read 0x02141b thru 0x021c72 (0x858 bytes) 000507 1788198962.680865 read 0x01e986 thru 0x02460a (0x5c85 bytes) 000510 1788198962.682458 punch from 0x0152a8 to 0x023be6 (0xe93f bytes) 000512 1788198962.688388 punch from 0x03cf9f to 0x03ffff (0x3061 bytes) 000513 1788198962.693279 mapread 0x033b95 thru 0x03c9a2 (0x8e0e bytes) 000514 1788198962.704717 write 0x03b9bd thru 0x03df26 (0x256a bytes) 000515 1788198962.705825 write 0x01397e thru 0x01d729 (0x9dac bytes) 000517 1788198962.709620 mapwrite 0x0185da thru 0x019a49 (0x1470 bytes) 000518 1788198962.798828 trunc from 0x040000 to 0x036350 (0x9caf bytes) 000523 1788198962.825991 mapwrite 0x03a044 thru 0x03ffff (0x5fbc bytes) 000526 1788198962.936413 read 0x0392cd thru 0x03ffff (0x6d33 bytes) 000527 1788198962.942860 punch from 0x0024e2 to 0x007b71 (0x5690 bytes) 000528 1788198962.948143 punch from 0x02e521 to 0x03d4d7 (0xefb7 bytes) 000529 1788198962.953750 write 0x0008d1 thru 0x002660 (0x1d90 bytes) 000531 1788198962.959192 punch from 0x02f692 to 0x036801 (0x7170 bytes) 000534 1788198962.969243 punch from 0x036c26 to 0x0384b1 (0x188c bytes) 000535 1788198962.973814 trunc from 0x040000 to 0x005294 (0x3ad6b bytes) 000536 1788198962.994575 read 0x000895 thru 0x0037ba (0x2f26 bytes) 000539 1788198963.003500 write 0x0277d0 thru 0x031ccb (0xa4fc bytes) 000540 1788198963.008904 trunc from 0x031ccc to 0x007555 (0x2a776 bytes) 000542 1788198963.033141 trunc from 0x007556 to 0x02a6a0 (0x2314b bytes) 000545 1788198963.052452 mapwrite 0x02058c thru 0x024a55 (0x44ca bytes) 000546 1788198963.093425 write 0x00b0d9 thru 0x00e42b (0x3353 bytes) 000547 1788198963.094521 write 0x03027a thru 0x03861c (0x83a3 bytes) 000548 1788198963.099571 MIRROR_SPLIT mirror 11 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3861d): Mirror 5: 0xb7f4c00 (stale) Mirror 6: 0xb7f4c00 (stale) Mirror 8: 0xb7f4c00 (stale) Mirror 9: 0xb7f4c00 (stale) Mirror 13: 0xb7f4c00 (stale) Mirror 14: 0xb7f4c00 (stale) Mirror 15: 0xb7f4c00 (stale) Mirror 17: 0xb7f4c00 (stale) Mirror 18: 0xb7f4c00 (stale) Mirror 19: 0xb7f4c00 (stale) Mirror 21: 0xb7f4c00 (stale) Mirror 23: 0xb7f4c00 (stale) Mirror 24: 0x4fc46569 (stale) Mirror 25: 0x4fc46569 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3861d): Mirror 5: 0xb7f4c00 (stale) Mirror 6: 0xb7f4c00 (stale) Mirror 8: 0xb7f4c00 (stale) Mirror 9: 0xb7f4c00 (stale) Mirror 13: 0xb7f4c00 (stale) Mirror 14: 0xb7f4c00 (stale) Mirror 15: 0xb7f4c00 (stale) Mirror 17: 0xb7f4c00 (stale) Mirror 18: 0xb7f4c00 (stale) Mirror 19: 0xb7f4c00 (stale) Mirror 21: 0xb7f4c00 (stale) Mirror 23: 0xb7f4c00 (stale) Mirror 24: 0x4fc46569 (stale) Mirror 25: 0x4fc46569 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3861d: skipped 000549 1788198964.242859 punch from 0x00cc82 to 0x01b1b2 (0xe531 bytes) 000550 1788198964.249560 mapread 0x032051 thru 0x034fd2 (0x2f82 bytes) 000552 1788198964.275857 write 0x03f825 thru 0x03ffff (0x7db bytes) 000554 1788198964.281555 write 0x036506 thru 0x0387d9 (0x22d4 bytes) 000555 1788198964.284495 punch from 0x02ff46 to 0x03a36c (0xa427 bytes) 000556 1788198964.321497 read 0x036517 thru 0x03ffff (0x9ae9 bytes) 000557 1788198964.335820 mapwrite 0x03ce24 thru 0x03ffff (0x31dc bytes) 000558 1788198964.417973 MIRROR_RESYNC 15 mirrors 000559 1788198968.094163 MIRROR_RESYNC 15 mirrors 000561 1788198969.322294 read 0x02dc02 thru 0x02df13 (0x312 bytes) 000562 1788198969.328406 read 0x00e1a3 thru 0x01dd60 (0xfbbe bytes) 000565 1788198969.341129 read 0x01d521 thru 0x0249bb (0x749b bytes) 000566 1788198969.342444 trunc from 0x040000 to 0x022651 (0x1d9ae bytes) 000567 1788198969.497092 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22652): Mirror 6: 0x57460480 (stale) Mirror 8: 0x57460480 (stale) Mirror 9: 0x57460480 (stale) Mirror 13: 0x57460480 (stale) Mirror 14: 0x57460480 (stale) Mirror 15: 0x57460480 (stale) Mirror 17: 0x57460480 (stale) Mirror 18: 0x57460480 (stale) Mirror 19: 0x57460480 (stale) Mirror 21: 0x57460480 (stale) Mirror 23: 0x57460480 (stale) Mirror 24: 0x57460480 (stale) Mirror 25: 0x57460480 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22652): Mirror 6: 0x57460480 (stale) Mirror 8: 0x57460480 (stale) Mirror 9: 0x57460480 (stale) Mirror 13: 0x57460480 (stale) Mirror 14: 0x57460480 (stale) Mirror 15: 0x57460480 (stale) Mirror 17: 0x57460480 (stale) Mirror 18: 0x57460480 (stale) Mirror 19: 0x57460480 (stale) Mirror 21: 0x57460480 (stale) Mirror 23: 0x57460480 (stale) Mirror 24: 0x57460480 (stale) Mirror 25: 0x57460480 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22652: skipped 000569 1788198970.590779 mapread 0x00ebfc thru 0x018fcf (0xa3d4 bytes) 000570 1788198970.622029 mapread 0x00d46d thru 0x0167f7 (0x938b bytes) 000571 1788198970.623502 write 0x03b646 thru 0x03ffff (0x49ba bytes) 000573 1788198970.625481 mapwrite 0x03e52b thru 0x03ffff (0x1ad5 bytes) 000574 1788198970.720859 write 0x0262fd thru 0x02923e (0x2f42 bytes) 000576 1788198970.753372 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x79b8b003 (stale) Mirror 8: 0x79b8b003 (stale) Mirror 9: 0x79b8b003 (stale) Mirror 13: 0x79b8b003 (stale) Mirror 14: 0x79b8b003 (stale) Mirror 15: 0x79b8b003 (stale) Mirror 17: 0x79b8b003 (stale) Mirror 18: 0x79b8b003 (stale) Mirror 19: 0x79b8b003 (stale) Mirror 21: 0x79b8b003 (stale) Mirror 23: 0x79b8b003 (stale) Mirror 24: 0x79b8b003 (stale) Mirror 25: 0x79b8b003 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfdd1b3fc Mirror 26: 0xfdd1b3fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000577 1788198972.714782 read 0x03103d thru 0x03a148 (0x910c bytes) 000578 1788198972.730621 write 0x00d210 thru 0x019b6f (0xc960 bytes) 000580 1788198972.869053 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x79b8b003 (stale) Mirror 8: 0x79b8b003 (stale) Mirror 9: 0x79b8b003 (stale) Mirror 13: 0x79b8b003 (stale) Mirror 14: 0x79b8b003 (stale) Mirror 15: 0x79b8b003 (stale) Mirror 17: 0x79b8b003 (stale) Mirror 18: 0x79b8b003 (stale) Mirror 19: 0x79b8b003 (stale) Mirror 21: 0x79b8b003 (stale) Mirror 23: 0x79b8b003 (stale) Mirror 24: 0x79b8b003 (stale) Mirror 25: 0x79b8b003 (stale) Mirror 26: 0xfdd1b3fc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc4c1dfc2 Mirror 27: 0xc4c1dfc2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000583 1788198974.373251 punch from 0x00fe52 to 0x016d1f (0x6ece bytes) 000584 1788198974.460467 MIRROR_SPLIT mirror 8 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x79b8b003 (stale) Mirror 8: 0x79b8b003 (stale) Mirror 9: 0x79b8b003 (stale) Mirror 13: 0x79b8b003 (stale) Mirror 14: 0x79b8b003 (stale) Mirror 15: 0x79b8b003 (stale) Mirror 17: 0x79b8b003 (stale) Mirror 19: 0x79b8b003 (stale) Mirror 21: 0x79b8b003 (stale) Mirror 23: 0x79b8b003 (stale) Mirror 24: 0x79b8b003 (stale) Mirror 25: 0x79b8b003 (stale) Mirror 26: 0xfdd1b3fc (stale) Mirror 27: 0xc4c1dfc2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x79b8b003 (stale) Mirror 8: 0x79b8b003 (stale) Mirror 9: 0x79b8b003 (stale) Mirror 13: 0x79b8b003 (stale) Mirror 14: 0x79b8b003 (stale) Mirror 15: 0x79b8b003 (stale) Mirror 17: 0x79b8b003 (stale) Mirror 19: 0x79b8b003 (stale) Mirror 21: 0x79b8b003 (stale) Mirror 23: 0x79b8b003 (stale) Mirror 24: 0x79b8b003 (stale) Mirror 25: 0x79b8b003 (stale) Mirror 26: 0xfdd1b3fc (stale) Mirror 27: 0xc4c1dfc2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000587 1788198975.270697 write 0x011ea3 thru 0x012704 (0x862 bytes) 000588 1788198975.280736 trunc from 0x040000 to 0x00f55a (0x30aa5 bytes) 000591 1788198975.301614 punch from 0x0013a4 to 0x0080e6 (0x6d43 bytes) 000593 1788198975.306786 mapwrite 0x0311a0 thru 0x0378bb (0x671c bytes) 000594 1788198975.386112 mapwrite 0x021370 thru 0x02cee9 (0xbb7a bytes) 000596 1788198975.447115 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x378bc): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x378bc): Mirror 6: 0x6e2e2870 (stale) Mirror 8: 0x6e2e2870 (stale) Mirror 9: 0x6e2e2870 (stale) Mirror 13: 0x6e2e2870 (stale) Mirror 14: 0x6e2e2870 (stale) Mirror 15: 0x6e2e2870 (stale) Mirror 17: 0x6e2e2870 (stale) Mirror 19: 0x6e2e2870 (stale) Mirror 21: 0x6e2e2870 (stale) Mirror 23: 0x6e2e2870 (stale) Mirror 24: 0x6e2e2870 (stale) Mirror 25: 0x6e2e2870 (stale) Mirror 26: 0xafbea1b4 (stale) Mirror 27: 0x8afe968e (stale) CRC-32 checksum value for chunk [0, 0x378bc): Mirror 1: 0xdee6cc96 Mirror 28: 0xdee6cc96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x378bc: skipped 000597 1788198976.748421 mapread 0x02d5bf thru 0x02eb91 (0x15d3 bytes) 000598 1788198976.768286 trunc from 0x0378bc to 0x03acef (0x3434 bytes) 000602 1788198976.858959 mapread 0x03314d thru 0x03acef (0x7ba3 bytes) 000604 1788198976.869832 punch from 0x005b34 to 0x015359 (0xf826 bytes) 000606 1788198976.874480 mapread 0x020ecc thru 0x021266 (0x39b bytes) 000607 1788198976.883048 punch from 0x033d9b to 0x036dba (0x3020 bytes) 000608 1788198976.887152 trunc from 0x03acf0 to 0x02cb0c (0xe1e3 bytes) 000610 1788198976.907749 mapwrite 0x001bd5 thru 0x005f55 (0x4381 bytes) 000611 1788198976.962099 punch from 0x0161bf to 0x0176ff (0x1541 bytes) 000612 1788198976.966682 punch from 0x01d867 to 0x023891 (0x602b bytes) 000614 1788198976.972259 trunc from 0x02cb0d to 0x021439 (0xb6d3 bytes) 000615 1788198976.989981 trunc from 0x02143a to 0x02ac84 (0x984b bytes) 000616 1788198977.004495 read 0x0150ac thru 0x0163b4 (0x1309 bytes) 000618 1788198977.011161 write 0x014651 thru 0x0200b5 (0xba65 bytes) 000619 1788198977.020485 trunc from 0x02ac85 to 0x01b37f (0xf905 bytes) 000620 1788198977.037351 punch from 0x00dc56 to 0x01b37f (0xd72a bytes) 000622 1788198977.051301 trunc from 0x01b380 to 0x003192 (0x181ed bytes) 000623 1788198977.065058 mapread 0x002b2e thru 0x003192 (0x665 bytes) 000624 1788198977.066843 trunc from 0x003193 to 0x01a5a7 (0x17415 bytes) 000625 1788198977.082254 punch from 0x002862 to 0x0107fa (0xdf99 bytes) 000626 1788198977.091334 MIRROR_RESYNC 16 mirrors 000627 1788198983.635960 trunc from 0x01a5a8 to 0x00488e (0x15d19 bytes) 000628 1788198983.767263 MIRROR_RESYNC 16 mirrors 000631 1788198985.573659 read 0x002ba0 thru 0x00488e (0x1cef bytes) 000633 1788198985.579884 read 0x00209c thru 0x00488e (0x27f3 bytes) 000634 1788198985.580311 read 0x000705 thru 0x00488e (0x418a bytes) 000636 1788198985.586946 write 0x0208df thru 0x02ca4e (0xc170 bytes) 000637 1788198985.669192 MIRROR_SPLIT mirror 4 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ca4f): Mirror 6: 0x89703d47 (stale) Mirror 8: 0x89703d47 (stale) Mirror 9: 0x89703d47 (stale) Mirror 14: 0x89703d47 (stale) Mirror 15: 0x89703d47 (stale) Mirror 17: 0x89703d47 (stale) Mirror 19: 0x89703d47 (stale) Mirror 21: 0x89703d47 (stale) Mirror 23: 0x89703d47 (stale) Mirror 24: 0x89703d47 (stale) Mirror 25: 0x89703d47 (stale) Mirror 26: 0x89703d47 (stale) Mirror 27: 0x89703d47 (stale) Mirror 28: 0x89703d47 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ca4f): Mirror 6: 0x89703d47 (stale) Mirror 8: 0x89703d47 (stale) Mirror 9: 0x89703d47 (stale) Mirror 14: 0x89703d47 (stale) Mirror 15: 0x89703d47 (stale) Mirror 17: 0x89703d47 (stale) Mirror 19: 0x89703d47 (stale) Mirror 21: 0x89703d47 (stale) Mirror 23: 0x89703d47 (stale) Mirror 24: 0x89703d47 (stale) Mirror 25: 0x89703d47 (stale) Mirror 26: 0x89703d47 (stale) Mirror 27: 0x89703d47 (stale) Mirror 28: 0x89703d47 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ca4f: skipped 000638 1788198986.331571 MIRROR_RESYNC 15 mirrors 000639 1788198990.752416 write 0x01c2f0 thru 0x029b71 (0xd882 bytes) 000640 1788198990.853564 punch from 0x014794 to 0x020bbc (0xc429 bytes) 000641 1788198990.884302 MIRROR_RESYNC 15 mirrors 000642 1788198993.889699 mapread 0x00e375 thru 0x01d6e9 (0xf375 bytes) 000645 1788198993.950478 mapwrite 0x014aa5 thru 0x0220b1 (0xd60d bytes) 000648 1788198994.168273 punch from 0x029a81 to 0x02ca4e (0x2fce bytes) 000649 1788198994.173148 mapread 0x02a53c thru 0x02ca4e (0x2513 bytes) 000651 1788198994.186417 read 0x00879a thru 0x00a953 (0x21ba bytes) 000652 1788198994.192361 trunc from 0x02ca4f to 0x00183c (0x2b212 bytes) 000653 1788198994.218196 MIRROR_SPLIT mirror 6 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x183d): Mirror 6: 0xcef2a1ad (stale) Mirror 8: 0xcef2a1ad (stale) Mirror 9: 0xcef2a1ad (stale) Mirror 14: 0xcef2a1ad (stale) Mirror 15: 0xcef2a1ad (stale) Mirror 19: 0xcef2a1ad (stale) Mirror 21: 0xcef2a1ad (stale) Mirror 23: 0xcef2a1ad (stale) Mirror 24: 0xcef2a1ad (stale) Mirror 25: 0xcef2a1ad (stale) Mirror 26: 0xcef2a1ad (stale) Mirror 27: 0xcef2a1ad (stale) Mirror 28: 0xcef2a1ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x183d): Mirror 6: 0xcef2a1ad (stale) Mirror 8: 0xcef2a1ad (stale) Mirror 9: 0xcef2a1ad (stale) Mirror 14: 0xcef2a1ad (stale) Mirror 15: 0xcef2a1ad (stale) Mirror 19: 0xcef2a1ad (stale) Mirror 21: 0xcef2a1ad (stale) Mirror 23: 0xcef2a1ad (stale) Mirror 24: 0xcef2a1ad (stale) Mirror 25: 0xcef2a1ad (stale) Mirror 26: 0xcef2a1ad (stale) Mirror 27: 0xcef2a1ad (stale) Mirror 28: 0xcef2a1ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x183d: skipped 000654 1788198994.750120 punch from 0x0010b8 to 0x00183c (0x785 bytes) 000655 1788198994.761122 write 0x03ebf3 thru 0x03ffff (0x140d bytes) 000657 1788198994.767502 mapwrite 0x02a1eb thru 0x03770e (0xd524 bytes) 000658 1788198995.001975 write 0x0157bb thru 0x019533 (0x3d79 bytes) 000662 1788198995.037583 trunc from 0x040000 to 0x0204fb (0x1fb04 bytes) 000664 1788198995.101887 mapread 0x00f197 thru 0x01175d (0x25c7 bytes) 000665 1788198995.126695 punch from 0x01bb11 to 0x0204fb (0x49eb bytes) 000668 1788198995.168054 write 0x025572 thru 0x0350c1 (0xfb50 bytes) 000669 1788198995.174511 trunc from 0x0350c2 to 0x02eede (0x61e3 bytes) 000670 1788198995.237302 punch from 0x02811d to 0x028f02 (0xde6 bytes) 000672 1788198995.267043 write 0x0032ec thru 0x00c027 (0x8d3c bytes) 000674 1788198995.287262 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2eedf): Mirror 6: 0x6526de42 (stale) Mirror 8: 0x6526de42 (stale) Mirror 14: 0x6526de42 (stale) Mirror 15: 0x6526de42 (stale) Mirror 19: 0x6526de42 (stale) Mirror 21: 0x6526de42 (stale) Mirror 23: 0x6526de42 (stale) Mirror 24: 0x6526de42 (stale) Mirror 25: 0x6526de42 (stale) Mirror 26: 0x6526de42 (stale) Mirror 27: 0x6526de42 (stale) Mirror 28: 0x6526de42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eedf): Mirror 6: 0x6526de42 (stale) Mirror 8: 0x6526de42 (stale) Mirror 14: 0x6526de42 (stale) Mirror 15: 0x6526de42 (stale) Mirror 19: 0x6526de42 (stale) Mirror 21: 0x6526de42 (stale) Mirror 23: 0x6526de42 (stale) Mirror 24: 0x6526de42 (stale) Mirror 25: 0x6526de42 (stale) Mirror 26: 0x6526de42 (stale) Mirror 27: 0x6526de42 (stale) Mirror 28: 0x6526de42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eedf: skipped 000675 1788198996.093092 mapread 0x01633f thru 0x02579c (0xf45e bytes) 000676 1788198996.116636 read 0x0018b8 thru 0x00e874 (0xcfbd bytes) 000677 1788198996.131120 punch from 0x02c30e to 0x02caa0 (0x793 bytes) 000680 1788198996.138807 mapread 0x001489 thru 0x00e9e5 (0xd55d bytes) 000681 1788198996.144002 read 0x020edb thru 0x029437 (0x855d bytes) 000682 1788198996.144776 write 0x03eb0e thru 0x03ffff (0x14f2 bytes) 000685 1788198996.147515 mapread 0x038925 thru 0x03ffff (0x76db bytes) 000687 1788198996.157123 trunc from 0x040000 to 0x0017cb (0x3e834 bytes) 000688 1788198996.174969 read 0x0013ed thru 0x0017cb (0x3df bytes) truncating to largest ever: 0x3d765 000689 1788198996.175696 trunc from 0x0017cc to 0x03d764 (0x3bf99 bytes) 000691 1788198996.189141 read 0x01cc8d thru 0x027054 (0xa3c8 bytes) 000692 1788198996.200007 mapwrite 0x03e31b thru 0x03f706 (0x13ec bytes) 000693 1788198996.266716 mapwrite 0x01ab6f thru 0x01c08b (0x151d bytes) 000694 1788198996.304155 trunc from 0x03f707 to 0x02d637 (0x120cf bytes) 000695 1788198996.320001 mapread 0x00519c thru 0x00546f (0x2d4 bytes) 000696 1788198996.320773 mapwrite 0x0057fb thru 0x00bc15 (0x641b bytes) 000697 1788198996.371177 mapread 0x02a00f thru 0x02d637 (0x3629 bytes) truncating to largest ever: 0x3e1da 000698 1788198996.373621 trunc from 0x02d638 to 0x03e1d9 (0x10ba2 bytes) 000699 1788198996.388628 mapwrite 0x009245 thru 0x00998d (0x749 bytes) 000701 1788198996.424109 read 0x014576 thru 0x01e482 (0x9f0d bytes) 000703 1788198996.425442 mapwrite 0x01ff6c thru 0x02e738 (0xe7cd bytes) 000704 1788198996.491832 punch from 0x02cb64 to 0x033f50 (0x73ed bytes) 000706 1788198996.497603 read 0x038f15 thru 0x03e1d9 (0x52c5 bytes) truncating to largest ever: 0x3e217 000707 1788198996.499140 trunc from 0x03e1da to 0x03e216 (0x3d bytes) 000710 1788198996.515035 mapread 0x032d6f thru 0x03d90f (0xaba1 bytes) 000713 1788198996.532996 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3e217): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e217): Mirror 6: 0xd9f76830 (stale) Mirror 8: 0xd9f76830 (stale) Mirror 14: 0xd9f76830 (stale) Mirror 15: 0xd9f76830 (stale) Mirror 19: 0xd9f76830 (stale) Mirror 21: 0xd9f76830 (stale) Mirror 23: 0xd9f76830 (stale) Mirror 24: 0xd9f76830 (stale) Mirror 25: 0xd9f76830 (stale) Mirror 26: 0xd9f76830 (stale) Mirror 27: 0xd9f76830 (stale) Mirror 28: 0xd9f76830 (stale) CRC-32 checksum value for chunk [0, 0x3e217): Mirror 1: 0x1ab004eb Mirror 29: 0x1ab004eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e217: skipped 000714 1788198998.431474 mapread 0x02b272 thru 0x02e480 (0x320f bytes) 000715 1788198998.466914 read 0x0097f5 thru 0x014e00 (0xb60c bytes) 000716 1788198998.492107 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e217): Mirror 6: 0xd9f76830 (stale) Mirror 8: 0xd9f76830 (stale) Mirror 14: 0xd9f76830 (stale) Mirror 15: 0xd9f76830 (stale) Mirror 19: 0xd9f76830 (stale) Mirror 21: 0xd9f76830 (stale) Mirror 23: 0xd9f76830 (stale) Mirror 24: 0xd9f76830 (stale) Mirror 25: 0xd9f76830 (stale) Mirror 26: 0xd9f76830 (stale) Mirror 27: 0xd9f76830 (stale) Mirror 28: 0xd9f76830 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e217): Mirror 6: 0xd9f76830 (stale) Mirror 8: 0xd9f76830 (stale) Mirror 14: 0xd9f76830 (stale) Mirror 15: 0xd9f76830 (stale) Mirror 19: 0xd9f76830 (stale) Mirror 21: 0xd9f76830 (stale) Mirror 23: 0xd9f76830 (stale) Mirror 24: 0xd9f76830 (stale) Mirror 25: 0xd9f76830 (stale) Mirror 26: 0xd9f76830 (stale) Mirror 27: 0xd9f76830 (stale) Mirror 28: 0xd9f76830 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e217: skipped 000717 1788198999.472750 read 0x006e2b thru 0x00b22c (0x4402 bytes) 000718 1788198999.490030 write 0x019c84 thru 0x024e09 (0xb186 bytes) truncating to largest ever: 0x3f320 000719 1788198999.514078 trunc from 0x03e217 to 0x03f31f (0x1109 bytes) 000720 1788198999.539027 mapread 0x025740 thru 0x02beec (0x67ad bytes) 000721 1788198999.550118 write 0x013c24 thru 0x021eb6 (0xe293 bytes) 000722 1788198999.559629 mapread 0x0134af thru 0x016c22 (0x3774 bytes) 000723 1788198999.560284 read 0x0286fa thru 0x028d80 (0x687 bytes) 000725 1788198999.560998 mapwrite 0x014041 thru 0x02158b (0xd54b bytes) 000726 1788198999.593510 mapwrite 0x00e063 thru 0x011c17 (0x3bb5 bytes) 000727 1788198999.667707 read 0x011eff thru 0x01f4c9 (0xd5cb bytes) 000728 1788198999.669829 mapread 0x01516d thru 0x018758 (0x35ec bytes) 000729 1788198999.672492 trunc from 0x03f320 to 0x00cc70 (0x326af bytes) 000730 1788198999.702176 write 0x00d558 thru 0x017a1f (0xa4c8 bytes) 000732 1788198999.707136 write 0x00dd5c thru 0x01b1f2 (0xd497 bytes) 000733 1788198999.711624 punch from 0x002d79 to 0x00ecb1 (0xbf39 bytes) 000734 1788198999.749601 write 0x03cca9 thru 0x03f32e (0x2686 bytes) 000735 1788198999.751139 mapwrite 0x03a86c thru 0x03ffff (0x5794 bytes) 000736 1788198999.918376 write 0x00e4cb thru 0x0195dc (0xb112 bytes) 000737 1788198999.919779 read 0x020910 thru 0x02e97b (0xe06c bytes) 000738 1788198999.920842 trunc from 0x040000 to 0x01ea71 (0x2158e bytes) 000739 1788198999.938359 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1ea72): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea72): Mirror 6: 0xb5d6f95b (stale) Mirror 8: 0xb5d6f95b (stale) Mirror 14: 0xb5d6f95b (stale) Mirror 15: 0xb5d6f95b (stale) Mirror 19: 0xb5d6f95b (stale) Mirror 21: 0xb5d6f95b (stale) Mirror 23: 0xb5d6f95b (stale) Mirror 24: 0xb5d6f95b (stale) Mirror 25: 0xb5d6f95b (stale) Mirror 26: 0xb5d6f95b (stale) Mirror 27: 0xb5d6f95b (stale) Mirror 28: 0xb5d6f95b (stale) CRC-32 checksum value for chunk [0, 0x1ea72): Mirror 1: 0x42eced56 Mirror 29: 0x42eced56 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea72: skipped 000740 1788199000.625159 mapwrite 0x03bda1 thru 0x03ffff (0x425f bytes) 000741 1788199000.859343 trunc from 0x040000 to 0x0138d6 (0x2c729 bytes) 000742 1788199000.888766 write 0x01d1e2 thru 0x020f0a (0x3d29 bytes) 000743 1788199000.891072 read 0x010361 thru 0x016e87 (0x6b27 bytes) 000744 1788199000.902074 punch from 0x006c9c to 0x0135fb (0xc960 bytes) 000745 1788199000.913993 write 0x0063e5 thru 0x014e4e (0xea6a bytes) 000746 1788199000.920566 write 0x024f5b thru 0x031254 (0xc2fa bytes) 000747 1788199000.923130 trunc from 0x031255 to 0x00b255 (0x25fff bytes) 000748 1788199000.951832 MIRROR_RESYNC 14 mirrors 000750 1788199004.146593 mapread 0x002829 thru 0x00b255 (0x8a2d bytes) 000751 1788199004.185737 MIRROR_EXTEND to 15 mirrors 000752 1788199005.679374 punch from 0x009729 to 0x00b255 (0x1b2d bytes) 000754 1788199005.776584 mapread 0x000754 thru 0x008836 (0x80e3 bytes) 000755 1788199005.847557 mapwrite 0x01b8b5 thru 0x023249 (0x7995 bytes) 000756 1788199006.026346 mapwrite 0x003055 thru 0x00504d (0x1ff9 bytes) 000757 1788199006.133276 mapread 0x01f0bb thru 0x023249 (0x418f bytes) 000758 1788199006.134006 write 0x032cd4 thru 0x03ffff (0xd32c bytes) 000759 1788199006.135399 write 0x02aa86 thru 0x0323a8 (0x7923 bytes) 000761 1788199006.151458 punch from 0x031016 to 0x034d8e (0x3d79 bytes) 000762 1788199006.178090 mapread 0x00a077 thru 0x011f76 (0x7f00 bytes) 000764 1788199006.225388 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x15db25d9 (stale) Mirror 8: 0x15db25d9 (stale) Mirror 14: 0x15db25d9 (stale) Mirror 15: 0x15db25d9 (stale) Mirror 19: 0x15db25d9 (stale) Mirror 21: 0x15db25d9 (stale) Mirror 23: 0x15db25d9 (stale) Mirror 24: 0x15db25d9 (stale) Mirror 25: 0x15db25d9 (stale) Mirror 26: 0x15db25d9 (stale) Mirror 27: 0x15db25d9 (stale) Mirror 28: 0x15db25d9 (stale) Mirror 29: 0x15db25d9 (stale) Mirror 30: 0x15db25d9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdaed50ef Mirror 31: 0xdaed50ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000765 1788199008.307609 trunc from 0x040000 to 0x03368e (0xc971 bytes) 000766 1788199008.481006 mapread 0x00ad55 thru 0x013a2c (0x8cd8 bytes) 000767 1788199008.505757 read 0x02aece thru 0x03368e (0x87c1 bytes) 000769 1788199008.518359 punch from 0x010b90 to 0x01a6d5 (0x9b46 bytes) 000770 1788199008.530532 MIRROR_SPLIT mirror 11 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3368f): Mirror 6: 0xe4532d2d (stale) Mirror 8: 0xe4532d2d (stale) Mirror 14: 0xe4532d2d (stale) Mirror 15: 0xe4532d2d (stale) Mirror 19: 0xe4532d2d (stale) Mirror 21: 0xe4532d2d (stale) Mirror 23: 0xe4532d2d (stale) Mirror 24: 0xe4532d2d (stale) Mirror 25: 0xe4532d2d (stale) Mirror 26: 0xe4532d2d (stale) Mirror 28: 0xe4532d2d (stale) Mirror 29: 0xe4532d2d (stale) Mirror 30: 0xe4532d2d (stale) Mirror 31: 0x72d1949d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3368f): Mirror 6: 0xe4532d2d (stale) Mirror 8: 0xe4532d2d (stale) Mirror 14: 0xe4532d2d (stale) Mirror 15: 0xe4532d2d (stale) Mirror 19: 0xe4532d2d (stale) Mirror 21: 0xe4532d2d (stale) Mirror 23: 0xe4532d2d (stale) Mirror 24: 0xe4532d2d (stale) Mirror 25: 0xe4532d2d (stale) Mirror 26: 0xe4532d2d (stale) Mirror 28: 0xe4532d2d (stale) Mirror 29: 0xe4532d2d (stale) Mirror 30: 0xe4532d2d (stale) Mirror 31: 0x72d1949d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3368f: skipped 000772 1788199009.867426 trunc from 0x03368f to 0x021d05 (0x11989 bytes) 000773 1788199009.924473 punch from 0x01d9ac to 0x021d05 (0x435a bytes) 000774 1788199009.932883 trunc from 0x021d06 to 0x02bb7f (0x9e7a bytes) 000775 1788199009.998607 read 0x0171dc thru 0x022319 (0xb13e bytes) 000776 1788199010.024472 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2bb80): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bb80): Mirror 6: 0x21a9c32a (stale) Mirror 8: 0x21a9c32a (stale) Mirror 14: 0x21a9c32a (stale) Mirror 15: 0x21a9c32a (stale) Mirror 19: 0x21a9c32a (stale) Mirror 21: 0x21a9c32a (stale) Mirror 23: 0x21a9c32a (stale) Mirror 24: 0x21a9c32a (stale) Mirror 25: 0x21a9c32a (stale) Mirror 26: 0x21a9c32a (stale) Mirror 28: 0x21a9c32a (stale) Mirror 29: 0x21a9c32a (stale) Mirror 30: 0x21a9c32a (stale) Mirror 31: 0x1e6f234f (stale) CRC-32 checksum value for chunk [0, 0x2bb80): Mirror 1: 0x151b3ddf Mirror 32: 0x151b3ddf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bb80: skipped 000778 1788199012.909725 MIRROR_RESYNC 16 mirrors 000779 1788199017.784929 trunc from 0x02bb80 to 0x0168fb (0x15284 bytes) 000780 1788199018.050684 write 0x01f3de thru 0x02b803 (0xc426 bytes) 000782 1788199018.054928 mapwrite 0x02bfb6 thru 0x039f6f (0xdfba bytes) 000784 1788199018.259679 trunc from 0x039f70 to 0x0055f2 (0x3497d bytes) 000786 1788199018.290729 mapread 0x00109f thru 0x0055f2 (0x4554 bytes) 000787 1788199018.313199 mapread 0x004538 thru 0x0055f2 (0x10bb bytes) 000788 1788199018.315741 read 0x003a48 thru 0x0055f2 (0x1bab bytes) 000789 1788199018.317185 mapwrite 0x018887 thru 0x02075a (0x7ed4 bytes) 000791 1788199018.469636 read 0x00dfe6 thru 0x01ccfa (0xed15 bytes) 000794 1788199018.488509 mapread 0x004f8e thru 0x007971 (0x29e4 bytes) 000795 1788199018.489474 trunc from 0x02075b to 0x03b3a1 (0x1ac47 bytes) 000796 1788199018.515168 mapread 0x00c4e9 thru 0x01184f (0x5367 bytes) 000797 1788199018.521856 punch from 0x02ec75 to 0x032534 (0x38c0 bytes) 000800 1788199018.539205 MIRROR_RESYNC 16 mirrors 000801 1788199021.690870 trunc from 0x03b3a2 to 0x0178e7 (0x23aba bytes) 000804 1788199021.800956 write 0x00b595 thru 0x018925 (0xd391 bytes) 000805 1788199021.808190 trunc from 0x018926 to 0x03456d (0x1bc48 bytes) 000806 1788199021.827348 mapwrite 0x00e98e thru 0x011907 (0x2f7a bytes) 000807 1788199021.923410 mapread 0x005cdd thru 0x00fcc0 (0x9fe4 bytes) 000808 1788199021.975977 mapwrite 0x03b00a thru 0x03ffff (0x4ff6 bytes) 000809 1788199022.188475 punch from 0x023bc6 to 0x025c89 (0x20c4 bytes) 000810 1788199022.194950 write 0x00f916 thru 0x014fa2 (0x568d bytes) 000811 1788199022.195979 mapread 0x01fd58 thru 0x02d48b (0xd734 bytes) 000814 1788199022.226959 mapread 0x026617 thru 0x03603b (0xfa25 bytes) 000815 1788199022.246759 read 0x03cf8a thru 0x03ffff (0x3076 bytes) 000816 1788199022.247798 mapwrite 0x02ab2c thru 0x036fa0 (0xc475 bytes) 000817 1788199022.370757 MIRROR_SPLIT mirror 3 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x234954f5 (stale) Mirror 8: 0x234954f5 (stale) Mirror 15: 0x234954f5 (stale) Mirror 19: 0x234954f5 (stale) Mirror 21: 0x234954f5 (stale) Mirror 23: 0x234954f5 (stale) Mirror 24: 0x234954f5 (stale) Mirror 25: 0x234954f5 (stale) Mirror 26: 0x234954f5 (stale) Mirror 28: 0x234954f5 (stale) Mirror 29: 0x234954f5 (stale) Mirror 30: 0x234954f5 (stale) Mirror 31: 0x234954f5 (stale) Mirror 32: 0x234954f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x234954f5 (stale) Mirror 8: 0x234954f5 (stale) Mirror 15: 0x234954f5 (stale) Mirror 19: 0x234954f5 (stale) Mirror 21: 0x234954f5 (stale) Mirror 23: 0x234954f5 (stale) Mirror 24: 0x234954f5 (stale) Mirror 25: 0x234954f5 (stale) Mirror 26: 0x234954f5 (stale) Mirror 28: 0x234954f5 (stale) Mirror 29: 0x234954f5 (stale) Mirror 30: 0x234954f5 (stale) Mirror 31: 0x234954f5 (stale) Mirror 32: 0x234954f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000819 1788199023.473585 mapwrite 0x012716 thru 0x01e1ba (0xbaa5 bytes) 000820 1788199023.557361 mapread 0x01df6b thru 0x02b9a4 (0xda3a bytes) 000821 1788199023.569363 mapwrite 0x02f7d8 thru 0x033638 (0x3e61 bytes) 000823 1788199023.625919 mapwrite 0x02c513 thru 0x036256 (0x9d44 bytes) 000824 1788199023.680615 write 0x03ddc0 thru 0x03ffff (0x2240 bytes) 000825 1788199023.685974 trunc from 0x040000 to 0x010b30 (0x2f4cf bytes) 000829 1788199023.706571 read 0x00d58b thru 0x010b30 (0x35a6 bytes) 000830 1788199023.707696 mapwrite 0x03bbc9 thru 0x03ffff (0x4437 bytes) 000831 1788199023.788090 mapread 0x0125c8 thru 0x014c19 (0x2652 bytes) 000832 1788199023.801353 write 0x029d2b thru 0x038ea1 (0xf177 bytes) 000833 1788199023.814870 MIRROR_RESYNC 15 mirrors 000834 1788199025.915786 mapread 0x00e2a8 thru 0x0154d0 (0x7229 bytes) 000836 1788199025.936442 write 0x019462 thru 0x028d1a (0xf8b9 bytes) 000837 1788199026.030497 trunc from 0x040000 to 0x008781 (0x3787e bytes) 000838 1788199026.064398 MIRROR_RESYNC 15 mirrors 000839 1788199027.792162 MIRROR_RESYNC 15 mirrors 000841 1788199028.323494 mapwrite 0x02501b thru 0x0302ef (0xb2d5 bytes) 000842 1788199028.552801 punch from 0x016168 to 0x01cc33 (0x6acc bytes) 000843 1788199028.562874 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x302f0): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x302f0): Mirror 6: 0x4e0e33c9 (stale) Mirror 8: 0x4e0e33c9 (stale) Mirror 15: 0x4e0e33c9 (stale) Mirror 19: 0x4e0e33c9 (stale) Mirror 21: 0x4e0e33c9 (stale) Mirror 23: 0x4e0e33c9 (stale) Mirror 24: 0x4e0e33c9 (stale) Mirror 25: 0x4e0e33c9 (stale) Mirror 26: 0x4e0e33c9 (stale) Mirror 28: 0x4e0e33c9 (stale) Mirror 29: 0x4e0e33c9 (stale) Mirror 30: 0x4e0e33c9 (stale) Mirror 31: 0x4e0e33c9 (stale) Mirror 32: 0x4e0e33c9 (stale) CRC-32 checksum value for chunk [0, 0x302f0): Mirror 1: 0x15f7cee1 Mirror 33: 0x15f7cee1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x302f0: skipped 000844 1788199030.066859 punch from 0x00d8dd to 0x00f922 (0x2046 bytes) 000845 1788199030.247591 mapread 0x0125f4 thru 0x01d02e (0xaa3b bytes) 000846 1788199030.290698 punch from 0x023446 to 0x026fb5 (0x3b70 bytes) 000848 1788199030.300803 trunc from 0x0302f0 to 0x00a1a2 (0x2614d bytes) 000850 1788199030.360171 punch from 0x002db8 to 0x00946e (0x66b7 bytes) 000852 1788199030.381570 MIRROR_RESYNC 16 mirrors 000853 1788199033.600316 write 0x0260f5 thru 0x02ee44 (0x8d50 bytes) 000854 1788199033.799118 mapwrite 0x0249f7 thru 0x033780 (0xed8a bytes) 000855 1788199034.005834 read 0x02323e thru 0x031c2d (0xe9f0 bytes) 000859 1788199034.018920 mapread 0x031af1 thru 0x033780 (0x1c90 bytes) 000860 1788199034.021673 write 0x01a143 thru 0x0239a9 (0x9867 bytes) 000861 1788199034.035748 mapwrite 0x02ce14 thru 0x036fa2 (0xa18f bytes) 000863 1788199034.253277 write 0x018432 thru 0x019635 (0x1204 bytes) 000864 1788199034.289783 MIRROR_RESYNC 16 mirrors 000866 1788199037.918510 MIRROR_SPLIT mirror 15 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) 000867 1788199038.922551 read 0x003f3c thru 0x00945b (0x5520 bytes) 000868 1788199038.935577 trunc from 0x036fa3 to 0x033c10 (0x3392 bytes) 000869 1788199039.117288 mapwrite 0x03477d thru 0x03ffff (0xb883 bytes) 000870 1788199039.324799 read 0x03a7a3 thru 0x03ffff (0x585d bytes) 000871 1788199039.325367 trunc from 0x040000 to 0x016602 (0x299fd bytes) 000872 1788199039.365483 read 0x0003e7 thru 0x00fa7a (0xf694 bytes) 000873 1788199039.380739 write 0x00e773 thru 0x015162 (0x69f0 bytes) 000874 1788199039.384109 punch from 0x005a6d to 0x006ca8 (0x123c bytes) 000876 1788199039.410739 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16603): Mirror 6: 0x7afdfc95 (stale) Mirror 8: 0x7afdfc95 (stale) Mirror 15: 0x7afdfc95 (stale) Mirror 19: 0x7afdfc95 (stale) Mirror 23: 0x7afdfc95 (stale) Mirror 24: 0x7afdfc95 (stale) Mirror 25: 0x7afdfc95 (stale) Mirror 26: 0x7afdfc95 (stale) Mirror 28: 0x7afdfc95 (stale) Mirror 29: 0x7afdfc95 (stale) Mirror 30: 0x7afdfc95 (stale) Mirror 31: 0x7afdfc95 (stale) Mirror 32: 0x7afdfc95 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16603): Mirror 6: 0x7afdfc95 (stale) Mirror 8: 0x7afdfc95 (stale) Mirror 15: 0x7afdfc95 (stale) Mirror 19: 0x7afdfc95 (stale) Mirror 23: 0x7afdfc95 (stale) Mirror 24: 0x7afdfc95 (stale) Mirror 25: 0x7afdfc95 (stale) Mirror 26: 0x7afdfc95 (stale) Mirror 28: 0x7afdfc95 (stale) Mirror 29: 0x7afdfc95 (stale) Mirror 30: 0x7afdfc95 (stale) Mirror 31: 0x7afdfc95 (stale) Mirror 32: 0x7afdfc95 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16603: skipped 000877 1788199040.216308 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x16603): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16603): Mirror 6: 0x7afdfc95 (stale) Mirror 8: 0x7afdfc95 (stale) Mirror 15: 0x7afdfc95 (stale) Mirror 19: 0x7afdfc95 (stale) Mirror 23: 0x7afdfc95 (stale) Mirror 24: 0x7afdfc95 (stale) Mirror 25: 0x7afdfc95 (stale) Mirror 26: 0x7afdfc95 (stale) Mirror 28: 0x7afdfc95 (stale) Mirror 29: 0x7afdfc95 (stale) Mirror 30: 0x7afdfc95 (stale) Mirror 31: 0x7afdfc95 (stale) Mirror 32: 0x7afdfc95 (stale) CRC-32 checksum value for chunk [0, 0x16603): Mirror 1: 0x2f5ddc93 Mirror 33: 0x2f5ddc93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16603: skipped 000878 1788199041.565145 read 0x011a72 thru 0x016602 (0x4b91 bytes) 000880 1788199041.628073 punch from 0x0149c2 to 0x016602 (0x1c41 bytes) 000881 1788199041.837369 mapread 0x009ce8 thru 0x016602 (0xc91b bytes) 000884 1788199041.867916 write 0x001c16 thru 0x00950a (0x78f5 bytes) 000886 1788199041.883411 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x16603): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16603): Mirror 6: 0x7afdfc95 (stale) Mirror 8: 0x7afdfc95 (stale) Mirror 15: 0x7afdfc95 (stale) Mirror 19: 0x7afdfc95 (stale) Mirror 23: 0x7afdfc95 (stale) Mirror 24: 0x7afdfc95 (stale) Mirror 25: 0x7afdfc95 (stale) Mirror 26: 0x7afdfc95 (stale) Mirror 28: 0x7afdfc95 (stale) Mirror 29: 0x7afdfc95 (stale) Mirror 30: 0x7afdfc95 (stale) Mirror 31: 0x7afdfc95 (stale) Mirror 32: 0x7afdfc95 (stale) Mirror 33: 0x2f5ddc93 (stale) CRC-32 checksum value for chunk [0, 0x16603): Mirror 1: 0x961207ff Mirror 34: 0x961207ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16603: skipped 000887 1788199043.615768 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16603): Mirror 6: 0x7afdfc95 (stale) Mirror 8: 0x7afdfc95 (stale) Mirror 15: 0x7afdfc95 (stale) Mirror 19: 0x7afdfc95 (stale) Mirror 23: 0x7afdfc95 (stale) Mirror 24: 0x7afdfc95 (stale) Mirror 25: 0x7afdfc95 (stale) Mirror 26: 0x7afdfc95 (stale) Mirror 28: 0x7afdfc95 (stale) Mirror 29: 0x7afdfc95 (stale) Mirror 30: 0x7afdfc95 (stale) Mirror 31: 0x7afdfc95 (stale) Mirror 33: 0x2f5ddc93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16603): Mirror 6: 0x7afdfc95 (stale) Mirror 8: 0x7afdfc95 (stale) Mirror 15: 0x7afdfc95 (stale) Mirror 19: 0x7afdfc95 (stale) Mirror 23: 0x7afdfc95 (stale) Mirror 24: 0x7afdfc95 (stale) Mirror 25: 0x7afdfc95 (stale) Mirror 26: 0x7afdfc95 (stale) Mirror 28: 0x7afdfc95 (stale) Mirror 29: 0x7afdfc95 (stale) Mirror 30: 0x7afdfc95 (stale) Mirror 31: 0x7afdfc95 (stale) Mirror 33: 0x2f5ddc93 (stale) CRC-32 checksum value for chunk [0, 0x16603): Mirror 1: 0x961207ff Mirror 34: 0x961207ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16603: skipped 000888 1788199045.247021 mapwrite 0x005304 thru 0x01413e (0xee3b bytes) 000889 1788199045.525539 punch from 0x00a0e3 to 0x016602 (0xc520 bytes) 000892 1788199045.537643 MIRROR_RESYNC 15 mirrors 000893 1788199049.526786 punch from 0x00791e to 0x0083fa (0xadd bytes) 000894 1788199049.661340 mapwrite 0x001969 thru 0x001ee9 (0x581 bytes) 000895 1788199049.744677 punch from 0x002ad4 to 0x009068 (0x6595 bytes) 000897 1788199049.754180 mapwrite 0x0362e2 thru 0x03ffff (0x9d1e bytes) 000898 1788199049.878991 MIRROR_RESYNC 15 mirrors 000899 1788199054.161317 MIRROR_EXTEND to 16 mirrors 000900 1788199055.407526 read 0x028881 thru 0x0304bc (0x7c3c bytes) 000903 1788199055.421985 mapwrite 0x001205 thru 0x00569f (0x449b bytes) 000904 1788199055.689072 trunc from 0x040000 to 0x039b9b (0x6464 bytes) 000906 1788199055.733957 MIRROR_RESYNC 16 mirrors 000908 1788199060.411715 write 0x017e14 thru 0x021cb9 (0x9ea6 bytes) 000909 1788199060.499451 trunc from 0x039b9c to 0x01d6c3 (0x1c4d8 bytes) 000910 1788199060.526547 write 0x00305b thru 0x009499 (0x643f bytes) 000911 1788199060.551082 MIRROR_RESYNC 16 mirrors 000912 1788199063.274421 mapread 0x01498d thru 0x01d6c3 (0x8d37 bytes) 000913 1788199063.301911 write 0x033a7b thru 0x03ffff (0xc585 bytes) 000915 1788199063.392945 mapread 0x0151d7 thru 0x018b42 (0x396c bytes) 000916 1788199063.410620 write 0x02dda0 thru 0x03aad4 (0xcd35 bytes) 000917 1788199063.418188 mapwrite 0x0271ad thru 0x027b13 (0x967 bytes) 000918 1788199063.577658 read 0x039460 thru 0x03ffff (0x6ba0 bytes) 000919 1788199063.579137 write 0x03ea05 thru 0x03ffff (0x15fb bytes) 000921 1788199063.581863 punch from 0x025c31 to 0x032e2b (0xd1fb bytes) 000922 1788199063.592416 write 0x003227 thru 0x00b870 (0x864a bytes) 000923 1788199063.605935 mapread 0x01c09e thru 0x02ac5c (0xebbf bytes) 000925 1788199063.629483 punch from 0x01d0ad to 0x0220c9 (0x501d bytes) 000926 1788199063.642840 write 0x02d6c1 thru 0x0348d3 (0x7213 bytes) 000927 1788199063.644363 trunc from 0x040000 to 0x03f278 (0xd87 bytes) 000928 1788199063.677424 mapread 0x00baed thru 0x00d412 (0x1926 bytes) 000929 1788199063.684486 mapread 0x00169c thru 0x010519 (0xee7e bytes) 000930 1788199063.693779 punch from 0x02c4ae to 0x02d8ed (0x1440 bytes) 000934 1788199063.710860 trunc from 0x03f279 to 0x0164c6 (0x28db2 bytes) 000935 1788199063.747729 write 0x006461 thru 0x0142a1 (0xde41 bytes) 000937 1788199063.753187 trunc from 0x0164c7 to 0x00a021 (0xc4a5 bytes) 000938 1788199063.781575 trunc from 0x00a022 to 0x0264f6 (0x1c4d5 bytes) 000939 1788199063.811138 punch from 0x00f593 to 0x014aef (0x555d bytes) 000940 1788199063.826433 trunc from 0x0264f7 to 0x00f4c0 (0x17036 bytes) 000941 1788199063.846350 mapread 0x0037b1 thru 0x0050d3 (0x1923 bytes) 000942 1788199063.848267 punch from 0x009b4e to 0x00f4c0 (0x5973 bytes) 000943 1788199063.855320 punch from 0x009b43 to 0x00f4c0 (0x597e bytes) 000945 1788199063.862539 write 0x019294 thru 0x0287bd (0xf52a bytes) 000947 1788199063.868511 read 0x00e053 thru 0x011d3a (0x3ce8 bytes) 000949 1788199063.879662 mapread 0x00798c thru 0x014de7 (0xd45c bytes) 000950 1788199063.881027 read 0x017b44 thru 0x020a3d (0x8efa bytes) 000952 1788199063.883202 punch from 0x0232bc to 0x0287bd (0x5502 bytes) 000954 1788199063.900650 punch from 0x024d5a to 0x0287bd (0x3a64 bytes) 000955 1788199063.911013 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x178:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x287be): Mirror 6: 0xa2819bd0 (stale) Mirror 8: 0xa2819bd0 (stale) Mirror 15: 0xa2819bd0 (stale) Mirror 19: 0xa2819bd0 (stale) Mirror 23: 0xa2819bd0 (stale) Mirror 24: 0xa2819bd0 (stale) Mirror 25: 0xa2819bd0 (stale) Mirror 26: 0xa2819bd0 (stale) Mirror 28: 0xa2819bd0 (stale) Mirror 29: 0xa2819bd0 (stale) Mirror 30: 0xa2819bd0 (stale) Mirror 31: 0xa2819bd0 (stale) Mirror 34: 0xa2819bd0 (stale) Mirror 35: 0xa2819bd0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x287be): Mirror 6: 0xa2819bd0 (stale) Mirror 8: 0xa2819bd0 (stale) Mirror 15: 0xa2819bd0 (stale) Mirror 19: 0xa2819bd0 (stale) Mirror 23: 0xa2819bd0 (stale) Mirror 24: 0xa2819bd0 (stale) Mirror 25: 0xa2819bd0 (stale) Mirror 26: 0xa2819bd0 (stale) Mirror 28: 0xa2819bd0 (stale) Mirror 29: 0xa2819bd0 (stale) Mirror 30: 0xa2819bd0 (stale) Mirror 31: 0xa2819bd0 (stale) Mirror 34: 0xa2819bd0 (stale) Mirror 35: 0xa2819bd0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x287be: skipped 000957 1788199064.779995 trunc from 0x0287be to 0x02c162 (0x39a5 bytes) 000959 1788199064.833463 mapwrite 0x010fad thru 0x01bc24 (0xac78 bytes) 000961 1788199064.981414 mapwrite 0x01f8b1 thru 0x020f02 (0x1652 bytes) 000962 1788199065.046339 mapread 0x022aed thru 0x02396d (0xe81 bytes) 000963 1788199065.048071 mapread 0x00502e thru 0x00a704 (0x56d7 bytes) 000964 1788199065.076304 write 0x016bd1 thru 0x01f3b2 (0x87e2 bytes) 000965 1788199065.077440 read 0x00bcba thru 0x01bac7 (0xfe0e bytes) 000966 1788199065.077967 mapread 0x001092 thru 0x00b1b9 (0xa128 bytes) 000967 1788199065.084490 write 0x02432f thru 0x02fbc7 (0xb899 bytes) 000968 1788199065.098504 write 0x020d40 thru 0x02beae (0xb16f bytes) 000970 1788199065.102747 write 0x0177a5 thru 0x01c926 (0x5182 bytes) 000972 1788199065.110449 punch from 0x01d5d8 to 0x0259a5 (0x83ce bytes) 000973 1788199065.127338 read 0x001324 thru 0x00ce5a (0xbb37 bytes) 000974 1788199065.132785 write 0x019bdc thru 0x01b5ae (0x19d3 bytes) 000975 1788199065.139330 punch from 0x026918 to 0x02ea4d (0x8136 bytes) 000977 1788199065.173042 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2fbc8): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fbc8): Mirror 6: 0xd4e9c89a (stale) Mirror 8: 0xd4e9c89a (stale) Mirror 15: 0xd4e9c89a (stale) Mirror 19: 0xd4e9c89a (stale) Mirror 23: 0xd4e9c89a (stale) Mirror 24: 0xd4e9c89a (stale) Mirror 25: 0xd4e9c89a (stale) Mirror 26: 0xd4e9c89a (stale) Mirror 28: 0xd4e9c89a (stale) Mirror 29: 0xd4e9c89a (stale) Mirror 30: 0xd4e9c89a (stale) Mirror 31: 0xd4e9c89a (stale) Mirror 34: 0xd4e9c89a (stale) Mirror 35: 0xd4e9c89a (stale) CRC-32 checksum value for chunk [0, 0x2fbc8): Mirror 1: 0x9db801b7 Mirror 36: 0x9db801b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fbc8: skipped 000979 1788199066.524927 read 0x00bd62 thru 0x00ea7e (0x2d1d bytes) 000981 1788199066.540301 mapread 0x01cbe1 thru 0x021520 (0x4940 bytes) 000982 1788199066.572078 trunc from 0x02fbc8 to 0x01d619 (0x125ae bytes) 000983 1788199066.776447 trunc from 0x01d61a to 0x006c76 (0x169a3 bytes) 000984 1788199066.797497 mapwrite 0x00eb3c thru 0x0130cc (0x4591 bytes) 000985 1788199066.929581 mapread 0x003268 thru 0x009b22 (0x68bb bytes) 000987 1788199066.950442 read 0x011d96 thru 0x0130cc (0x1337 bytes) 000988 1788199066.956812 MIRROR_RESYNC 16 mirrors 000989 1788199069.129057 mapread 0x00fa51 thru 0x012375 (0x2925 bytes) 000991 1788199069.154772 trunc from 0x0130cd to 0x02ed0e (0x1bc42 bytes) 000992 1788199069.277486 MIRROR_RESYNC 16 mirrors 000995 1788199072.184614 read 0x011308 thru 0x01dff4 (0xcced bytes) 000997 1788199072.200075 read 0x00c810 thru 0x00f933 (0x3124 bytes) 001000 1788199072.210890 mapwrite 0x038475 thru 0x03e7d2 (0x635e bytes) All operations completed A-OK!