== sanity-flr test 70a: flr mode fsx test ================ 00:10:59 (1788581459) Seed set to 1461 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1788581462.327420 write 0x02bf3f thru 0x03214c (0x620e bytes) truncating to largest ever: 0x1aa02 000004 1788581462.358548 trunc from 0x03214d to 0x01aa01 (0x1774b bytes) 000005 1788581462.377556 punch from 0x013d62 to 0x01aa01 (0x6ca0 bytes) truncating to largest ever: 0x31cda 000006 1788581462.381720 trunc from 0x01aa02 to 0x031cd9 (0x172d8 bytes) 000007 1788581462.413575 mapwrite 0x021574 thru 0x023757 (0x21e4 bytes) 000008 1788581462.489936 mapread 0x01f918 thru 0x02dc43 (0xe32c bytes) 000009 1788581462.502501 write 0x01c42a thru 0x0215c0 (0x5197 bytes) 000011 1788581462.504843 mapread 0x00683b thru 0x00800d (0x17d3 bytes) 000012 1788581462.514136 write 0x00ad29 thru 0x00c6ba (0x1992 bytes) 000013 1788581462.515696 read 0x02d380 thru 0x02e7c5 (0x1446 bytes) 000017 1788581462.522870 MIRROR_EXTEND to 2 mirrors 000018 1788581463.758467 mapwrite 0x01441a thru 0x0202de (0xbec5 bytes) 000019 1788581464.054619 mapwrite 0x03869e thru 0x039148 (0xaab bytes) 000020 1788581464.136489 punch from 0x020004 to 0x020fdf (0xfdc bytes) 000021 1788581464.141428 trunc from 0x039149 to 0x01b5c9 (0x1db7f bytes) 000022 1788581464.162468 read 0x0010a8 thru 0x00f445 (0xe39e bytes) 000023 1788581464.171647 write 0x021f85 thru 0x028c25 (0x6ca1 bytes) 000024 1788581464.173452 mapwrite 0x01f51c thru 0x02d4e5 (0xdfca bytes) 000025 1788581464.254724 write 0x00a643 thru 0x01070a (0x60c8 bytes) 000026 1788581464.257524 punch from 0x02742f to 0x029a5c (0x262e bytes) 000027 1788581464.272913 mapread 0x00b5fe thru 0x014d4f (0x9752 bytes) 000028 1788581464.275445 mapwrite 0x02f225 thru 0x03b3cd (0xc1a9 bytes) 000029 1788581464.433465 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b3ce): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b3ce): Mirror 2: 0x102be031 (stale) CRC-32 checksum value for chunk [0, 0x3b3ce): Mirror 1: 0x9326267c Mirror 3: 0x9326267c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b3ce: skipped 000030 1788581465.403668 mapwrite 0x034c60 thru 0x03bd81 (0x7122 bytes) 000032 1788581465.569554 mapread 0x0147a4 thru 0x01ed87 (0xa5e4 bytes) 000034 1788581465.588549 mapwrite 0x019f33 thru 0x0207b8 (0x6886 bytes) 000035 1788581465.646445 write 0x0178f5 thru 0x023113 (0xb81f bytes) 000036 1788581465.654445 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3bd82): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd82): Mirror 2: 0x96a71f76 (stale) Mirror 3: 0xf19c14d (stale) CRC-32 checksum value for chunk [0, 0x3bd82): Mirror 1: 0x70c11283 Mirror 4: 0x70c11283 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd82: skipped 000039 1788581466.683573 mapread 0x02eb48 thru 0x03bd81 (0xd23a bytes) 000040 1788581466.752835 mapread 0x004023 thru 0x008094 (0x4072 bytes) 000044 1788581466.777158 read 0x0313e3 thru 0x0380d5 (0x6cf3 bytes) 000045 1788581466.780684 mapread 0x0253cf thru 0x0300b3 (0xace5 bytes) 000046 1788581466.803678 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3bd82): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd82): Mirror 2: 0x96a71f76 (stale) Mirror 3: 0xf19c14d (stale) CRC-32 checksum value for chunk [0, 0x3bd82): Mirror 1: 0x70c11283 Mirror 4: 0x70c11283 Mirror 5: 0x70c11283 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd82: skipped 000049 1788581467.914477 trunc from 0x03bd82 to 0x010141 (0x2bc40 bytes) 000051 1788581467.977723 trunc from 0x010142 to 0x01ecba (0xeb79 bytes) 000052 1788581467.991762 read 0x01a843 thru 0x01d412 (0x2bd0 bytes) 000053 1788581467.996418 mapwrite 0x01af4a thru 0x01ba2c (0xae3 bytes) 000055 1788581468.021472 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ecbb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ecbb): Mirror 2: 0x3e1544e2 (stale) Mirror 3: 0xd14138b1 (stale) Mirror 4: 0x3cc9ade1 (stale) Mirror 5: 0x3cc9ade1 (stale) CRC-32 checksum value for chunk [0, 0x1ecbb): Mirror 1: 0xb5fd7419 Mirror 6: 0xb5fd7419 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ecbb: skipped 000056 1788581469.016063 punch from 0x016332 to 0x01b660 (0x532f bytes) 000057 1788581469.092024 mapread 0x01dc38 thru 0x01ecba (0x1083 bytes) 000059 1788581469.105014 mapwrite 0x035962 thru 0x03c897 (0x6f36 bytes) 000060 1788581469.244611 mapread 0x026613 thru 0x02a287 (0x3c75 bytes) 000061 1788581469.261980 trunc from 0x03c898 to 0x01a31a (0x2257d bytes) 000062 1788581469.292824 mapwrite 0x0030dd thru 0x006466 (0x338a bytes) 000063 1788581469.347375 trunc from 0x01a31b to 0x018c0a (0x1710 bytes) 000064 1788581469.365855 write 0x005e6c thru 0x012ac0 (0xcc55 bytes) 000065 1788581469.375851 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x18c0b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18c0b): Mirror 2: 0x88cdc6e3 (stale) Mirror 3: 0xf474724c (stale) Mirror 4: 0xbcea863b (stale) Mirror 5: 0xbcea863b (stale) Mirror 6: 0xd33d93ed (stale) CRC-32 checksum value for chunk [0, 0x18c0b): Mirror 1: 0x5a54295f Mirror 7: 0x5a54295f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18c0b: skipped 000067 1788581470.522346 write 0x01485d thru 0x023528 (0xeccc bytes) 000068 1788581470.613980 mapread 0x00d635 thru 0x01b1b3 (0xdb7f bytes) 000070 1788581470.635724 write 0x03bebb thru 0x03ffff (0x4145 bytes) 000071 1788581470.636879 punch from 0x037b65 to 0x03ffff (0x849b bytes) 000072 1788581470.654881 mapread 0x000c99 thru 0x00cbb9 (0xbf21 bytes) 000073 1788581470.664881 write 0x02f653 thru 0x034eef (0x589d bytes) 000074 1788581470.674710 write 0x007b45 thru 0x014e3f (0xd2fb bytes) 000075 1788581470.676983 mapwrite 0x01db48 thru 0x01e5fb (0xab4 bytes) 000077 1788581470.741838 write 0x0278bd thru 0x02c98e (0x50d2 bytes) 000078 1788581470.752862 trunc from 0x040000 to 0x02fa23 (0x105dc bytes) 000081 1788581470.780373 punch from 0x025aad to 0x02d3b2 (0x7906 bytes) 000083 1788581470.799344 punch from 0x00b42a to 0x00f710 (0x42e7 bytes) 000084 1788581470.804952 read 0x01e20b thru 0x024cb8 (0x6aae bytes) 000085 1788581470.817315 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa24): Mirror 2: 0xfc34da0c (stale) Mirror 4: 0xc6bac7ac (stale) Mirror 5: 0xc6bac7ac (stale) Mirror 6: 0x5963a43e (stale) Mirror 7: 0xab2737fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa24): Mirror 2: 0xfc34da0c (stale) Mirror 4: 0xc6bac7ac (stale) Mirror 5: 0xc6bac7ac (stale) Mirror 6: 0x5963a43e (stale) Mirror 7: 0xab2737fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa24: skipped 000088 1788581471.441450 mapread 0x02087e thru 0x02c7f2 (0xbf75 bytes) 000089 1788581471.469881 write 0x02e814 thru 0x03653d (0x7d2a bytes) 000090 1788581471.473750 mapread 0x01f070 thru 0x02c575 (0xd506 bytes) 000091 1788581471.479671 mapread 0x02ef12 thru 0x03653d (0x762c bytes) 000094 1788581471.483887 write 0x00612a thru 0x0158b6 (0xf78d bytes) 000096 1788581471.505183 mapwrite 0x030310 thru 0x03b285 (0xaf76 bytes) 000101 1788581471.633837 write 0x03d543 thru 0x03ffff (0x2abd bytes) 000102 1788581471.641495 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x12429a8 (stale) Mirror 4: 0x7c418f96 (stale) Mirror 5: 0x7c418f96 (stale) Mirror 6: 0x4cd30f80 (stale) Mirror 7: 0x9c4ee7db (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4b6b0795 Mirror 8: 0x4b6b0795 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000103 1788581473.339339 mapread 0x016776 thru 0x020239 (0x9ac4 bytes) 000104 1788581473.390977 punch from 0x0103bf to 0x013523 (0x3165 bytes) 000106 1788581473.529678 mapread 0x03fa04 thru 0x03ffff (0x5fc bytes) 000107 1788581473.546503 trunc from 0x040000 to 0x00e22f (0x31dd0 bytes) 000108 1788581473.579688 write 0x03f17f thru 0x03ffff (0xe81 bytes) 000109 1788581473.585935 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x12429a8 (stale) Mirror 4: 0x7c418f96 (stale) Mirror 5: 0x7c418f96 (stale) Mirror 6: 0x4cd30f80 (stale) Mirror 7: 0x9c4ee7db (stale) Mirror 8: 0x4b6b0795 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf935f3c3 Mirror 9: 0xf935f3c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000110 1788581474.839642 mapread 0x00a790 thru 0x011e74 (0x76e5 bytes) 000111 1788581474.903811 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x12429a8 (stale) Mirror 4: 0x7c418f96 (stale) Mirror 5: 0x7c418f96 (stale) Mirror 6: 0x4cd30f80 (stale) Mirror 7: 0x9c4ee7db (stale) Mirror 8: 0x4b6b0795 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x12429a8 (stale) Mirror 4: 0x7c418f96 (stale) Mirror 5: 0x7c418f96 (stale) Mirror 6: 0x4cd30f80 (stale) Mirror 7: 0x9c4ee7db (stale) Mirror 8: 0x4b6b0795 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000113 1788581475.472462 trunc from 0x040000 to 0x01d928 (0x226d7 bytes) 000114 1788581475.511460 write 0x034018 thru 0x035e10 (0x1df9 bytes) 000115 1788581475.513963 trunc from 0x035e11 to 0x02ae5d (0xafb3 bytes) 000117 1788581475.533511 write 0x02ffc8 thru 0x039a7c (0x9ab5 bytes) 000118 1788581475.536854 mapwrite 0x03a489 thru 0x03bded (0x1965 bytes) 000119 1788581475.633576 trunc from 0x03bdee to 0x004532 (0x378bb bytes) 000120 1788581475.657603 mapread 0x00250e thru 0x004532 (0x2025 bytes) 000121 1788581475.667604 trunc from 0x004533 to 0x0085a9 (0x4077 bytes) 000122 1788581475.690701 trunc from 0x0085aa to 0x01cd25 (0x1477c bytes) 000123 1788581475.708438 mapwrite 0x00042a thru 0x0019a7 (0x157e bytes) 000125 1788581475.762797 read 0x003f4e thru 0x00f23b (0xb2ee bytes) 000127 1788581475.763860 write 0x00d791 thru 0x019c84 (0xc4f4 bytes) 000128 1788581475.769891 read 0x01350f thru 0x013b3c (0x62e bytes) 000130 1788581475.771344 read 0x011f84 thru 0x01bd14 (0x9d91 bytes) 000132 1788581475.778472 mapwrite 0x033bda thru 0x03507a (0x14a1 bytes) 000133 1788581475.922841 write 0x03b49c thru 0x03cab5 (0x161a bytes) 000134 1788581475.929257 mapread 0x02d8a5 thru 0x03928a (0xb9e6 bytes) 000135 1788581475.942097 trunc from 0x03cab6 to 0x02f5e2 (0xd4d3 bytes) 000137 1788581475.987337 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f5e3): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5e3): Mirror 2: 0xede3baab (stale) Mirror 4: 0x448ae136 (stale) Mirror 5: 0x448ae136 (stale) Mirror 6: 0x97941f53 (stale) Mirror 7: 0x204436d5 (stale) Mirror 8: 0xdf35a9fa (stale) CRC-32 checksum value for chunk [0, 0x2f5e3): Mirror 1: 0x121515a6 Mirror 9: 0x121515a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5e3: skipped 000138 1788581477.517543 punch from 0x02a1c8 to 0x02f5e2 (0x541b bytes) 000139 1788581477.679866 punch from 0x022f1e to 0x02567e (0x2761 bytes) 000141 1788581477.683990 mapread 0x008cf6 thru 0x00e138 (0x5443 bytes) 000142 1788581477.735528 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f5e3): Mirror 2: 0xede3baab (stale) Mirror 4: 0x448ae136 (stale) Mirror 5: 0x448ae136 (stale) Mirror 7: 0x204436d5 (stale) Mirror 8: 0xdf35a9fa (stale) Mirror 9: 0x121515a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5e3): Mirror 2: 0xede3baab (stale) Mirror 4: 0x448ae136 (stale) Mirror 5: 0x448ae136 (stale) Mirror 7: 0x204436d5 (stale) Mirror 8: 0xdf35a9fa (stale) Mirror 9: 0x121515a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5e3: skipped 000143 1788581478.379739 trunc from 0x02f5e3 to 0x001c07 (0x2d9db bytes) 000144 1788581478.403828 punch from 0x000228 to 0x001c07 (0x19e0 bytes) 000146 1788581478.426205 trunc from 0x001c08 to 0x00e8bd (0xccb6 bytes) 000147 1788581478.447928 trunc from 0x00e8be to 0x02b228 (0x1c96b bytes) 000148 1788581478.472616 mapwrite 0x031978 thru 0x03335f (0x19e8 bytes) 000150 1788581478.605520 read 0x00d50b thru 0x011646 (0x413c bytes) 000151 1788581478.616779 mapwrite 0x0335be thru 0x03d96e (0xa3b1 bytes) 000153 1788581478.728855 punch from 0x01b1d4 to 0x01bf5f (0xd8c bytes) 000154 1788581478.737430 write 0x01d1cd thru 0x026021 (0x8e55 bytes) 000155 1788581478.754142 mapread 0x0259d5 thru 0x029239 (0x3865 bytes) 000156 1788581478.760413 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d96f): Mirror 2: 0x788987a7 (stale) Mirror 4: 0xd7769f07 (stale) Mirror 5: 0xd7769f07 (stale) Mirror 7: 0x3e4451d1 (stale) Mirror 8: 0x4542c9de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d96f): Mirror 2: 0x788987a7 (stale) Mirror 4: 0xd7769f07 (stale) Mirror 5: 0xd7769f07 (stale) Mirror 7: 0x3e4451d1 (stale) Mirror 8: 0x4542c9de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d96f: skipped 000157 1788581479.248797 punch from 0x0374d7 to 0x03cbb8 (0x56e2 bytes) 000158 1788581479.256644 write 0x0275eb thru 0x031551 (0x9f67 bytes) 000163 1788581479.272525 punch from 0x008a4b to 0x0154cb (0xca81 bytes) 000164 1788581479.293003 trunc from 0x03d96f to 0x0225f3 (0x1b37b bytes) 000167 1788581479.318248 write 0x005581 thru 0x0143cc (0xee4c bytes) 000169 1788581479.329427 mapwrite 0x00bdc4 thru 0x018fa1 (0xd1de bytes) 000170 1788581479.412733 mapwrite 0x0315f9 thru 0x0358a6 (0x42ae bytes) 000171 1788581479.511150 write 0x00c537 thru 0x01672a (0xa1f4 bytes) 000172 1788581479.513327 write 0x02b59e thru 0x02bad4 (0x537 bytes) 000173 1788581479.517660 mapread 0x031817 thru 0x0358a6 (0x4090 bytes) 000174 1788581479.518586 read 0x025e81 thru 0x028e4e (0x2fce bytes) 000175 1788581479.530577 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x358a7): Mirror 4: 0x6ab61041 (stale) Mirror 5: 0x6ab61041 (stale) Mirror 7: 0xa422d89 (stale) Mirror 8: 0x7887b470 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x358a7): Mirror 4: 0x6ab61041 (stale) Mirror 5: 0x6ab61041 (stale) Mirror 7: 0xa422d89 (stale) Mirror 8: 0x7887b470 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x358a7: skipped 000176 1788581480.097271 punch from 0x003757 to 0x00e680 (0xaf2a bytes) 000177 1788581480.106267 punch from 0x034e94 to 0x035111 (0x27e bytes) 000178 1788581480.112707 mapwrite 0x02da58 thru 0x033703 (0x5cac bytes) 000179 1788581480.220120 punch from 0x005ed4 to 0x00e9ec (0x8b19 bytes) 000180 1788581480.226506 punch from 0x0313de to 0x0358a6 (0x44c9 bytes) 000181 1788581480.233464 punch from 0x0186d3 to 0x01d296 (0x4bc4 bytes) 000182 1788581480.247552 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x358a7): Mirror 5: 0x6ab61041 (stale) Mirror 7: 0xa422d89 (stale) Mirror 8: 0x7887b470 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x358a7): Mirror 5: 0x6ab61041 (stale) Mirror 7: 0xa422d89 (stale) Mirror 8: 0x7887b470 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x358a7: skipped 000183 1788581480.650462 write 0x006d7b thru 0x00ee98 (0x811e bytes) 000184 1788581480.664498 mapwrite 0x02671f thru 0x029140 (0x2a22 bytes) 000185 1788581480.770144 mapwrite 0x019765 thru 0x024bd6 (0xb472 bytes) 000186 1788581480.870466 mapread 0x00c610 thru 0x01b80a (0xf1fb bytes) 000187 1788581480.881849 trunc from 0x0358a7 to 0x00b1f5 (0x2a6b1 bytes) 000188 1788581480.909671 mapwrite 0x03dccb thru 0x03ffff (0x2335 bytes) 000191 1788581481.020070 punch from 0x00baed to 0x00e929 (0x2e3d bytes) 000193 1788581481.027742 mapread 0x03466e thru 0x03ffff (0xb992 bytes) 000194 1788581481.041648 mapread 0x02c1ad thru 0x0338bf (0x7713 bytes) 000195 1788581481.053683 mapread 0x006f69 thru 0x00718d (0x225 bytes) 000197 1788581481.068387 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x7c418f96 (stale) Mirror 7: 0x9c4ee7db (stale) Mirror 8: 0x4b6b0795 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa1004263 Mirror 9: 0xa1004263 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000198 1788581482.663671 mapwrite 0x030341 thru 0x030872 (0x532 bytes) 000200 1788581482.827816 trunc from 0x040000 to 0x00a351 (0x35cae bytes) 000201 1788581482.855344 mapwrite 0x002a33 thru 0x002a70 (0x3e bytes) 000202 1788581482.917840 write 0x023535 thru 0x02df23 (0xa9ef bytes) 000203 1788581482.921647 write 0x022e4e thru 0x03193b (0xeaee bytes) 000205 1788581482.929571 trunc from 0x03193c to 0x02dff2 (0x3949 bytes) 000206 1788581482.954388 mapwrite 0x03356c thru 0x035248 (0x1cdd bytes) 000211 1788581483.047556 mapread 0x01bf54 thru 0x01c2e6 (0x393 bytes) 000212 1788581483.077349 mapwrite 0x02b4ee thru 0x02d1bf (0x1cd2 bytes) 000214 1788581483.128022 punch from 0x024fba to 0x02b47b (0x64c2 bytes) 000216 1788581483.138399 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35249): Mirror 5: 0x8aeb74b3 (stale) Mirror 7: 0x3bc0f156 (stale) Mirror 8: 0x6d015399 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35249): Mirror 5: 0x8aeb74b3 (stale) Mirror 7: 0x3bc0f156 (stale) Mirror 8: 0x6d015399 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35249: skipped 000220 1788581483.566388 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35249): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35249): Mirror 5: 0x8aeb74b3 (stale) Mirror 7: 0x3bc0f156 (stale) Mirror 8: 0x6d015399 (stale) CRC-32 checksum value for chunk [0, 0x35249): Mirror 1: 0xe6bcab0e Mirror 9: 0xe6bcab0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35249: skipped 000221 1788581484.602567 read 0x011531 thru 0x01dd1a (0xc7ea bytes) 000222 1788581484.618780 trunc from 0x035249 to 0x022a45 (0x12803 bytes) 000223 1788581484.684861 read 0x022260 thru 0x022a45 (0x7e6 bytes) 000225 1788581484.694496 mapread 0x016fd3 thru 0x01b85a (0x4888 bytes) 000227 1788581484.695908 punch from 0x016738 to 0x01e79e (0x8067 bytes) 000228 1788581484.701633 write 0x022d04 thru 0x02833b (0x5638 bytes) 000229 1788581484.703328 trunc from 0x02833c to 0x0118f2 (0x16a49 bytes) 000230 1788581484.721877 write 0x02c5b5 thru 0x030bc9 (0x4615 bytes) 000231 1788581484.723541 mapread 0x02c7a1 thru 0x030bc9 (0x4429 bytes) 000232 1788581484.725744 trunc from 0x030bca to 0x00570c (0x2b4bd bytes) 000233 1788581484.742643 mapwrite 0x031b37 thru 0x038164 (0x662e bytes) 000235 1788581484.812885 read 0x001633 thru 0x004ae5 (0x34b3 bytes) 000236 1788581484.813508 punch from 0x025aec to 0x025b94 (0xa9 bytes) 000239 1788581484.819215 read 0x036166 thru 0x038164 (0x1fff bytes) 000241 1788581484.821284 mapread 0x0180cd thru 0x0250a6 (0xcfda bytes) 000242 1788581484.829215 mapwrite 0x01bdb1 thru 0x021d6c (0x5fbc bytes) 000243 1788581484.873909 mapwrite 0x032363 thru 0x036e6c (0x4b0a bytes) 000244 1788581484.919514 mapread 0x00159f thru 0x0094a5 (0x7f07 bytes) 000245 1788581484.922983 punch from 0x00ce44 to 0x013d1b (0x6ed8 bytes) 000246 1788581484.927966 punch from 0x013e61 to 0x014807 (0x9a7 bytes) 000247 1788581484.934962 mapwrite 0x031f93 thru 0x039e5d (0x7ecb bytes) 000248 1788581485.014517 punch from 0x01b96f to 0x021953 (0x5fe5 bytes) 000249 1788581485.020166 mapread 0x00dd67 thru 0x01b2c3 (0xd55d bytes) 000250 1788581485.081491 mapread 0x01a585 thru 0x01f6ad (0x5129 bytes) 000252 1788581485.100604 mapwrite 0x027f5d thru 0x0329ef (0xaa93 bytes) 000253 1788581485.153532 write 0x03808f thru 0x03ffff (0x7f71 bytes) 000254 1788581485.154571 trunc from 0x040000 to 0x02f8d7 (0x10728 bytes) 000255 1788581485.168522 write 0x022762 thru 0x031906 (0xf1a5 bytes) 000256 1788581485.171389 punch from 0x00c623 to 0x01975e (0xd13c bytes) 000259 1788581485.191579 mapwrite 0x0147af thru 0x0200b5 (0xb907 bytes) 000261 1788581485.273033 trunc from 0x031907 to 0x0090d8 (0x2882e bytes) 000263 1788581485.298294 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x90d9): Mirror 5: 0xa2427409 (stale) Mirror 7: 0xcd8d0e01 (stale) Mirror 9: 0xcd499421 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x90d9): Mirror 5: 0xa2427409 (stale) Mirror 7: 0xcd8d0e01 (stale) Mirror 9: 0xcd499421 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x90d9: skipped truncating to largest ever: 0x3e619 000264 1788581485.566646 trunc from 0x0090d9 to 0x03e618 (0x35540 bytes) 000265 1788581485.586490 MIRROR_RESYNC 4 mirrors 000266 1788581486.514955 write 0x0040d1 thru 0x00aaa4 (0x69d4 bytes) 000267 1788581486.591964 mapwrite 0x03e7ce thru 0x03ffff (0x1832 bytes) 000268 1788581486.716020 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x13a192cd (stale) Mirror 9: 0x13a192cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x13a192cd (stale) Mirror 9: 0x13a192cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000269 1788581487.033706 mapread 0x00270c thru 0x00b748 (0x903d bytes) 000270 1788581487.057320 read 0x004281 thru 0x00e6c0 (0xa440 bytes) 000271 1788581487.057871 trunc from 0x040000 to 0x030f6e (0xf091 bytes) 000273 1788581487.086665 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30f6f): Mirror 5: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30f6f): Mirror 5: 0x8fbce950 (stale) Mirror 9: 0x8fbce950 (stale) CRC-32 checksum value for chunk [0, 0x30f6f): Mirror 1: 0xb45771c6 Mirror 10: 0xb45771c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30f6f: skipped 000274 1788581488.009646 trunc from 0x030f6f to 0x02874f (0x881f bytes) 000275 1788581488.104516 write 0x01c8bc thru 0x0264ec (0x9c31 bytes) 000276 1788581488.117509 read 0x021985 thru 0x02874f (0x6dcb bytes) 000277 1788581488.123484 read 0x007ee4 thru 0x00aea2 (0x2fbf bytes) 000279 1788581488.137744 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28750): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28750): Mirror 5: 0xa60e5f91 (stale) Mirror 9: 0xa60e5f91 (stale) Mirror 10: 0xeece649b (stale) CRC-32 checksum value for chunk [0, 0x28750): Mirror 1: 0x8c243328 Mirror 11: 0x8c243328 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28750: skipped 000280 1788581489.343839 trunc from 0x028750 to 0x00a7d9 (0x1df76 bytes) 000281 1788581489.500857 punch from 0x004736 to 0x007fd1 (0x389c bytes) 000282 1788581489.511107 mapread 0x005bcc thru 0x00a7d9 (0x4c0e bytes) 000283 1788581489.532492 mapread 0x006b29 thru 0x00a7d9 (0x3cb1 bytes) 000284 1788581489.537864 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa7da): Mirror 5: 0xd408dd8d (stale) Mirror 9: 0xd408dd8d (stale) Mirror 11: 0xfe4be49c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa7da): Mirror 5: 0xd408dd8d (stale) Mirror 9: 0xd408dd8d (stale) Mirror 11: 0xfe4be49c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa7da: skipped 000285 1788581489.835251 punch from 0x00285a to 0x00305e (0x805 bytes) 000286 1788581489.842022 punch from 0x00149c to 0x001fa1 (0xb06 bytes) 000287 1788581489.849371 write 0x008bc5 thru 0x008c65 (0xa1 bytes) 000290 1788581489.857383 mapread 0x002da5 thru 0x00a7d9 (0x7a35 bytes) 000291 1788581489.882021 write 0x03a589 thru 0x03ffff (0x5a77 bytes) 000292 1788581489.890837 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x13a192cd (stale) Mirror 9: 0x13a192cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x13a192cd (stale) Mirror 9: 0x13a192cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000293 1788581490.171381 mapread 0x0014db thru 0x00a438 (0x8f5e bytes) 000294 1788581490.191708 MIRROR_RESYNC 3 mirrors 000295 1788581490.977776 write 0x01d6ae thru 0x029f93 (0xc8e6 bytes) 000296 1788581491.094557 punch from 0x009f1f to 0x016021 (0xc103 bytes) 000297 1788581491.116349 mapwrite 0x008708 thru 0x00ca5a (0x4353 bytes) 000298 1788581491.208353 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x67e161c8 (stale) Mirror 9: 0x67e161c8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xedb80471 Mirror 10: 0xedb80471 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000299 1788581492.099670 trunc from 0x040000 to 0x027f06 (0x180f9 bytes) 000300 1788581492.203307 write 0x000c3c thru 0x008d44 (0x8109 bytes) 000301 1788581492.215399 mapwrite 0x01a61e thru 0x01ada4 (0x787 bytes) 000303 1788581492.274590 MIRROR_RESYNC 4 mirrors 000304 1788581493.688140 read 0x020f45 thru 0x02688c (0x5948 bytes) 000307 1788581493.696425 write 0x022f1a thru 0x025c1c (0x2d03 bytes) 000308 1788581493.780321 mapwrite 0x012832 thru 0x01fa21 (0xd1f0 bytes) 000309 1788581493.833527 trunc from 0x027f07 to 0x025cff (0x2207 bytes) 000311 1788581493.845801 read 0x007716 thru 0x00e9df (0x72ca bytes) 000312 1788581493.853128 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25d00): Mirror 5: 0x9d603e19 (stale) Mirror 10: 0x9d603e19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25d00): Mirror 5: 0x9d603e19 (stale) Mirror 10: 0x9d603e19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25d00: skipped 000315 1788581494.176692 MIRROR_RESYNC 3 mirrors 000317 1788581494.951213 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000319 1788581495.278914 write 0x017591 thru 0x01b8cf (0x433f bytes) 000320 1788581495.413272 read 0x007304 thru 0x00b797 (0x4494 bytes) 000321 1788581495.428503 write 0x024962 thru 0x02a7b5 (0x5e54 bytes) 000323 1788581495.435159 mapread 0x01ab53 thru 0x028b48 (0xdff6 bytes) 000324 1788581495.457111 mapread 0x0096c3 thru 0x009aec (0x42a bytes) 000325 1788581495.457966 read 0x020cc8 thru 0x02a7b5 (0x9aee bytes) 000328 1788581495.463680 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000329 1788581495.620589 mapread 0x011636 thru 0x0143c6 (0x2d91 bytes) 000330 1788581495.670851 punch from 0x01d55d to 0x022c0b (0x56af bytes) 000331 1788581495.685362 read 0x028415 thru 0x02a7b5 (0x23a1 bytes) 000334 1788581495.702074 mapread 0x014613 thru 0x01c77f (0x816d bytes) 000339 1788581495.723477 write 0x00a897 thru 0x012858 (0x7fc2 bytes) 000340 1788581495.758897 mapwrite 0x01d3b0 thru 0x02adbe (0xda0f bytes) 000341 1788581495.859988 write 0x03fadb thru 0x03ffff (0x525 bytes) 000342 1788581495.862577 read 0x03cc5a thru 0x03d31d (0x6c4 bytes) 000343 1788581495.884988 punch from 0x03858a to 0x03ffff (0x7a76 bytes) 000345 1788581495.922136 MIRROR_EXTEND to 2 mirrors 000346 1788581496.756118 MIRROR_EXTEND to 3 mirrors 000347 1788581497.483315 mapwrite 0x0090bc thru 0x010bad (0x7af2 bytes) 000348 1788581497.651934 write 0x030263 thru 0x03e7c1 (0xe55f bytes) 000349 1788581497.666875 read 0x0140ab thru 0x01418f (0xe5 bytes) 000351 1788581497.693783 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xff25e781 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xff25e781 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000352 1788581497.995435 trunc from 0x040000 to 0x03bfaa (0x4055 bytes) 000353 1788581498.015229 mapread 0x02c392 thru 0x032c84 (0x68f3 bytes) 000356 1788581498.055923 mapwrite 0x015b33 thru 0x02296e (0xce3c bytes) 000357 1788581498.238697 read 0x01fb55 thru 0x02e97b (0xee27 bytes) 000358 1788581498.242434 mapwrite 0x0086f4 thru 0x00b8b4 (0x31c1 bytes) 000359 1788581498.323233 read 0x005100 thru 0x00f65b (0xa55c bytes) 000360 1788581498.323905 read 0x02cfaf thru 0x03ae5c (0xdeae bytes) 000362 1788581498.348807 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000363 1788581498.557925 mapwrite 0x005b05 thru 0x00bafc (0x5ff8 bytes) 000364 1788581498.640108 trunc from 0x03bfab to 0x003853 (0x38757 bytes) 000366 1788581498.658138 write 0x00ccde thru 0x011b78 (0x4e9b bytes) 000367 1788581498.659413 punch from 0x0023f4 to 0x005d0d (0x391a bytes) 000368 1788581498.674861 trunc from 0x011b79 to 0x008580 (0x95f8 bytes) 000369 1788581498.691413 trunc from 0x008581 to 0x028600 (0x20080 bytes) 000370 1788581498.708383 trunc from 0x028601 to 0x00ac01 (0x1d9ff bytes) 000375 1788581498.726233 trunc from 0x00ac02 to 0x037a8e (0x2ce8d bytes) 000376 1788581498.740316 mapwrite 0x03b7e2 thru 0x03c36f (0xb8e bytes) 000377 1788581498.834389 write 0x018ac3 thru 0x028975 (0xfeb3 bytes) 000380 1788581498.849687 trunc from 0x03c370 to 0x01e27e (0x1e0f1 bytes) 000381 1788581498.865295 trunc from 0x01e27f to 0x0349b1 (0x16733 bytes) 000382 1788581498.883415 trunc from 0x0349b2 to 0x03881b (0x3e6a bytes) 000383 1788581498.909474 mapwrite 0x00b3c6 thru 0x013ac6 (0x8701 bytes) 000384 1788581498.972453 trunc from 0x03881c to 0x03bf84 (0x3769 bytes) 000385 1788581498.996195 read 0x020d4f thru 0x026881 (0x5b33 bytes) 000386 1788581499.005421 write 0x013fbf thru 0x01a399 (0x63db bytes) 000388 1788581499.012360 MIRROR_EXTEND to 2 mirrors 000389 1788581500.035448 write 0x02e518 thru 0x0311de (0x2cc7 bytes) 000390 1788581500.153865 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000391 1788581500.325845 write 0x0249f2 thru 0x02badb (0x70ea bytes) 000393 1788581500.344477 mapwrite 0x017bd8 thru 0x026caa (0xf0d3 bytes) 000394 1788581500.427414 read 0x004458 thru 0x00d5dc (0x9185 bytes) 000395 1788581500.436294 punch from 0x0149dc to 0x014ac6 (0xeb bytes) 000396 1788581500.442630 mapwrite 0x007420 thru 0x01250e (0xb0ef bytes) 000397 1788581500.525297 trunc from 0x03bf85 to 0x00c6d0 (0x2f8b4 bytes) 000398 1788581500.568360 mapwrite 0x029726 thru 0x038357 (0xec32 bytes) 000401 1788581500.655149 mapwrite 0x027a79 thru 0x032ae1 (0xb069 bytes) 000403 1788581500.707233 read 0x0131e6 thru 0x016974 (0x378f bytes) 000404 1788581500.718004 read 0x006c49 thru 0x00d902 (0x6cba bytes) 000406 1788581500.724446 read 0x020adf thru 0x028e00 (0x8322 bytes) 000408 1788581500.727351 write 0x00119f thru 0x00ff05 (0xed67 bytes) 000409 1788581500.729403 punch from 0x02dd53 to 0x038357 (0xa605 bytes) 000413 1788581500.744216 mapread 0x02fb9b thru 0x038357 (0x87bd bytes) 000416 1788581500.756297 mapread 0x0220e4 thru 0x02ab72 (0x8a8f bytes) 000417 1788581500.757502 mapwrite 0x02c32f thru 0x0334b8 (0x718a bytes) 000418 1788581500.807463 read 0x0300a9 thru 0x037a57 (0x79af bytes) 000419 1788581500.808068 mapread 0x015837 thru 0x01dd8c (0x8556 bytes) 000422 1788581500.811420 punch from 0x01e942 to 0x020ca2 (0x2361 bytes) 000423 1788581500.816492 mapwrite 0x02b22b thru 0x02ca0a (0x17e0 bytes) 000425 1788581500.851364 punch from 0x0300ef to 0x038357 (0x8269 bytes) 000426 1788581500.855889 trunc from 0x038358 to 0x01a451 (0x1df06 bytes) 000427 1788581500.876167 read 0x009c79 thru 0x018b23 (0xeeab bytes) 000428 1788581500.876798 mapread 0x008370 thru 0x016c2f (0xe8c0 bytes) 000430 1788581500.878582 write 0x01a922 thru 0x02a8d2 (0xffb1 bytes) 000431 1788581500.880263 read 0x024316 thru 0x02723b (0x2f26 bytes) 000433 1788581500.882847 read 0x024579 thru 0x02a8d2 (0x635a bytes) 000434 1788581500.883663 write 0x029197 thru 0x035c61 (0xcacb bytes) 000436 1788581500.886071 punch from 0x005e20 to 0x006d13 (0xef4 bytes) 000438 1788581500.897253 trunc from 0x035c62 to 0x01b990 (0x1a2d1 bytes) 000440 1788581500.915745 read 0x00002a thru 0x003420 (0x33f7 bytes) 000442 1788581500.918825 trunc from 0x01b991 to 0x02bf49 (0x105b9 bytes) 000444 1788581500.937825 read 0x016780 thru 0x0246ca (0xdf4b bytes) 000446 1788581500.950105 trunc from 0x02bf4a to 0x01f8aa (0xc69f bytes) 000447 1788581500.965754 mapread 0x00f75d thru 0x016e70 (0x7714 bytes) 000451 1788581500.973715 mapread 0x01ebb6 thru 0x01f8aa (0xcf5 bytes) 000454 1788581500.975992 read 0x018685 thru 0x01cb02 (0x447e bytes) 000456 1788581500.978424 read 0x005b9d thru 0x0062e7 (0x74b bytes) 000458 1788581500.981361 write 0x03e6f6 thru 0x03ea56 (0x361 bytes) 000461 1788581500.984879 write 0x01a188 thru 0x01afa5 (0xe1e bytes) 000463 1788581500.986813 read 0x00a3f2 thru 0x013767 (0x9376 bytes) 000465 1788581500.988839 mapwrite 0x0083fc thru 0x00ed07 (0x690c bytes) 000467 1788581501.054825 punch from 0x00abcc to 0x00b764 (0xb99 bytes) 000468 1788581501.060345 mapwrite 0x03782c thru 0x03f8c8 (0x809d bytes) 000469 1788581501.144454 read 0x02b98c thru 0x03aedd (0xf552 bytes) 000470 1788581501.145821 mapwrite 0x03aaa8 thru 0x03ffff (0x5558 bytes) 000472 1788581501.247578 MIRROR_EXTEND to 2 mirrors 000474 1788581502.520235 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000475 1788581502.749836 mapread 0x03fcc1 thru 0x03ffff (0x33f bytes) 000476 1788581502.757474 mapwrite 0x0270b4 thru 0x02a51f (0x346c bytes) 000480 1788581502.942690 punch from 0x0388e8 to 0x03ffff (0x7718 bytes) 000482 1788581502.964786 mapwrite 0x01323d thru 0x01ecf7 (0xbabb bytes) 000484 1788581503.138393 read 0x034fc9 thru 0x03f997 (0xa9cf bytes) 000485 1788581503.151430 punch from 0x02800f to 0x02c257 (0x4249 bytes) 000486 1788581503.159410 MIRROR_EXTEND to 2 mirrors 000490 1788581504.343683 mapwrite 0x019b36 thru 0x020401 (0x68cc bytes) 000491 1788581504.524845 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcc4b6798 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4332e4f8 Mirror 3: 0x4332e4f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000493 1788581505.601155 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcc4b6798 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4332e4f8 Mirror 3: 0x4332e4f8 Mirror 4: 0x4332e4f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000495 1788581506.694153 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcc4b6798 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4332e4f8 Mirror 3: 0x4332e4f8 Mirror 4: 0x4332e4f8 Mirror 5: 0x4332e4f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000496 1788581508.116700 read 0x01a341 thru 0x02658a (0xc24a bytes) 000497 1788581508.136382 write 0x0007b2 thru 0x00be17 (0xb666 bytes) 000498 1788581508.333459 read 0x01dc99 thru 0x0288c0 (0xac28 bytes) 000499 1788581508.355655 mapwrite 0x02e967 thru 0x033a68 (0x5102 bytes) 000500 1788581508.467848 write 0x014827 thru 0x01c33a (0x7b14 bytes) 000502 1788581508.477548 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcc4b6798 (stale) Mirror 3: 0x4332e4f8 (stale) Mirror 5: 0x4332e4f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcc4b6798 (stale) Mirror 3: 0x4332e4f8 (stale) Mirror 5: 0x4332e4f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000505 1788581508.921793 mapwrite 0x009159 thru 0x00f68b (0x6533 bytes) 000506 1788581509.016516 punch from 0x00ca7c to 0x011ff2 (0x5577 bytes) 000507 1788581509.027475 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcc4b6798 (stale) Mirror 3: 0x4332e4f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcc4b6798 (stale) Mirror 3: 0x4332e4f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000508 1788581509.395173 mapwrite 0x02edf6 thru 0x03a46a (0xb675 bytes) 000511 1788581509.464613 mapwrite 0x012dcf thru 0x0184b4 (0x56e6 bytes) 000513 1788581509.524569 write 0x021f66 thru 0x02fe9f (0xdf3a bytes) 000515 1788581509.533572 trunc from 0x040000 to 0x00a5be (0x35a41 bytes) 000516 1788581509.556021 mapread 0x0083a6 thru 0x00a5be (0x2219 bytes) 000517 1788581509.567524 trunc from 0x00a5bf to 0x020ff2 (0x16a34 bytes) 000519 1788581509.593740 write 0x03504a thru 0x03ffff (0xafb6 bytes) 000520 1788581509.596945 write 0x003be2 thru 0x0091da (0x55f9 bytes) 000521 1788581509.598969 mapwrite 0x03bcc7 thru 0x03ffff (0x4339 bytes) 000524 1788581509.672380 read 0x00fd30 thru 0x014747 (0x4a18 bytes) 000525 1788581509.683226 read 0x02966a thru 0x02c086 (0x2a1d bytes) truncating to largest ever: 0x3f1e1 000527 1788581509.697324 trunc from 0x040000 to 0x03f1e0 (0xe1f bytes) 000528 1788581509.718396 trunc from 0x03f1e1 to 0x00e31b (0x30ec5 bytes) 000530 1788581509.739401 mapwrite 0x031bcb thru 0x035359 (0x378f bytes) 000531 1788581509.850095 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3535a): Mirror 2: 0x759d273f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3535a): Mirror 2: 0x759d273f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3535a: skipped 000532 1788581510.174655 read 0x02d590 thru 0x035359 (0x7dca bytes) 000533 1788581510.189870 punch from 0x015f44 to 0x01cd34 (0x6df1 bytes) 000534 1788581510.195724 mapread 0x0213f6 thru 0x022b88 (0x1793 bytes) 000535 1788581510.207748 punch from 0x002cba to 0x00453d (0x1884 bytes) 000536 1788581510.217588 MIRROR_RESYNC 2 mirrors 000537 1788581511.027496 mapread 0x003ae8 thru 0x007c43 (0x415c bytes) 000538 1788581511.054289 MIRROR_RESYNC 2 mirrors 000539 1788581511.419898 write 0x03ac95 thru 0x03e272 (0x35de bytes) 000540 1788581511.488945 trunc from 0x03e273 to 0x013274 (0x2affe bytes) 000546 1788581511.519255 mapwrite 0x00c211 thru 0x014272 (0x8062 bytes) 000547 1788581511.622243 write 0x005d92 thru 0x00c1f1 (0x6460 bytes) 000548 1788581511.628135 read 0x001269 thru 0x002300 (0x1098 bytes) 000549 1788581511.635538 mapread 0x005317 thru 0x00843d (0x3127 bytes) 000550 1788581511.637665 read 0x000fc4 thru 0x00c8a1 (0xb8de bytes) 000551 1788581511.645895 read 0x00532a thru 0x007eaf (0x2b86 bytes) 000553 1788581511.647103 read 0x00821a thru 0x00884a (0x631 bytes) 000555 1788581511.649872 write 0x0244bb thru 0x02e3ff (0x9f45 bytes) 000558 1788581511.653342 mapread 0x0263cd thru 0x02e3ff (0x8033 bytes) 000559 1788581511.655899 read 0x02036c thru 0x02c148 (0xbddd bytes) 000560 1788581511.664419 write 0x02f0d7 thru 0x03e334 (0xf25e bytes) 000561 1788581511.668543 mapwrite 0x02b6a3 thru 0x0340a8 (0x8a06 bytes) 000565 1788581511.753819 read 0x012b9a thru 0x0173de (0x4845 bytes) 000567 1788581511.755481 mapread 0x0125b7 thru 0x01681c (0x4266 bytes) 000568 1788581511.758156 punch from 0x03a71c to 0x03e334 (0x3c19 bytes) 000570 1788581511.763710 write 0x03bea7 thru 0x03ffff (0x4159 bytes) 000571 1788581511.773766 read 0x03918e thru 0x03c0fd (0x2f70 bytes) 000573 1788581511.774824 read 0x01daf7 thru 0x0251d0 (0x76da bytes) 000574 1788581511.775414 mapread 0x01fc9d thru 0x02a701 (0xaa65 bytes) 000576 1788581511.778810 read 0x007b60 thru 0x008bc7 (0x1068 bytes) 000577 1788581511.779880 punch from 0x01d75d to 0x02355d (0x5e01 bytes) 000578 1788581511.798004 mapwrite 0x00beb7 thru 0x011bff (0x5d49 bytes) 000579 1788581511.884947 write 0x0055dd thru 0x00d91b (0x833f bytes) 000580 1788581511.890725 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000581 1788581512.094151 punch from 0x0244eb to 0x02c86d (0x8383 bytes) 000582 1788581512.117339 read 0x03a4ad thru 0x03dabb (0x360f bytes) 000583 1788581512.135347 mapwrite 0x012055 thru 0x013857 (0x1803 bytes) 000584 1788581512.202564 write 0x02de73 thru 0x037636 (0x97c4 bytes) 000588 1788581512.215652 mapread 0x004f63 thru 0x00a26d (0x530b bytes) 000591 1788581512.228418 punch from 0x01fc7a to 0x026d79 (0x7100 bytes) 000592 1788581512.254922 trunc from 0x040000 to 0x019e64 (0x2619b bytes) 000593 1788581512.296993 write 0x0038ff thru 0x00af44 (0x7646 bytes) 000594 1788581512.297957 mapwrite 0x020553 thru 0x029971 (0x941f bytes) 000595 1788581512.448227 read 0x013efd thru 0x023361 (0xf465 bytes) 000596 1788581512.464244 trunc from 0x029972 to 0x007556 (0x2241b bytes) 000597 1788581512.484829 mapwrite 0x005a8e thru 0x012f66 (0xd4d9 bytes) 000598 1788581512.645518 read 0x005be8 thru 0x00a188 (0x45a1 bytes) 000599 1788581512.646967 trunc from 0x012f67 to 0x00c50f (0x6a57 bytes) 000600 1788581512.666999 mapwrite 0x0337aa thru 0x03ffff (0xc856 bytes) 000603 1788581512.757574 mapread 0x0379e1 thru 0x037a9e (0xbe bytes) 000605 1788581512.760146 trunc from 0x040000 to 0x02c85d (0x137a2 bytes) 000607 1788581512.790826 read 0x01b63f thru 0x026c83 (0xb645 bytes) 000609 1788581512.794303 mapwrite 0x033461 thru 0x03b9bc (0x855c bytes) 000614 1788581512.877007 write 0x03c59d thru 0x03dd4d (0x17b1 bytes) 000615 1788581512.878210 trunc from 0x03dd4e to 0x00a492 (0x338bb bytes) 000616 1788581512.906260 mapwrite 0x021866 thru 0x02a85e (0x8ff9 bytes) 000620 1788581513.064796 MIRROR_EXTEND to 2 mirrors 000622 1788581514.322907 MIRROR_RESYNC 2 mirrors 000623 1788581514.740569 read 0x0027c7 thru 0x00f182 (0xc9bc bytes) 000625 1788581514.749163 write 0x006fbc thru 0x00ba53 (0x4a98 bytes) 000627 1788581514.829902 read 0x011e4c thru 0x020a03 (0xebb8 bytes) 000628 1788581514.840837 punch from 0x00d74f to 0x00e982 (0x1234 bytes) 000629 1788581514.852933 mapread 0x01860d thru 0x027fe0 (0xf9d4 bytes) 000630 1788581514.854013 mapwrite 0x032ff2 thru 0x03f265 (0xc274 bytes) 000631 1788581514.933997 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000632 1788581515.055982 mapread 0x00ebe7 thru 0x0152c7 (0x66e1 bytes) 000633 1788581515.073487 trunc from 0x03f266 to 0x02bc7e (0x135e7 bytes) 000634 1788581515.087247 mapwrite 0x029f8e thru 0x02aae7 (0xb5a bytes) 000635 1788581515.134710 mapwrite 0x01f91e thru 0x02f326 (0xfa09 bytes) 000636 1788581515.210942 mapread 0x02deb2 thru 0x02f326 (0x1475 bytes) truncating to largest ever: 0x3f8b8 000637 1788581515.212609 trunc from 0x02f327 to 0x03f8b7 (0x10591 bytes) 000638 1788581515.230961 trunc from 0x03f8b8 to 0x010989 (0x2ef2e bytes) 000639 1788581515.251659 write 0x002c2d thru 0x00d35c (0xa730 bytes) 000641 1788581515.258162 mapread 0x00da61 thru 0x01060c (0x2bac bytes) 000644 1788581515.260671 punch from 0x00020d to 0x00aaab (0xa89f bytes) 000645 1788581515.278879 read 0x00cb3b thru 0x00dee2 (0x13a8 bytes) 000647 1788581515.285138 MIRROR_EXTEND to 2 mirrors 000648 1788581516.161810 trunc from 0x01098a to 0x013b3a (0x31b1 bytes) 000651 1788581516.348017 trunc from 0x013b3b to 0x018814 (0x4cda bytes) 000652 1788581516.382986 read 0x00412a thru 0x00f7dc (0xb6b3 bytes) 000654 1788581516.392949 read 0x00265f thru 0x0120a3 (0xfa45 bytes) 000655 1788581516.402183 read 0x00801b thru 0x011d0b (0x9cf1 bytes) 000656 1788581516.402971 read 0x007979 thru 0x012471 (0xaaf9 bytes) 000657 1788581516.404560 trunc from 0x018815 to 0x03972f (0x20f1b bytes) 000659 1788581516.424331 mapread 0x019254 thru 0x01f733 (0x64e0 bytes) 000660 1788581516.433603 mapwrite 0x008062 thru 0x010d32 (0x8cd1 bytes) 000662 1788581516.478772 punch from 0x029c2c to 0x02e048 (0x441d bytes) 000663 1788581516.483253 mapread 0x010770 thru 0x016d9a (0x662b bytes) 000666 1788581516.485604 write 0x0329a6 thru 0x03f6e1 (0xcd3c bytes) 000667 1788581516.487777 mapwrite 0x000d98 thru 0x00c13e (0xb3a7 bytes) 000669 1788581516.543642 mapwrite 0x03706e thru 0x03fffb (0x8f8e bytes) 000672 1788581516.629025 read 0x01e1a7 thru 0x01f86f (0x16c9 bytes) 000676 1788581516.641252 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000677 1788581516.784924 read 0x0271ee thru 0x02fdcc (0x8bdf bytes) 000679 1788581516.795842 mapread 0x025036 thru 0x03262b (0xd5f6 bytes) 000682 1788581516.817171 write 0x00a3d3 thru 0x0138d6 (0x9504 bytes) 000683 1788581516.828686 punch from 0x0368cc to 0x03fffb (0x9730 bytes) 000685 1788581516.849803 trunc from 0x03fffc to 0x01b7bd (0x2483e bytes) 000686 1788581516.878665 trunc from 0x01b7be to 0x02fd86 (0x145c9 bytes) 000687 1788581516.910971 read 0x0266d6 thru 0x02fd86 (0x96b1 bytes) 000688 1788581516.921693 punch from 0x016a57 to 0x019871 (0x2e1b bytes) 000689 1788581516.926362 mapwrite 0x0219e2 thru 0x023e7d (0x249c bytes) 000690 1788581517.058546 punch from 0x0255cf to 0x02fd86 (0xa7b8 bytes) 000691 1788581517.066475 read 0x020012 thru 0x025dc2 (0x5db1 bytes) 000692 1788581517.096534 write 0x0383cc thru 0x038565 (0x19a bytes) 000695 1788581517.102027 read 0x02d089 thru 0x038565 (0xb4dd bytes) 000697 1788581517.115633 read 0x034d88 thru 0x038565 (0x37de bytes) 000698 1788581517.126102 trunc from 0x038566 to 0x0360ae (0x24b7 bytes) 000699 1788581517.153601 mapwrite 0x02cfb8 thru 0x0343e1 (0x742a bytes) 000701 1788581517.254904 write 0x014c0c thru 0x024a5f (0xfe54 bytes) 000702 1788581517.256354 mapwrite 0x03f46a thru 0x03ffff (0xb96 bytes) 000703 1788581517.470478 mapread 0x011964 thru 0x01f0fa (0xd797 bytes) 000704 1788581517.471409 mapread 0x00a669 thru 0x0112d5 (0x6c6d bytes) 000705 1788581517.485466 MIRROR_EXTEND to 2 mirrors 000706 1788581518.662215 mapread 0x00d9c6 thru 0x01893f (0xaf7a bytes) 000707 1788581518.737561 mapwrite 0x01ca9f thru 0x0272a1 (0xa803 bytes) 000708 1788581518.985084 mapwrite 0x0356ff thru 0x035df2 (0x6f4 bytes) 000709 1788581519.049264 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x144d3cc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x14bf12ff Mirror 3: 0x14bf12ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000710 1788581520.208486 mapread 0x02740c thru 0x027dbe (0x9b3 bytes) 000713 1788581520.215737 write 0x01855c thru 0x0221bd (0x9c62 bytes) 000714 1788581520.275938 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x144d3cc (stale) Mirror 3: 0x14bf12ff (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe3ab3849 Mirror 4: 0xe3ab3849 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000715 1788581522.031928 trunc from 0x040000 to 0x014bda (0x2b425 bytes) 000716 1788581522.180941 read 0x003a40 thru 0x00ebfc (0xb1bd bytes) 000717 1788581522.201073 write 0x003b9d thru 0x00ba8f (0x7ef3 bytes) 000718 1788581522.204377 trunc from 0x014bdb to 0x02b528 (0x1694e bytes) 000721 1788581522.236453 trunc from 0x02b529 to 0x01fcc0 (0xb868 bytes) 000722 1788581522.261777 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1fcc1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fcc1): Mirror 2: 0x548de7c3 (stale) Mirror 3: 0x72dccee5 (stale) Mirror 4: 0xbf83a4f7 (stale) CRC-32 checksum value for chunk [0, 0x1fcc1): Mirror 1: 0xc58aa5a4 Mirror 5: 0xc58aa5a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fcc1: skipped 000723 1788581523.151379 punch from 0x01e102 to 0x01fcc0 (0x1bbf bytes) 000724 1788581523.229836 read 0x003c83 thru 0x004ccd (0x104b bytes) 000725 1788581523.244759 MIRROR_RESYNC 5 mirrors 000727 1788581524.866994 MIRROR_RESYNC 5 mirrors 000729 1788581525.455933 punch from 0x00df0c to 0x01d804 (0xf8f9 bytes) 000730 1788581525.529839 read 0x01e44f thru 0x01fc53 (0x1805 bytes) 000733 1788581525.538891 punch from 0x00f3ac to 0x01e0ca (0xed1f bytes) 000734 1788581525.543901 mapread 0x00023b thru 0x00ea9e (0xe864 bytes) 000735 1788581525.572700 mapread 0x01a938 thru 0x01ed80 (0x4449 bytes) 000736 1788581525.581214 write 0x016dce thru 0x01bf5b (0x518e bytes) 000737 1788581525.582284 write 0x014197 thru 0x01b2ee (0x7158 bytes) 000738 1788581525.590775 mapread 0x000b07 thru 0x002eb9 (0x23b3 bytes) 000739 1788581525.593678 read 0x01efd2 thru 0x01fcc0 (0xcef bytes) 000740 1788581525.595027 trunc from 0x01fcc1 to 0x01ae69 (0x4e57 bytes) 000741 1788581525.628117 mapwrite 0x03aa21 thru 0x03feab (0x548b bytes) 000742 1788581525.718290 trunc from 0x03feac to 0x02eea3 (0x11008 bytes) 000743 1788581525.738720 trunc from 0x02eea4 to 0x027cc3 (0x71e0 bytes) 000744 1788581525.755237 write 0x01231a thru 0x020795 (0xe47c bytes) 000745 1788581525.756658 punch from 0x00a713 to 0x00d946 (0x3234 bytes) 000746 1788581525.768616 punch from 0x023463 to 0x027cc3 (0x4861 bytes) 000747 1788581525.772989 trunc from 0x027cc4 to 0x0027fe (0x254c5 bytes) 000748 1788581525.792890 write 0x002993 thru 0x002efd (0x56b bytes) 000750 1788581525.796943 write 0x031097 thru 0x03396a (0x28d4 bytes) 000751 1788581525.798847 mapwrite 0x02cbe3 thru 0x034b14 (0x7f32 bytes) 000752 1788581525.887435 trunc from 0x034b15 to 0x0118a1 (0x23273 bytes) 000753 1788581525.904831 trunc from 0x0118a2 to 0x0115ac (0x2f5 bytes) 000755 1788581525.918188 write 0x01183b thru 0x01d2ff (0xbac5 bytes) 000757 1788581525.926261 trunc from 0x01d300 to 0x034071 (0x16d72 bytes) 000760 1788581525.939274 read 0x015d71 thru 0x02315b (0xd3eb bytes) 000761 1788581525.949624 trunc from 0x034072 to 0x014288 (0x1fde9 bytes) 000764 1788581525.967401 mapwrite 0x0159fb thru 0x025165 (0xf76b bytes) 000765 1788581526.184927 trunc from 0x025166 to 0x009a6b (0x1b6fa bytes) 000766 1788581526.222588 punch from 0x003e71 to 0x009a6b (0x5bfb bytes) 000768 1788581526.230441 trunc from 0x009a6c to 0x011ff1 (0x8586 bytes) 000769 1788581526.249525 write 0x000ed1 thru 0x00227d (0x13ad bytes) 000770 1788581526.250489 mapread 0x003389 thru 0x007bba (0x4832 bytes) 000771 1788581526.292812 punch from 0x0109cb to 0x011ff1 (0x1627 bytes) 000772 1788581526.311637 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x11ff2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11ff2): Mirror 2: 0xcf10f569 (stale) Mirror 3: 0xcf10f569 (stale) Mirror 4: 0xcf10f569 (stale) Mirror 5: 0xcf10f569 (stale) CRC-32 checksum value for chunk [0, 0x11ff2): Mirror 1: 0xfcac4c64 Mirror 6: 0xfcac4c64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11ff2: skipped 000773 1788581527.349104 trunc from 0x011ff2 to 0x032796 (0x207a5 bytes) 000775 1788581527.559467 write 0x0214aa thru 0x029cd5 (0x882c bytes) 000776 1788581527.572638 write 0x00e549 thru 0x019336 (0xadee bytes) 000777 1788581527.598916 mapwrite 0x01842d thru 0x01f756 (0x732a bytes) 000780 1788581527.738031 write 0x01cadb thru 0x01f500 (0x2a26 bytes) 000781 1788581527.744716 write 0x0302d6 thru 0x033f9e (0x3cc9 bytes) 000782 1788581527.772721 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33f9f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f9f): Mirror 2: 0xaf1ba467 (stale) Mirror 3: 0xaf1ba467 (stale) Mirror 4: 0xaf1ba467 (stale) Mirror 5: 0xaf1ba467 (stale) Mirror 6: 0x5d6f5edc (stale) CRC-32 checksum value for chunk [0, 0x33f9f): Mirror 1: 0xb5f2a6c9 Mirror 7: 0xb5f2a6c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f9f: skipped 000783 1788581529.167013 punch from 0x027944 to 0x029019 (0x16d6 bytes) 000785 1788581529.307753 trunc from 0x033f9f to 0x02db69 (0x6435 bytes) 000786 1788581529.357707 read 0x023921 thru 0x02db69 (0xa249 bytes) 000788 1788581529.375996 mapwrite 0x02bc9b thru 0x030e57 (0x51bd bytes) 000789 1788581529.553012 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x30e58): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30e58): Mirror 2: 0x223b7cba (stale) Mirror 3: 0x223b7cba (stale) Mirror 4: 0x223b7cba (stale) Mirror 5: 0x223b7cba (stale) Mirror 6: 0xab19ff82 (stale) Mirror 7: 0xab1ed58d (stale) CRC-32 checksum value for chunk [0, 0x30e58): Mirror 1: 0xc5e1884f Mirror 8: 0xc5e1884f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30e58: skipped 000790 1788581530.399572 read 0x011680 thru 0x01a4f6 (0x8e77 bytes) 000792 1788581530.418998 trunc from 0x030e58 to 0x023acf (0xd388 bytes) 000793 1788581530.626891 read 0x000d9a thru 0x001ce9 (0xf50 bytes) 000794 1788581530.641378 punch from 0x021055 to 0x023acf (0x2a7b bytes) 000797 1788581530.657300 trunc from 0x023ad0 to 0x022593 (0x153c bytes) 000799 1788581530.685626 trunc from 0x022594 to 0x02b98c (0x93f9 bytes) 000800 1788581530.706852 punch from 0x018a35 to 0x0203db (0x79a7 bytes) 000801 1788581530.711809 read 0x002ad5 thru 0x006048 (0x3574 bytes) 000804 1788581530.717544 mapread 0x0141b7 thru 0x0164ae (0x22f8 bytes) 000805 1788581530.718605 mapread 0x01790b thru 0x021f56 (0xa64c bytes) 000806 1788581530.731314 read 0x01c1e6 thru 0x02926a (0xd085 bytes) 000807 1788581530.732217 mapwrite 0x01e14e thru 0x023539 (0x53ec bytes) 000808 1788581530.792929 read 0x009f1e thru 0x013778 (0x985b bytes) 000809 1788581530.793608 punch from 0x029ca8 to 0x02a15f (0x4b8 bytes) 000810 1788581530.802935 MIRROR_RESYNC 8 mirrors 000811 1788581532.612835 trunc from 0x02b98d to 0x018e2f (0x12b5d bytes) 000812 1788581532.686253 write 0x00bfa4 thru 0x0104f8 (0x4555 bytes) 000813 1788581532.697383 trunc from 0x018e30 to 0x032432 (0x19603 bytes) 000814 1788581532.722258 mapwrite 0x02f742 thru 0x03d942 (0xe201 bytes) 000815 1788581532.810939 trunc from 0x03d943 to 0x02f9b2 (0xdf90 bytes) 000816 1788581532.831982 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f9b3): Mirror 3: 0xe5a3bc09 (stale) Mirror 4: 0xe5a3bc09 (stale) Mirror 5: 0xe5a3bc09 (stale) Mirror 6: 0xe5a3bc09 (stale) Mirror 7: 0xe5a3bc09 (stale) Mirror 8: 0xe5a3bc09 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f9b3): Mirror 3: 0xe5a3bc09 (stale) Mirror 4: 0xe5a3bc09 (stale) Mirror 5: 0xe5a3bc09 (stale) Mirror 6: 0xe5a3bc09 (stale) Mirror 7: 0xe5a3bc09 (stale) Mirror 8: 0xe5a3bc09 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f9b3: skipped 000817 1788581533.315269 mapread 0x00b559 thru 0x01768e (0xc136 bytes) 000818 1788581533.339297 punch from 0x0203df to 0x0244aa (0x40cc bytes) 000819 1788581533.343541 write 0x017924 thru 0x026ad6 (0xf1b3 bytes) 000820 1788581533.350210 write 0x0019bf thru 0x008036 (0x6678 bytes) 000821 1788581533.356271 mapwrite 0x0399ad thru 0x03af8f (0x15e3 bytes) 000824 1788581533.433650 mapread 0x026c13 thru 0x032fdc (0xc3ca bytes) 000825 1788581533.445175 read 0x0175ce thru 0x0249c7 (0xd3fa bytes) 000826 1788581533.446020 punch from 0x0158fe to 0x025704 (0xfe07 bytes) 000827 1788581533.450920 mapwrite 0x036ded thru 0x03ffff (0x9213 bytes) 000831 1788581533.527691 read 0x033508 thru 0x03e139 (0xac32 bytes) 000832 1788581533.529146 mapwrite 0x03c916 thru 0x03ffff (0x36ea bytes) 000834 1788581533.575536 MIRROR_RESYNC 7 mirrors 000835 1788581536.092547 write 0x02896b thru 0x02fdf7 (0x748d bytes) 000836 1788581536.160680 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4bb0ff05 (stale) Mirror 4: 0x4bb0ff05 (stale) Mirror 5: 0x4bb0ff05 (stale) Mirror 6: 0x4bb0ff05 (stale) Mirror 8: 0x4bb0ff05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4bb0ff05 (stale) Mirror 4: 0x4bb0ff05 (stale) Mirror 5: 0x4bb0ff05 (stale) Mirror 6: 0x4bb0ff05 (stale) Mirror 8: 0x4bb0ff05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000839 1788581536.560296 trunc from 0x040000 to 0x014bbf (0x2b440 bytes) 000840 1788581536.572862 read 0x0134bc thru 0x014bbf (0x1704 bytes) 000841 1788581536.583634 MIRROR_RESYNC 6 mirrors 000842 1788581537.413600 mapwrite 0x00b70e thru 0x00d164 (0x1a57 bytes) 000843 1788581537.556358 trunc from 0x014bc0 to 0x00b3cf (0x97f0 bytes) 000844 1788581537.584261 mapread 0x006035 thru 0x00b3cf (0x539b bytes) 000845 1788581537.585338 punch from 0x008a16 to 0x00b3cf (0x29ba bytes) 000846 1788581537.591473 mapread 0x000d7f thru 0x003313 (0x2595 bytes) 000848 1788581537.604435 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb3d0): Mirror 3: 0xb3a47113 (stale) Mirror 5: 0xb3a47113 (stale) Mirror 6: 0xb3a47113 (stale) Mirror 8: 0xb3a47113 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb3d0): Mirror 3: 0xb3a47113 (stale) Mirror 5: 0xb3a47113 (stale) Mirror 6: 0xb3a47113 (stale) Mirror 8: 0xb3a47113 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb3d0: skipped 000850 1788581537.903204 MIRROR_RESYNC 5 mirrors 000852 1788581538.887767 mapwrite 0x01256f thru 0x01a46a (0x7efc bytes) 000853 1788581539.021659 punch from 0x0107bc to 0x01a46a (0x9caf bytes) 000854 1788581539.025932 trunc from 0x01a46b to 0x03effd (0x24b93 bytes) 000855 1788581539.046454 write 0x021934 thru 0x02797c (0x6049 bytes) 000856 1788581539.056475 punch from 0x013bd2 to 0x017442 (0x3871 bytes) 000858 1788581539.068499 trunc from 0x03effe to 0x007b4b (0x374b2 bytes) 000860 1788581539.082646 punch from 0x00537f to 0x007b4b (0x27cd bytes) 000861 1788581539.088234 read 0x00339c thru 0x006d03 (0x3968 bytes) 000862 1788581539.098696 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7b4c): Mirror 3: 0x3ec464b4 (stale) Mirror 5: 0x3ec464b4 (stale) Mirror 8: 0x3ec464b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7b4c): Mirror 3: 0x3ec464b4 (stale) Mirror 5: 0x3ec464b4 (stale) Mirror 8: 0x3ec464b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7b4c: skipped 000863 1788581539.388635 mapwrite 0x034e39 thru 0x035c73 (0xe3b bytes) 000865 1788581539.450503 trunc from 0x035c74 to 0x001303 (0x34970 bytes) 000866 1788581539.473804 trunc from 0x001304 to 0x000a56 (0x8ad bytes) 000868 1788581539.494805 mapread 0x0009e7 thru 0x000a56 (0x70 bytes) 000870 1788581539.505740 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xa57): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa57): Mirror 3: 0xe6e30705 (stale) Mirror 5: 0xe6e30705 (stale) Mirror 8: 0xe6e30705 (stale) CRC-32 checksum value for chunk [0, 0xa57): Mirror 1: 0xe6e30705 Mirror 9: 0xe6e30705 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa57: skipped 000871 1788581540.168937 punch from 0x000a3f to 0x000a56 (0x18 bytes) 000872 1788581540.255488 mapwrite 0x01032f thru 0x013770 (0x3442 bytes) 000873 1788581540.429741 punch from 0x0100de to 0x01243a (0x235d bytes) 000874 1788581540.436384 mapread 0x00dca3 thru 0x013770 (0x5ace bytes) 000875 1788581540.449402 write 0x01aa05 thru 0x01bebd (0x14b9 bytes) 000876 1788581540.450413 punch from 0x005943 to 0x00e6eb (0x8da9 bytes) 000877 1788581540.464426 write 0x029a1a thru 0x034912 (0xaef9 bytes) 000878 1788581540.469516 trunc from 0x034913 to 0x03e21d (0x990b bytes) 000879 1788581540.502097 mapwrite 0x029aee thru 0x02adc6 (0x12d9 bytes) 000880 1788581540.602035 MIRROR_RESYNC 5 mirrors 000882 1788581542.959297 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000883 1788581543.344966 mapread 0x025b80 thru 0x026edd (0x135e bytes) 000884 1788581543.366769 mapwrite 0x031c4f thru 0x032546 (0x8f8 bytes) 000886 1788581543.529685 mapwrite 0x012327 thru 0x014a17 (0x26f1 bytes) 000887 1788581543.584428 mapwrite 0x037ef4 thru 0x03d768 (0x5875 bytes) 000888 1788581543.636420 write 0x03f10e thru 0x03ffff (0xef2 bytes) 000890 1788581543.639076 trunc from 0x040000 to 0x02d971 (0x1268e bytes) 000891 1788581543.666834 punch from 0x029023 to 0x02abba (0x1b98 bytes) 000892 1788581543.671481 mapwrite 0x01695a thru 0x02077d (0x9e24 bytes) 000893 1788581543.722370 mapwrite 0x01704f thru 0x01fb2c (0x8ade bytes) 000894 1788581543.758431 mapwrite 0x01e693 thru 0x024b63 (0x64d1 bytes) 000895 1788581543.821761 MIRROR_RESYNC 4 mirrors 000896 1788581545.059352 mapwrite 0x00c891 thru 0x00e222 (0x1992 bytes) 000897 1788581545.211295 read 0x027583 thru 0x02d971 (0x63ef bytes) 000899 1788581545.219552 mapread 0x02ca11 thru 0x02d971 (0xf61 bytes) 000900 1788581545.220304 mapread 0x0041c5 thru 0x008041 (0x3e7d bytes) 000901 1788581545.227543 mapwrite 0x02ad0a thru 0x034328 (0x961f bytes) 000902 1788581545.293123 mapwrite 0x01cde9 thru 0x029c63 (0xce7b bytes) 000904 1788581545.356822 read 0x025948 thru 0x026a13 (0x10cc bytes) 000905 1788581545.357429 mapread 0x02798c thru 0x034328 (0xc99d bytes) 000906 1788581545.358380 mapwrite 0x005642 thru 0x0098b9 (0x4278 bytes) 000907 1788581545.403988 mapread 0x0205a3 thru 0x025dae (0x580c bytes) 000908 1788581545.405363 mapwrite 0x034f6e thru 0x035013 (0xa6 bytes) 000909 1788581545.485299 write 0x003d0d thru 0x013698 (0xf98c bytes) 000910 1788581545.488021 punch from 0x01e0ca to 0x020006 (0x1f3d bytes) 000911 1788581545.505272 mapwrite 0x030b31 thru 0x03a24b (0x971b bytes) 000914 1788581545.611122 MIRROR_RESYNC 4 mirrors 000916 1788581546.358340 MIRROR_EXTEND to 5 mirrors 000917 1788581546.957580 write 0x000bfc thru 0x00e490 (0xd895 bytes) 000920 1788581547.031292 read 0x035e41 thru 0x03a24b (0x440b bytes) 000921 1788581547.043602 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a24c): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a24c): Mirror 3: 0x1d1b2fce (stale) Mirror 8: 0x1d1b2fce (stale) Mirror 9: 0x1d1b2fce (stale) Mirror 10: 0x1d1b2fce (stale) CRC-32 checksum value for chunk [0, 0x3a24c): Mirror 1: 0x58c96b76 Mirror 11: 0x58c96b76 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a24c: skipped 000922 1788581547.908502 mapread 0x003d9f thru 0x00fb84 (0xbde6 bytes) 000923 1788581547.975663 mapread 0x002bb1 thru 0x003574 (0x9c4 bytes) 000924 1788581547.976414 punch from 0x017a36 to 0x01c843 (0x4e0e bytes) 000925 1788581548.095856 write 0x014875 thru 0x01d8dc (0x9068 bytes) 000927 1788581548.105372 write 0x0185b4 thru 0x025f37 (0xd984 bytes) 000929 1788581548.110734 trunc from 0x03a24c to 0x01ce20 (0x1d42b bytes) 000930 1788581548.150685 read 0x00325d thru 0x012aa6 (0xf84a bytes) 000931 1788581548.158088 write 0x01505f thru 0x018394 (0x3336 bytes) 000932 1788581548.159465 punch from 0x01c38b to 0x01ce20 (0xa96 bytes) 000933 1788581548.171946 punch from 0x006135 to 0x00e96c (0x8838 bytes) 000934 1788581548.175987 read 0x013ca7 thru 0x018437 (0x4791 bytes) 000935 1788581548.183444 write 0x02146d thru 0x03020a (0xed9e bytes) 000936 1788581548.185342 punch from 0x01ee36 to 0x029186 (0xa351 bytes) 000937 1788581548.197333 write 0x030dee thru 0x03ebd1 (0xdde4 bytes) 000939 1788581548.200297 mapwrite 0x03c558 thru 0x03fe45 (0x38ee bytes) 000940 1788581548.261811 write 0x02f93b thru 0x0354d7 (0x5b9d bytes) 000941 1788581548.264590 mapwrite 0x00f514 thru 0x01bda4 (0xc891 bytes) 000942 1788581548.321016 MIRROR_RESYNC 6 mirrors 000943 1788581550.630527 mapwrite 0x034027 thru 0x03ffff (0xbfd9 bytes) 000944 1788581550.891378 trunc from 0x040000 to 0x01c2cb (0x23d34 bytes) 000945 1788581550.909798 mapwrite 0x00fbb1 thru 0x013ff0 (0x4440 bytes) 000946 1788581550.953219 punch from 0x00c119 to 0x01a0b6 (0xdf9e bytes) 000947 1788581550.958526 mapwrite 0x03bc44 thru 0x03ffff (0x43bc bytes) 000948 1788581551.020899 mapwrite 0x03debb thru 0x03ffff (0x2145 bytes) 000949 1788581551.061149 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7e89018a (stale) Mirror 8: 0x7e89018a (stale) Mirror 9: 0x7e89018a (stale) Mirror 10: 0x7e89018a (stale) Mirror 11: 0x7e89018a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa7f9d364 Mirror 12: 0xa7f9d364 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000950 1788581552.111877 mapwrite 0x035d78 thru 0x03ed55 (0x8fde bytes) 000951 1788581552.405927 read 0x00286f thru 0x008ac4 (0x6256 bytes) 000952 1788581552.428154 read 0x02f32a thru 0x03462c (0x5303 bytes) 000954 1788581552.429197 mapwrite 0x00e312 thru 0x013d53 (0x5a42 bytes) 000955 1788581552.525794 write 0x02842b thru 0x02ddf8 (0x59ce bytes) 000956 1788581552.534404 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7e89018a (stale) Mirror 8: 0x7e89018a (stale) Mirror 9: 0x7e89018a (stale) Mirror 10: 0x7e89018a (stale) Mirror 11: 0x7e89018a (stale) Mirror 12: 0xa7f9d364 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x39767a0c Mirror 13: 0x39767a0c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000959 1788581554.094589 write 0x00c32c thru 0x014fbb (0x8c90 bytes) 000960 1788581554.179396 trunc from 0x040000 to 0x0101b9 (0x2fe46 bytes) 000961 1788581554.198004 trunc from 0x0101ba to 0x0091a6 (0x7013 bytes) 000965 1788581554.221822 mapread 0x000906 thru 0x002af9 (0x21f4 bytes) 000966 1788581554.235712 trunc from 0x0091a7 to 0x0315df (0x28439 bytes) 000969 1788581554.257739 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x315e0): Mirror 3: 0x9a35521 (stale) Mirror 9: 0x9a35521 (stale) Mirror 10: 0x9a35521 (stale) Mirror 11: 0x9a35521 (stale) Mirror 12: 0x2666975 (stale) Mirror 13: 0xab8a343c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x315e0): Mirror 3: 0x9a35521 (stale) Mirror 9: 0x9a35521 (stale) Mirror 10: 0x9a35521 (stale) Mirror 11: 0x9a35521 (stale) Mirror 12: 0x2666975 (stale) Mirror 13: 0xab8a343c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x315e0: skipped 000970 1788581554.676490 trunc from 0x0315e0 to 0x02768f (0x9f50 bytes) 000973 1788581554.694604 mapwrite 0x01ed5b thru 0x0233bd (0x4663 bytes) 000974 1788581554.761405 read 0x016410 thru 0x017754 (0x1345 bytes) 000976 1788581554.767563 mapread 0x001a00 thru 0x00fb14 (0xe115 bytes) 000977 1788581554.779496 mapwrite 0x024377 thru 0x02d0b1 (0x8d3b bytes) 000978 1788581554.852401 write 0x0209f9 thru 0x0296cb (0x8cd3 bytes) 000979 1788581554.855276 mapread 0x010af1 thru 0x01f4b1 (0xe9c1 bytes) 000980 1788581554.863639 mapwrite 0x0171a8 thru 0x021eb1 (0xad0a bytes) 000981 1788581554.907975 read 0x009b31 thru 0x0101b7 (0x6687 bytes) 000982 1788581554.909358 punch from 0x0247a3 to 0x02686a (0x20c8 bytes) 000983 1788581554.913998 trunc from 0x02d0b2 to 0x02c150 (0xf61 bytes) 000984 1788581554.927954 trunc from 0x02c151 to 0x00a28d (0x21ec3 bytes) 000988 1788581554.950733 MIRROR_RESYNC 7 mirrors 000990 1788581556.108832 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) 000992 1788581556.463527 trunc from 0x00a28e to 0x007bb2 (0x26db bytes) 000993 1788581556.562350 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7bb3): Mirror 3: 0x56e41c88 (stale) Mirror 9: 0x56e41c88 (stale) Mirror 11: 0x56e41c88 (stale) Mirror 12: 0x56e41c88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7bb3): Mirror 3: 0x56e41c88 (stale) Mirror 9: 0x56e41c88 (stale) Mirror 11: 0x56e41c88 (stale) Mirror 12: 0x56e41c88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7bb3: skipped 000994 1788581556.944027 read 0x006c6d thru 0x007bb2 (0xf46 bytes) 000995 1788581556.950385 write 0x0196e4 thru 0x0207a7 (0x70c4 bytes) All operations completed A-OK!