== conf-sanity-1 test 154: expand .. on rename after MDT backup restore ========================================================== 06:36:37 (1734262597) Stopping clients: oleg312-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg312-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg312-client: oleg312-server: ssh exited with exit code 2 oleg312-server: oleg312-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: detected 4 online CPUs by sysfs oleg312-server: Force libcfs to create 2 CPU partitions oleg312-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg312-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg312-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey Checking servers environments Checking clients oleg312-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: detected 4 online CPUs by sysfs oleg312-server: Force libcfs to create 2 CPU partitions oleg312-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost2_flakey Started lustre-OST0001 mount lustre on /mnt/lustre..... Starting client: oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre Starting client oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre Started clients oleg312-client.virtnet: 192.168.203.112@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012aaa2800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012aaa2800.idle_timeout=debug setting jobstats to procname_uid Setting lustre.sys.jobid_var from disable to procname_uid Waiting 90s for 'procname_uid' Updated after 3s: want 'procname_uid' got 'procname_uid' disable quota as required striped dir -i0 -c1 -H all_char /mnt/lustre/d154.conf-sanity-1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d154.conf-sanity-1.tgt striped dir -i0 -c1 -H crush2 /mnt/lustre/d154.conf-sanity-1.dx_dir striped dir -i0 -c1 -H all_char /mnt/lustre/d154.conf-sanity-1.dirent striped dir -i0 -c1 -H crush2 /mnt/lustre/d154.conf-sanity-1.empty total: 128 open/close in 0.53 seconds: 243.28 ops/second total: 2 open/close in 0.03 seconds: 79.53 ops/second ==target parent FID: fid:[0x200000402:0x1:0x0]== Stopping clients: oleg312-client.virtnet /mnt/lustre (opts:) Stopping client oleg312-client.virtnet /mnt/lustre opts: Stopping clients: oleg312-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg312-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg312-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg312-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg312-server ==debugfs before backup== oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps Inode: 53385 Type: directory Mode: 0755 Flags: 0x1000 Generation: 3887566429 Version: 0x00000001:0000010c User: 0 Group: 0 Project: 0 Size: 16384 File ACL: 0 Links: 2 Blockcount: 32 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x675ebf8a:00000000 -- Sun Dec 15 06:37:46 2024 atime: 0x675ebf88:00000000 -- Sun Dec 15 06:37:44 2024 mtime: 0x675ebf8a:00000000 -- Sun Dec 15 06:37:46 2024 crtime: 0x675ebf89:1f78a400 -- Sun Dec 15 06:37:45 2024 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x200000402:0x3:0x0] compat=0 incompat=0 trusted.dmv (48) = d0 0c d3 0c 00 00 00 00 00 00 00 00 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 user.job (5) = "lfs.0" linkea: idx=0 parent=[0x200000402:0x1:0x0] name='d154.conf-sanity-1.dx_dir' BLOCKS: (0):24781, (1-3):24784-24786 TOTAL: 4 oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps 53385 40755 (2) 0 0 16384 15-Dec-2024 06:37 . 53383 40755 (18) 0 0 4096 15-Dec-2024 06:37 fid:[0x200000402:0x1:0x0] .. 171 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0xc:0x0] f154.conf-sanity-1.longfilename6 172 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0xd:0x0] f154.conf-sanity-1.longfilename7 174 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0xf:0x0] f154.conf-sanity-1.longfilename9 176 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x11:0x0] f154.conf-sanity-1.longfilename11 179 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x14:0x0] f154.conf-sanity-1.longfilename14 182 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x17:0x0] f154.conf-sanity-1.longfilename17 183 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x18:0x0] f154.conf-sanity-1.longfilename18 186 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x1b:0x0] f154.conf-sanity-1.longfilename21 192 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x21:0x0] f154.conf-sanity-1.longfilename27 197 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x26:0x0] f154.conf-sanity-1.longfilename32 199 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x28:0x0] f154.conf-sanity-1.longfilename34 200 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x29:0x0] f154.conf-sanity-1.longfilename35 207 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x30:0x0] f154.conf-sanity-1.longfilename42 217 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x3a:0x0] f154.conf-sanity-1.longfilename52 221 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x3e:0x0] f154.conf-sanity-1.longfilename56 224 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x41:0x0] f154.conf-sanity-1.longfilename59 230 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x47:0x0] f154.conf-sanity-1.longfilename65 233 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x4a:0x0] f154.conf-sanity-1.longfilename68 234 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x4b:0x0] f154.conf-sanity-1.longfilename69 235 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x4c:0x0] f154.conf-sanity-1.longfilename70 236 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x4d:0x0] f154.conf-sanity-1.longfilename71 237 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x4e:0x0] f154.conf-sanity-1.longfilename72 246 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x57:0x0] f154.conf-sanity-1.longfilename81 252 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x5d:0x0] f154.conf-sanity-1.longfilename87 255 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x60:0x0] f154.conf-sanity-1.longfilename90 257 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x62:0x0] f154.conf-sanity-1.longfilename92 262 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x67:0x0] f154.conf-sanity-1.longfilename97 265 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x6a:0x0] f154.conf-sanity-1.longfilename100 267 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x6c:0x0] f154.conf-sanity-1.longfilename102 268 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x6d:0x0] f154.conf-sanity-1.longfilename103 269 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x6e:0x0] f154.conf-sanity-1.longfilename104 271 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x70:0x0] f154.conf-sanity-1.longfilename106 273 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x72:0x0] f154.conf-sanity-1.longfilename108 282 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x7b:0x0] f154.conf-sanity-1.longfilename117 286 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x7f:0x0] f154.conf-sanity-1.longfilename121 288 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x81:0x0] f154.conf-sanity-1.longfilename123 290 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x83:0x0] f154.conf-sanity-1.longfilename125 191 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x20:0x0] f154.conf-sanity-1.longfilename26 166 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x7:0x0] f154.conf-sanity-1.longfilename1 167 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x8:0x0] f154.conf-sanity-1.longfilename2 223 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x40:0x0] f154.conf-sanity-1.longfilename58 213 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x36:0x0] f154.conf-sanity-1.longfilename48 226 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x43:0x0] f154.conf-sanity-1.longfilename61 215 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x38:0x0] f154.conf-sanity-1.longfilename50 178 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x13:0x0] f154.conf-sanity-1.longfilename13 228 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x45:0x0] f154.conf-sanity-1.longfilename63 206 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x2f:0x0] f154.conf-sanity-1.longfilename41 187 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x1c:0x0] f154.conf-sanity-1.longfilename22 193 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x22:0x0] f154.conf-sanity-1.longfilename28 173 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0xe:0x0] f154.conf-sanity-1.longfilename8 169 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0xa:0x0] f154.conf-sanity-1.longfilename4 218 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x3b:0x0] f154.conf-sanity-1.longfilename53 204 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x2d:0x0] f154.conf-sanity-1.longfilename39 231 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x48:0x0] f154.conf-sanity-1.longfilename66 205 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x2e:0x0] f154.conf-sanity-1.longfilename40 201 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x2a:0x0] f154.conf-sanity-1.longfilename36 196 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x25:0x0] f154.conf-sanity-1.longfilename31 202 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x2b:0x0] f154.conf-sanity-1.longfilename37 165 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x6:0x0] f154.conf-sanity-1.longfilename0 229 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x46:0x0] f154.conf-sanity-1.longfilename64 222 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x3f:0x0] f154.conf-sanity-1.longfilename57 185 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x1a:0x0] f154.conf-sanity-1.longfilename20 170 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0xb:0x0] f154.conf-sanity-1.longfilename5 209 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x32:0x0] f154.conf-sanity-1.longfilename44 225 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x42:0x0] f154.conf-sanity-1.longfilename60 195 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x24:0x0] f154.conf-sanity-1.longfilename30 177 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x12:0x0] f154.conf-sanity-1.longfilename12 194 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x23:0x0] f154.conf-sanity-1.longfilename29 216 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x39:0x0] f154.conf-sanity-1.longfilename51 208 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x31:0x0] f154.conf-sanity-1.longfilename43 238 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x4f:0x0] f154.conf-sanity-1.longfilename73 239 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x50:0x0] f154.conf-sanity-1.longfilename74 241 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x52:0x0] f154.conf-sanity-1.longfilename76 243 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x54:0x0] f154.conf-sanity-1.longfilename78 244 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x55:0x0] f154.conf-sanity-1.longfilename79 245 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x56:0x0] f154.conf-sanity-1.longfilename80 247 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x58:0x0] f154.conf-sanity-1.longfilename82 248 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x59:0x0] f154.conf-sanity-1.longfilename83 250 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x5b:0x0] f154.conf-sanity-1.longfilename85 256 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x61:0x0] f154.conf-sanity-1.longfilename91 258 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x63:0x0] f154.conf-sanity-1.longfilename93 260 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x65:0x0] f154.conf-sanity-1.longfilename95 272 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x71:0x0] f154.conf-sanity-1.longfilename107 275 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x74:0x0] f154.conf-sanity-1.longfilename110 276 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x75:0x0] f154.conf-sanity-1.longfilename111 277 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x76:0x0] f154.conf-sanity-1.longfilename112 279 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x78:0x0] f154.conf-sanity-1.longfilename114 280 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x79:0x0] f154.conf-sanity-1.longfilename115 281 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x7a:0x0] f154.conf-sanity-1.longfilename116 283 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x7c:0x0] f154.conf-sanity-1.longfilename118 287 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x80:0x0] f154.conf-sanity-1.longfilename122 289 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x82:0x0] f154.conf-sanity-1.longfilename124 291 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x84:0x0] f154.conf-sanity-1.longfilename126 292 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x85:0x0] f154.conf-sanity-1.longfilename127 240 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x51:0x0] f154.conf-sanity-1.longfilename75 270 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x6f:0x0] f154.conf-sanity-1.longfilename105 232 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x49:0x0] f154.conf-sanity-1.longfilename67 189 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x1e:0x0] f154.conf-sanity-1.longfilename24 190 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x1f:0x0] f154.conf-sanity-1.longfilename25 214 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x37:0x0] f154.conf-sanity-1.longfilename49 220 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x3d:0x0] f154.conf-sanity-1.longfilename55 278 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x77:0x0] f154.conf-sanity-1.longfilename113 266 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x6b:0x0] f154.conf-sanity-1.longfilename101 181 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x16:0x0] f154.conf-sanity-1.longfilename16 263 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x68:0x0] f154.conf-sanity-1.longfilename98 242 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x53:0x0] f154.conf-sanity-1.longfilename77 251 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x5c:0x0] f154.conf-sanity-1.longfilename86 249 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x5a:0x0] f154.conf-sanity-1.longfilename84 184 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x19:0x0] f154.conf-sanity-1.longfilename19 264 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x69:0x0] f154.conf-sanity-1.longfilename99 254 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x5f:0x0] f154.conf-sanity-1.longfilename89 211 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x34:0x0] f154.conf-sanity-1.longfilename46 227 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x44:0x0] f154.conf-sanity-1.longfilename62 168 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x9:0x0] f154.conf-sanity-1.longfilename3 259 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x64:0x0] f154.conf-sanity-1.longfilename94 284 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x7d:0x0] f154.conf-sanity-1.longfilename119 210 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x33:0x0] f154.conf-sanity-1.longfilename45 175 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x10:0x0] f154.conf-sanity-1.longfilename10 198 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x27:0x0] f154.conf-sanity-1.longfilename33 212 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x35:0x0] f154.conf-sanity-1.longfilename47 253 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x5e:0x0] f154.conf-sanity-1.longfilename88 188 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x1d:0x0] f154.conf-sanity-1.longfilename23 180 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x15:0x0] f154.conf-sanity-1.longfilename15 261 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x66:0x0] f154.conf-sanity-1.longfilename96 274 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x73:0x0] f154.conf-sanity-1.longfilename109 219 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x3c:0x0] f154.conf-sanity-1.longfilename54 285 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x7e:0x0] f154.conf-sanity-1.longfilename120 203 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x2c:0x0] f154.conf-sanity-1.longfilename38 oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps Inode: 53386 Type: directory Mode: 0755 Flags: 0x0 Generation: 3887566430 Version: 0x00000001:0000010d User: 0 Group: 0 Project: 0 Size: 4096 File ACL: 0 Links: 2 Blockcount: 8 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x675ebf8a:00000000 -- Sun Dec 15 06:37:46 2024 atime: 0x675ebf88:00000000 -- Sun Dec 15 06:37:44 2024 mtime: 0x675ebf8a:00000000 -- Sun Dec 15 06:37:46 2024 crtime: 0x675ebf89:2b646600 -- Sun Dec 15 06:37:45 2024 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x200000402:0x4:0x0] compat=0 incompat=0 trusted.dmv (48) = d0 0c d3 0c 00 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 user.job (5) = "lfs.0" linkea: idx=0 parent=[0x200000402:0x1:0x0] name='d154.conf-sanity-1.dirent' BLOCKS: (0):24782 TOTAL: 1 oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps 53386 40755 (2) 0 0 4096 15-Dec-2024 06:37 . 53383 40755 (18) 0 0 4096 15-Dec-2024 06:37 fid:[0x200000402:0x1:0x0] .. 293 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x86:0x0] f154.conf-sanity-1.longfilename0 294 100644 (17) 0 0 0 15-Dec-2024 06:37 fid:[0x200000402:0x87:0x0] f154.conf-sanity-1.longfilename1 oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps Inode: 53387 Type: directory Mode: 0755 Flags: 0x0 Generation: 3887566431 Version: 0x00000001:0000010e User: 0 Group: 0 Project: 0 Size: 4096 File ACL: 0 Links: 2 Blockcount: 8 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x675ebf8a:00000000 -- Sun Dec 15 06:37:46 2024 atime: 0x675ebf88:00000000 -- Sun Dec 15 06:37:44 2024 mtime: 0x675ebf88:00000000 -- Sun Dec 15 06:37:44 2024 crtime: 0x675ebf89:378d3100 -- Sun Dec 15 06:37:45 2024 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x200000402:0x5:0x0] compat=0 incompat=0 trusted.dmv (48) = d0 0c d3 0c 00 00 00 00 00 00 00 00 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 user.job (5) = "lfs.0" linkea: idx=0 parent=[0x200000402:0x1:0x0] name='d154.conf-sanity-1.empty' BLOCKS: (0):24783 TOTAL: 1 oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps 53387 40755 (2) 0 0 4096 15-Dec-2024 06:37 . 53383 40755 (18) 0 0 4096 15-Dec-2024 06:37 fid:[0x200000402:0x1:0x0] .. file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' Checking servers environments Checking clients oleg312-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: detected 4 online CPUs by sysfs oleg312-server: Force libcfs to create 2 CPU partitions oleg312-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-MDT0000 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-MDT0001 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-OST0000 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-OST0001 mount lustre on /mnt/lustre..... Starting client: oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre Starting client oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre Started clients oleg312-client.virtnet: 192.168.203.112@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8801309ab000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8801309ab000.idle_timeout=debug disable quota as required ==pre-rename parent/.. inodes== 144115205289279489 drwxr-xr-x 5 root root 4096 Dec 15 06:37 /mnt/lustre/d154.conf-sanity-1 144115205289279489 drwxr-xr-x 5 root root 4096 Dec 15 06:37 /mnt/lustre/d154.conf-sanity-1/d154.conf-sanity-1.dx_dir/.. 144115205289279489 drwxr-xr-x 5 root root 4096 Dec 15 06:37 /mnt/lustre/d154.conf-sanity-1 144115205289279489 drwxr-xr-x 5 root root 4096 Dec 15 06:37 /mnt/lustre/d154.conf-sanity-1/d154.conf-sanity-1.dirent/.. 144115205289279489 drwxr-xr-x 5 root root 4096 Dec 15 06:37 /mnt/lustre/d154.conf-sanity-1 144115205289279489 drwxr-xr-x 5 root root 4096 Dec 15 06:37 /mnt/lustre/d154.conf-sanity-1/d154.conf-sanity-1.empty/.. ==post-rename parent/.. inodes== 144115205289279490 drwxr-xr-x 5 root root 4096 Dec 15 06:39 /mnt/lustre/d154.conf-sanity-1.tgt 144115205289279490 drwxr-xr-x 5 root root 4096 Dec 15 06:39 /mnt/lustre/d154.conf-sanity-1.tgt/d154.conf-sanity-1.dx_dir/.. 144115205289279490 drwxr-xr-x 5 root root 4096 Dec 15 06:39 /mnt/lustre/d154.conf-sanity-1.tgt 144115205289279490 drwxr-xr-x 5 root root 4096 Dec 15 06:39 /mnt/lustre/d154.conf-sanity-1.tgt/d154.conf-sanity-1.dirent/.. 144115205289279490 drwxr-xr-x 5 root root 4096 Dec 15 06:39 /mnt/lustre/d154.conf-sanity-1.tgt 144115205289279490 drwxr-xr-x 5 root root 4096 Dec 15 06:39 /mnt/lustre/d154.conf-sanity-1.tgt/d154.conf-sanity-1.empty/.. ==target parent FID: fid:[0x200000402:0x2:0x0]== Stopping clients: oleg312-client.virtnet /mnt/lustre (opts:) Stopping client oleg312-client.virtnet /mnt/lustre opts: Stopping clients: oleg312-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg312-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg312-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg312-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg312-server ==post-rename .dx_dir should have 'fid:[0x200000402:0x2:0x0] ..'== oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps Inode: 26672 Type: directory Mode: 0755 Flags: 0x1000 Generation: 2231959116 Version: 0x00000002:00000001 User: 0 Group: 0 Project: 0 Size: 12288 File ACL: 0 Links: 2 Blockcount: 24 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x675ebfda:00000000 -- Sun Dec 15 06:39:06 2024 atime: 0x675ebfb3:38074300 -- Sun Dec 15 06:38:27 2024 mtime: 0x675ebf8a:00000000 -- Sun Dec 15 06:37:46 2024 crtime: 0x675ebfb3:38074300 -- Sun Dec 15 06:38:27 2024 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x200000402:0x3:0x0] compat=0 incompat=0 trusted.dmv (48) = d0 0c d3 0c 00 00 00 00 00 00 00 00 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 linkea: idx=0 parent=[0x200000402:0x2:0x0] name='d154.conf-sanity-1.dx_dir' BLOCKS: (0-2):24160-24162 TOTAL: 3 oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps 26672 40755 (2) 0 0 12288 15-Dec-2024 06:37 . 26669 40755 (18) 0 0 4096 15-Dec-2024 06:39 fid:[0x200000402:0x2:0x0] .. 58 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename85 59 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename26 60 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename1 61 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename2 62 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename110 63 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename83 67 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename50 73 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename80 75 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename73 76 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename4 78 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename53 80 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename66 81 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename40 82 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename79 83 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename36 84 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename112 87 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename116 88 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename37 90 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename74 92 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename64 95 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename78 98 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename20 99 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename114 100 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename5 101 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename115 102 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename82 104 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename44 105 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename60 106 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename30 107 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename124 110 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename29 111 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename51 115 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename69 121 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename42 122 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename71 128 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename6 129 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename21 132 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename14 133 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename125 135 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename104 136 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename100 138 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename32 139 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename90 143 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename68 145 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename35 149 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename103 150 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename52 151 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename75 161 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename98 162 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename77 166 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename99 169 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename62 172 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename119 174 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename10 176 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename47 177 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename88 179 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename15 180 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename96 183 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename120 184 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename38 72 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename28 140 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename56 93 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename118 64 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename58 117 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename72 96 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename91 79 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename39 116 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename34 126 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename70 118 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename65 134 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename17 109 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename76 86 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename122 123 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename59 131 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename108 77 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename127 69 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename63 120 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename92 124 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename102 65 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename48 113 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename95 130 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename9 74 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename8 108 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename12 148 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename27 125 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename7 103 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename111 114 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename11 71 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename22 141 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename106 89 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename126 68 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename13 112 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename43 85 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename31 147 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename121 66 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename61 119 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename123 137 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename117 146 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename97 91 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename0 144 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename18 70 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename41 57 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename107 127 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename87 142 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename81 94 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename93 97 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename57 152 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename105 153 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename67 154 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename24 155 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename25 156 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename49 157 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename55 158 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename113 159 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename101 160 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename16 163 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename86 164 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename84 165 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename19 167 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename89 168 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename46 170 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename3 171 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename94 173 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename45 175 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename33 178 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename23 181 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename109 182 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename54 ==post-rename .dirent should have 'fid:[0x200000402:0x2:0x0] ..'== oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps Inode: 26671 Type: directory Mode: 0755 Flags: 0x0 Generation: 2231959113 Version: 0x00000002:00000002 User: 0 Group: 0 Project: 0 Size: 4096 File ACL: 0 Links: 2 Blockcount: 8 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x675ebfda:00000000 -- Sun Dec 15 06:39:06 2024 atime: 0x675ebfb3:37ca3a00 -- Sun Dec 15 06:38:27 2024 mtime: 0x675ebf8a:00000000 -- Sun Dec 15 06:37:46 2024 crtime: 0x675ebfb3:37ca3a00 -- Sun Dec 15 06:38:27 2024 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x200000402:0x4:0x0] compat=0 incompat=0 trusted.dmv (48) = d0 0c d3 0c 00 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 linkea: idx=0 parent=[0x200000402:0x2:0x0] name='d154.conf-sanity-1.dirent' BLOCKS: (0):24207 TOTAL: 1 oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps 26671 40755 (2) 0 0 4096 15-Dec-2024 06:37 . 26669 40755 (18) 0 0 4096 15-Dec-2024 06:39 fid:[0x200000402:0x2:0x0] .. 55 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename1 56 100644 (1) 0 0 0 15-Dec-2024 06:37 f154.conf-sanity-1.longfilename0 ==post-rename .empty should have 'fid:[0x200000402:0x2:0x0] ..'== oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps Inode: 26673 Type: directory Mode: 0755 Flags: 0x0 Generation: 2231959245 Version: 0x00000002:00000003 User: 0 Group: 0 Project: 0 Size: 4096 File ACL: 0 Links: 2 Blockcount: 8 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x675ebfda:00000000 -- Sun Dec 15 06:39:06 2024 atime: 0x675ebfb3:3eb43f00 -- Sun Dec 15 06:38:27 2024 mtime: 0x675ebf88:00000000 -- Sun Dec 15 06:37:44 2024 crtime: 0x675ebfb3:3eb43f00 -- Sun Dec 15 06:38:27 2024 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x200000402:0x5:0x0] compat=0 incompat=0 trusted.dmv (48) = d0 0c d3 0c 00 00 00 00 00 00 00 00 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 linkea: idx=0 parent=[0x200000402:0x2:0x0] name='d154.conf-sanity-1.empty' BLOCKS: (0):24163 TOTAL: 1 oleg312-server: debugfs 1.46.2.wc5 (26-Mar-2022) oleg312-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps 26673 40755 (2) 0 0 4096 15-Dec-2024 06:37 . 26669 40755 (18) 0 0 4096 15-Dec-2024 06:39 fid:[0x200000402:0x2:0x0] .. e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg312-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg312-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 3) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 209 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 291 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 292 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 294 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] Pass 1: Memory used: 276k/0k (144k/133k), time: 0.00/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 382.12MB/s [Thread 0] Scanned group range [0, 3), inodes 414 Pass 2: Checking directory structure Pass 2: Memory used: 276k/0k (98k/179k), time: 0.00/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 442.28MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 276k/0k (98k/179k), time: 0.01/ 0.00/ 0.00 Pass 3: Memory used: 276k/0k (96k/181k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 276k/0k (68k/209k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 276k/0k (67k/210k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 358.81MB/s 412 inodes used (0.52%, out of 79992) 2 non-contiguous files (0.5%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 24569 blocks used (49.14%, out of 50000) 0 bad blocks 1 large file 280 regular files 122 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 402 files Memory used: 276k/0k (66k/211k), time: 0.02/ 0.01/ 0.00 I/O read: 1MB, write: 0MB, rate: 65.23MB/s