== sanity-scrub test 17a: ENOSPC on OI insert shouldn't leak inodes ========================================================== 02:48:14 (1761288494) fail_loc=0x8000019d mkdir: cannot create directory '/mnt/lustre/d17a.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg129-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg129-server: e2fsck 1.47.1-wc2 (08-Nov-2024) oleg129-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4], used inodes 418/160000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2311: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2311: increase inode 50 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 50 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 160 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 161 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 162 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 163 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 178 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 185 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 185 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 186 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 186 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 187 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 187 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 188 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 188 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 262 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 265 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 265 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 267 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 267 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 268 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 269 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 270 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 271 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 272 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 273 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 274 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 275 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 276 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 277 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 278 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 279 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 280 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 281 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 282 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 283 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 284 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 285 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 286 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 287 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 288 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 289 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 290 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 291 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 292 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 293 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 294 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 295 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 296 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 297 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 298 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 299 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 300 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 301 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 302 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 302 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 304 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 304 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 305 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 305 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 308 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 308 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 311 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 311 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 313 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 313 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 316 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 316 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 317 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 317 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 320 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 320 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 321 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 321 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 322 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 322 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 323 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 323 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 325 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 325 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 329 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 329 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 330 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 330 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 333 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 333 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 334 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 334 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 335 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 335 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 336 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 336 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 337 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 337 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 338 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 338 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 339 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 339 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 340 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 340 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 341 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 341 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 342 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 342 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 343 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 343 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 344 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 344 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 345 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 345 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 346 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 346 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 347 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 347 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 348 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 348 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 349 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 349 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 350 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 350 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 351 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 351 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2311: increase inode 352 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 352 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2311: increase inode 32022 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2311: increase inode 32023 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2311: increase inode 32024 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 304k/0k (184k/121k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 66.58MB/s [Thread 0] Scanned group range [0, 4], used inodes 418/474 Pass 2: Checking directory structure Pass 2: Memory used: 304k/0k (135k/170k), time: 0.02/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 64.71MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 304k/0k (135k/170k), time: 0.06/ 0.01/ 0.01 Pass 3: Memory used: 304k/0k (134k/171k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 304k/0k (80k/225k), time: 0.02/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 412k/0k (79k/334k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 126.94MB/s 418 inodes used (0.26%, out of 160000) 2 non-contiguous files (0.5%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 355 44700 blocks used (44.70%, out of 100000) 0 bad blocks 1 large file 284 regular files 124 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 408 files Memory used: 412k/0k (83k/330k), time: 0.09/ 0.02/ 0.01 I/O read: 1MB, write: 0MB, rate: 11.27MB/s Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg129-server: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg129-client: oleg129-server: ssh exited with exit code 1 Started lustre-MDT0000