== sanity-lfsck test 1a: LFSCK can find out and repair crashed FID-in-dirent ========================================================== 03:27:30 (1722238050) Checking servers environments Checking clients oleg312-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: detected 4 online CPUs by sysfs oleg312-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg312-server: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-MDT0000 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg312-server: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-MDT0001 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg312-server: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-OST0000 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg312-server: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client: oleg312-client.virtnet: -o user_xattr,flock oleg312-server@tcp:/lustre /mnt/lustre Starting client oleg312-client.virtnet: -o user_xattr,flock oleg312-server@tcp:/lustre /mnt/lustre Started clients oleg312-client.virtnet: 192.168.203.112@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aaeec800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aaeec800.idle_timeout=debug disable quota as required preparing... 1 * 1 files will be created Mon Jul 29 03:27:54 EDT 2024. total: 1 mkdir in 0.00 seconds: 595.27 ops/second total: 1 create in 0.00 seconds: 594.52 ops/second total: 1 mkdir in 0.00 seconds: 586.53 ops/second prepared Mon Jul 29 03:27:55 EDT 2024. fail_loc=0x1501 fail_loc=0 192.168.203.112@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg312-client.virtnet /mnt/lustre (opts:) Started LFSCK on the device lustre-MDT0000: scrub namespace oleg312-server: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Starting client: oleg312-client.virtnet: -o user_xattr,flock oleg312-server@tcp:/lustre /mnt/lustre fail_loc=0x1505 fail_loc=0