== sanity-lfsck test 1a: LFSCK can find out and repair crashed FID-in-dirent ========================================================== 12:21:50 (1721406110) Checking servers environments Checking clients oleg243-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg243-server: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-MDT0000 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg243-server: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-MDT0001 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg243-server: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-OST0000 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg243-server: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client: oleg243-client.virtnet: -o user_xattr,flock oleg243-server@tcp:/lustre /mnt/lustre Starting client oleg243-client.virtnet: -o user_xattr,flock oleg243-server@tcp:/lustre /mnt/lustre Started clients oleg243-client.virtnet: 192.168.202.143@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012e168000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012e168000.idle_timeout=debug disable quota as required preparing... 1 * 1 files will be created Fri Jul 19 12:22:21 EDT 2024. total: 1 mkdir in 0.00 seconds: 525.21 ops/second total: 1 create in 0.00 seconds: 521.10 ops/second total: 1 mkdir in 0.00 seconds: 430.49 ops/second prepared Fri Jul 19 12:22:22 EDT 2024. fail_loc=0x1501 fail_loc=0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Started LFSCK on the device lustre-MDT0000: scrub namespace oleg243-server: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Starting client: oleg243-client.virtnet: -o user_xattr,flock oleg243-server@tcp:/lustre /mnt/lustre fail_loc=0x1505 fail_loc=0