-----============= acceptance-small: conf-sanity ============----- Sat Aug 22 19:11:42 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg623-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683199 >= 34553653) for LU-16938, go 81 - see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683199 >= 34554143) for LU-18348, go 32b 32c - see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683199 >= 34617107) for LU-17920, go 123ae 123ag excepting tests: 32b 32c 32newtarball Stopping clients: oleg623-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg623-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg623-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg623-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg623-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg623-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg623-server oleg623-server: oleg623-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg623-server' oleg623-server: oleg623-server.virtnet: executing load_modules_local oleg623-server: Loading modules from /home/green/git/lustre-release/lustre oleg623-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg623-server: detected 4 online CPUs by sysfs oleg623-server: MODOPTS_LIBCFS= oleg623-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg623-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg623-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg623-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg623-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg623-server: oleg623-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg623-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg623-server: oleg623-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg623-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg623-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg623-server == conf-sanity test 45: long unlink handling in ptlrpcd == 19:15:09 (1787440509) start mds service on oleg623-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg623-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg623-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-OST0000 oleg623-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg623-client.virtnet: -o user_xattr,flock 192.168.206.123@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg623-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg623-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg623-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg623-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg623-client.virtnet: -o user_xattr,flock 192.168.206.123@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg623-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg623-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg623-server unloading modules via unload_modules_local on: 'oleg623-server' oleg623-server: oleg623-server.virtnet: executing unload_modules_local oleg623-server: modules unloaded. pdsh@oleg623-client: oleg623-client: ssh exited with exit code 2 pdsh@oleg623-client: oleg623-server: ssh exited with exit code 2 pdsh@oleg623-client: oleg623-client: ssh exited with exit code 2 pdsh@oleg623-client: oleg623-server: ssh exited with exit code 2 PASS 45 (290s) == conf-sanity test 69: replace an OST with the same index ========================================================== 19:19:58 (1787440798) start mds service on oleg623-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg623-server' oleg623-server: oleg623-server.virtnet: executing load_modules_local oleg623-server: Loading modules from /home/green/git/lustre-release/lustre oleg623-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg623-server: detected 4 online CPUs by sysfs oleg623-server: MODOPTS_LIBCFS= oleg623-server: Force libcfs to create 2 CPU partitions oleg623-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg623-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg623-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg623-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg623-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-OST0000 oleg623-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg623-client.virtnet: -o user_xattr,flock 192.168.206.123@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49535 inodes available. Want 99872. rc=0 - open/close 760 (time 1787440908.45 total 10.01 last 75.89) - open/close 1486 (time 1787440918.45 total 20.02 last 72.59) - open/close 2161 (time 1787440928.46 total 30.03 last 67.43) - open/close 2924 (time 1787440938.46 total 40.03 last 76.29) - open/close 3683 (time 1787440948.46 total 50.03 last 75.88) - open/close 4493 (time 1787440958.47 total 60.03 last 80.97) - open/close 5275 (time 1787440968.48 total 70.04 last 78.13) - open/close 6049 (time 1787440978.49 total 80.05 last 77.31) - open/close 6819 (time 1787440988.51 total 90.07 last 76.87) - open/close 7596 (time 1787440998.51 total 100.07 last 77.69) - open/close 8341 (time 1787441008.51 total 110.08 last 74.49) - open/close 9116 (time 1787441018.52 total 120.08 last 77.43) - open/close 9740 (time 1787441028.53 total 130.09 last 62.34) total: 10000 open/close in 133.29 seconds: 75.02 ops/second - unlinked 0 (time 1787441036 ; total 0 ; last 0) total: 10000 unlinks in 70 seconds: 142.857147 unlinks/second - open/close 758 (time 1787441121.14 total 10.01 last 75.74) - open/close 1556 (time 1787441131.15 total 20.02 last 79.68) - open/close 2395 (time 1787441141.16 total 30.03 last 83.85) - open/close 3250 (time 1787441151.17 total 40.04 last 85.40) - open/close 4053 (time 1787441161.17 total 50.05 last 80.25) - open/close 4922 (time 1787441171.18 total 60.05 last 86.88) - open/close 5773 (time 1787441181.18 total 70.05 last 85.06) - open/close 6467 (time 1787441191.19 total 80.06 last 69.33) - open/close 7170 (time 1787441201.22 total 90.09 last 70.12) - open/close 7907 (time 1787441211.23 total 100.10 last 73.63) - open/close 8648 (time 1787441221.23 total 110.10 last 74.06) - open/close 9441 (time 1787441231.28 total 120.15 last 78.91) total: 10000 open/close in 127.63 seconds: 78.35 ops/second - unlinked 0 (time 1787441243 ; total 0 ; last 0) total: 10000 unlinks in 71 seconds: 140.845078 unlinks/second - open/close 781 (time 1787441328.72 total 10.00 last 78.07) - open/close 1618 (time 1787441338.72 total 20.00 last 83.69) - open/close 2416 (time 1787441348.72 total 30.00 last 79.80) - open/close 3172 (time 1787441358.72 total 40.01 last 75.59) - open/close 3870 (time 1787441368.72 total 50.01 last 69.77) - open/close 4552 (time 1787441378.73 total 60.02 last 68.13) - open/close 5279 (time 1787441388.74 total 70.03 last 72.62) - open/close 5987 (time 1787441398.76 total 80.04 last 70.72) - open/close 6770 (time 1787441408.77 total 90.05 last 78.22) - open/close 7572 (time 1787441418.78 total 100.06 last 80.13) - open/close 8385 (time 1787441428.78 total 110.07 last 81.23) - open/close 9231 (time 1787441438.79 total 120.08 last 84.55) total: 10000 open/close in 129.19 seconds: 77.41 ops/second - unlinked 0 (time 1787441451 ; total 0 ; last 0) total: 10000 unlinks in 67 seconds: 149.253738 unlinks/second - open/close 803 (time 1787441532.12 total 10.00 last 80.29) - open/close 1609 (time 1787441542.12 total 20.01 last 80.56) - open/close 2449 (time 1787441552.13 total 30.01 last 83.94) - open/close 3259 (time 1787441562.13 total 40.02 last 80.95) - open/close 4078 (time 1787441572.14 total 50.02 last 81.89) - open/close 4954 (time 1787441582.14 total 60.02 last 87.59) - open/close 5732 (time 1787441592.14 total 70.03 last 77.76) - open/close 6543 (time 1787441602.15 total 80.03 last 81.05) - open/close 7309 (time 1787441612.15 total 90.03 last 76.60) - open/close 8118 (time 1787441622.15 total 100.04 last 80.88) - open/close 8957 (time 1787441632.16 total 110.04 last 83.83) - open/close 9777 (time 1787441642.17 total 120.06 last 81.88) total: 10000 open/close in 122.84 seconds: 81.41 ops/second - unlinked 0 (time 1787441647 ; total 0 ; last 0) total: 10000 unlinks in 67 seconds: 149.253738 unlinks/second - open/close 796 (time 1787441728.42 total 10.01 last 79.53) - open/close 1504 (time 1787441738.43 total 20.02 last 70.75) - open/close 2214 (time 1787441748.44 total 30.03 last 70.93) - open/close 2940 (time 1787441758.44 total 40.03 last 72.56) - open/close 3719 (time 1787441768.45 total 50.04 last 77.82) - open/close 4541 (time 1787441778.46 total 60.05 last 82.12) - open/close 5366 (time 1787441788.47 total 70.06 last 82.43) - open/close 6152 (time 1787441798.49 total 80.08 last 78.43) - open/close 6884 (time 1787441808.50 total 90.08 last 73.19) - open/close 7691 (time 1787441818.50 total 100.09 last 80.68) - open/close 8528 (time 1787441828.51 total 110.09 last 83.62) - open/close 9318 (time 1787441838.52 total 120.10 last 78.93) total: 10000 open/close in 128.62 seconds: 77.75 ops/second - unlinked 0 (time 1787441852 ; total 0 ; last 0) total: 10000 unlinks in 70 seconds: 142.857147 unlinks/second - open/close 803 (time 1787441936.90 total 10.01 last 80.26) - open/close 1621 (time 1787441946.91 total 20.01 last 81.78) - open/close 2426 (time 1787441956.91 total 30.01 last 80.47) - open/close 3234 (time 1787441966.91 total 40.01 last 80.78) - open/close 4029 (time 1787441976.94 total 50.04 last 79.29) - open/close 4793 (time 1787441986.94 total 60.04 last 76.38) - open/close 5704 (time 1787441996.95 total 70.05 last 91.02) - open/close 6541 (time 1787442006.96 total 80.06 last 83.64) - open/close 7324 (time 1787442016.96 total 90.06 last 78.26) - open/close 8192 (time 1787442026.96 total 100.06 last 86.79) - open/close 8976 (time 1787442036.97 total 110.07 last 78.38) - open/close 9659 (time 1787442046.97 total 120.07 last 68.28) total: 10000 open/close in 126.11 seconds: 79.30 ops/second - unlinked 0 (time 1787442059 ; total 0 ; last 0) total: 10000 unlinks in 69 seconds: 144.927536 unlinks/second - open/close 844 (time 1787442143.65 total 10.01 last 84.35) - open/close 1634 (time 1787442153.66 total 20.01 last 78.95) - open/close 2390 (time 1787442163.67 total 30.03 last 75.49) - open/close 3182 (time 1787442173.69 total 40.04 last 79.05) - open/close 4040 (time 1787442183.70 total 50.05 last 85.74) - open/close 4855 (time 1787442193.70 total 60.06 last 81.47) - open/close 5649 (time 1787442203.70 total 70.06 last 79.39) - open/close 6481 (time 1787442213.71 total 80.06 last 83.14) - open/close 7306 (time 1787442223.72 total 90.07 last 82.46) - open/close 8123 (time 1787442233.72 total 100.07 last 81.69) - open/close 8968 (time 1787442243.73 total 110.08 last 84.39) - open/close 9819 (time 1787442253.73 total 120.08 last 85.10) total: 10000 open/close in 122.16 seconds: 81.86 ops/second - unlinked 0 (time 1787442259 ; total 0 ; last 0) total: 10000 unlinks in 69 seconds: 144.927536 unlinks/second - open/close 775 (time 1787442342.69 total 10.01 last 77.40) - open/close 1611 (time 1787442352.71 total 20.03 last 83.49) - open/close 2440 (time 1787442362.72 total 30.04 last 82.80) - open/close 3254 (time 1787442372.72 total 40.04 last 81.38) - open/close 4066 (time 1787442382.73 total 50.05 last 81.14) - open/close 4874 (time 1787442392.74 total 60.06 last 80.71) - open/close 5731 (time 1787442402.74 total 70.06 last 85.67) - open/close 6538 (time 1787442412.75 total 80.06 last 80.67) - open/close 7387 (time 1787442422.75 total 90.07 last 84.89) - open/close 8220 (time 1787442432.75 total 100.07 last 83.24) - open/close 9028 (time 1787442442.76 total 110.08 last 80.71) - open/close 9844 (time 1787442452.78 total 120.10 last 81.45) total: 10000 open/close in 122.40 seconds: 81.70 ops/second - unlinked 0 (time 1787442459 ; total 0 ; last 0) total: 10000 unlinks in 73 seconds: 136.986298 unlinks/second - open/close 685 (time 1787442547.95 total 10.00 last 68.48) - open/close 1374 (time 1787442557.96 total 20.01 last 68.82) - open/close 2078 (time 1787442567.96 total 30.02 last 70.39) - open/close 2801 (time 1787442577.98 total 40.03 last 72.22) - open/close 3548 (time 1787442587.99 total 50.04 last 74.61) - open/close 4256 (time 1787442598.00 total 60.05 last 70.73) - open/close 5105 (time 1787442608.01 total 70.06 last 84.84) - open/close 5857 (time 1787442618.01 total 80.07 last 75.14) - open/close 6621 (time 1787442628.02 total 90.07 last 76.34) - open/close 7507 (time 1787442638.05 total 100.10 last 88.40) - open/close 8280 (time 1787442648.05 total 110.10 last 77.27) - open/close 9070 (time 1787442658.05 total 120.10 last 79.00) - open/close 9926 (time 1787442668.06 total 130.11 last 85.53) total: 10000 open/close in 130.94 seconds: 76.37 ops/second - unlinked 0 (time 1787442673 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second - open/close 858 (time 1787442761.63 total 10.01 last 85.75) - open/close 1735 (time 1787442771.63 total 20.01 last 87.63) - open/close 2575 (time 1787442781.65 total 30.03 last 83.87) - open/close 3368 (time 1787442791.66 total 40.04 last 79.22) - open/close 4151 (time 1787442801.66 total 50.04 last 78.27) - open/close 5005 (time 1787442811.67 total 60.05 last 85.38) - open/close 5794 (time 1787442821.67 total 70.05 last 78.86) - open/close 6681 (time 1787442831.68 total 80.06 last 88.66) - open/close 7462 (time 1787442841.68 total 90.06 last 78.06) - open/close 8179 (time 1787442851.70 total 100.08 last 71.55) - open/close 8881 (time 1787442861.71 total 110.09 last 70.12) - open/close 9575 (time 1787442871.72 total 120.10 last 69.37) total: 10000 open/close in 125.60 seconds: 79.62 ops/second - unlinked 0 (time 1787442881 ; total 0 ; last 0) total: 10000 unlinks in 82 seconds: 121.951218 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg623-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg623-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg623-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.206.123@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg623-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-OST0000 oleg623-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg623-server: oleg623-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg623-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg623-server: oleg623-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg623-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg623-client.virtnet: -o user_xattr,flock 192.168.206.123@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg623-client: oleg623-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg623-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg623-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg623-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.206.123@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.206.123@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.206.123@tcp sys.timeout=20 start ost1 service on oleg623-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Started lustre-OST0000 oleg623-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg623-server: oleg623-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg623-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg623-server: oleg623-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg623-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg623-client.virtnet: -o user_xattr,flock 192.168.206.123@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg623-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg623-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg623-server unloading modules via unload_modules_local on: 'oleg623-server' oleg623-server: oleg623-server.virtnet: executing unload_modules_local oleg623-server: modules unloaded. pdsh@oleg623-client: oleg623-server: ssh exited with exit code 2 pdsh@oleg623-client: oleg623-client: ssh exited with exit code 2 pdsh@oleg623-client: oleg623-client: ssh exited with exit code 2 pdsh@oleg623-client: oleg623-server: ssh exited with exit code 2 PASS 69 (2325s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 19:58:44 (1787443124) oleg623-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg623-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg623-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg623-client: oleg623-server: ssh exited with exit code 2 oleg623-server: oleg623-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg623-server' oleg623-server: oleg623-server.virtnet: executing load_modules_local oleg623-server: Loading modules from /home/green/git/lustre-release/lustre oleg623-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg623-server: detected 4 online CPUs by sysfs oleg623-server: MODOPTS_LIBCFS= oleg623-server: Force libcfs to create 2 CPU partitions oleg623-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg623-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg623-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg623-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg623-client.virtnet /mnt/lustre2 (opts:-f) oleg623-server: oleg623-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg623-server' oleg623-server: oleg623-server.virtnet: executing load_modules_local oleg623-server: Loading modules from /home/green/git/lustre-release/lustre oleg623-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg623-server: detected 4 online CPUs by sysfs oleg623-server: MODOPTS_LIBCFS= oleg623-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg623-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg623-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg623-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg623-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg623-server: oleg623-server.virtnet: executing set_default_debug -1 all pdsh@oleg623-client: oleg623-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg623-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg623-server: oleg623-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg623-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg623-server: oleg623-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg623-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg623-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg623-server stop mds service on oleg623-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg623-server SKIP 111 (238s) Stopping clients: oleg623-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg623-client.virtnet /mnt/lustre2 (opts:-f) oleg623-server: oleg623-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg623-server' oleg623-server: oleg623-server.virtnet: executing load_modules_local oleg623-server: Loading modules from /home/green/git/lustre-release/lustre oleg623-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg623-server: detected 4 online CPUs by sysfs oleg623-server: MODOPTS_LIBCFS= oleg623-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3127 sec ========== 20:03:50 (1787443430) === conf-sanity: start cleanup 20:03:52 (1787443432) === === conf-sanity: finish cleanup 20:03:56 (1787443436) ===