-----============= acceptance-small: conf-sanity ============----- Tue Sep 8 08:10:01 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg446-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682648 > 34553653) for LU-16938, go 81 excepting tests: 32b 32c 32newtarball Stopping clients: oleg446-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg446-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg446-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg446-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg446-server oleg446-server: oleg446-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing load_modules_local oleg446-server: Loading modules from /home/green/git/lustre-release/lustre oleg446-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg446-server: detected 4 online CPUs by sysfs oleg446-server: MODOPTS_LIBCFS= oleg446-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg446-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg446-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg446-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg446-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg446-server: oleg446-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg446-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg446-server: oleg446-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg446-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg446-server == conf-sanity test 45: long unlink handling in ptlrpcd == 08:14:05 (1788869645) start mds service on oleg446-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg446-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg446-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-OST0000 oleg446-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg446-client.virtnet: -o user_xattr,flock 192.168.204.146@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg446-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg446-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg446-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg446-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg446-client.virtnet: -o user_xattr,flock 192.168.204.146@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg446-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg446-server unloading modules via unload_modules_local on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing unload_modules_local oleg446-server: modules unloaded. pdsh@oleg446-client: oleg446-client: ssh exited with exit code 2 pdsh@oleg446-client: oleg446-server: ssh exited with exit code 2 pdsh@oleg446-client: oleg446-client: ssh exited with exit code 2 pdsh@oleg446-client: oleg446-server: ssh exited with exit code 2 PASS 45 (300s) == conf-sanity test 69: replace an OST with the same index ========================================================== 08:19:05 (1788869945) start mds service on oleg446-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing load_modules_local oleg446-server: Loading modules from /home/green/git/lustre-release/lustre oleg446-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg446-server: detected 4 online CPUs by sysfs oleg446-server: MODOPTS_LIBCFS= oleg446-server: Force libcfs to create 2 CPU partitions oleg446-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg446-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg446-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg446-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg446-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-OST0000 oleg446-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg446-client.virtnet: -o user_xattr,flock 192.168.204.146@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 736 (time 1788870063.90 total 10.00 last 73.59) - open/close 1555 (time 1788870073.90 total 20.01 last 81.84) - open/close 2400 (time 1788870083.91 total 30.02 last 84.44) - open/close 3196 (time 1788870093.91 total 40.02 last 79.60) - open/close 3971 (time 1788870103.91 total 50.02 last 77.48) - open/close 4725 (time 1788870113.92 total 60.02 last 75.37) - open/close 5577 (time 1788870123.92 total 70.03 last 85.15) - open/close 6352 (time 1788870133.93 total 80.03 last 77.46) - open/close 7143 (time 1788870143.94 total 90.05 last 78.99) - open/close 7863 (time 1788870153.94 total 100.05 last 72.00) - open/close 8683 (time 1788870163.96 total 110.06 last 81.90) - open/close 9510 (time 1788870173.97 total 120.07 last 82.60) total: 10000 open/close in 127.79 seconds: 78.26 ops/second - unlinked 0 (time 1788870187 ; total 0 ; last 0) total: 10000 unlinks in 71 seconds: 140.845078 unlinks/second - open/close 682 (time 1788870272.87 total 10.02 last 68.08) - open/close 1526 (time 1788870282.87 total 20.02 last 84.39) - open/close 2349 (time 1788870292.88 total 30.03 last 82.22) - open/close 3171 (time 1788870302.88 total 40.03 last 82.17) - open/close 4088 (time 1788870312.89 total 50.04 last 91.65) - open/close 4928 (time 1788870322.90 total 60.05 last 83.87) - open/close 5783 (time 1788870332.91 total 70.06 last 85.47) - open/close 6608 (time 1788870342.91 total 80.06 last 82.47) - open/close 7404 (time 1788870352.92 total 90.07 last 79.55) - open/close 8225 (time 1788870362.92 total 100.07 last 82.07) - open/close 9164 (time 1788870372.92 total 110.07 last 93.89) - open/close 9912 (time 1788870382.92 total 120.07 last 74.79) total: 10000 open/close in 121.18 seconds: 82.52 ops/second - unlinked 0 (time 1788870387 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second - open/close 539 (time 1788870498.81 total 10.03 last 53.76) - open/close 1309 (time 1788870508.81 total 20.03 last 76.97) - open/close 2045 (time 1788870518.82 total 30.04 last 73.55) - open/close 2794 (time 1788870528.83 total 40.04 last 74.86) - open/close 3461 (time 1788870538.83 total 50.05 last 66.65) - open/close 4140 (time 1788870548.83 total 60.05 last 67.89) - open/close 4791 (time 1788870558.84 total 70.05 last 65.08) - open/close 5516 (time 1788870568.85 total 80.06 last 72.44) - open/close 6210 (time 1788870578.86 total 90.08 last 69.30) - open/close 6910 (time 1788870588.87 total 100.08 last 69.95) - open/close 7671 (time 1788870598.87 total 110.09 last 76.06) - open/close 8422 (time 1788870608.90 total 120.12 last 74.89) - open/close 9146 (time 1788870618.91 total 130.13 last 72.32) - open/close 9877 (time 1788870628.93 total 140.14 last 73.00) total: 10000 open/close in 142.12 seconds: 70.36 ops/second - unlinked 0 (time 1788870635 ; total 0 ; last 0) total: 10000 unlinks in 69 seconds: 144.927536 unlinks/second - open/close 696 (time 1788870719.21 total 10.00 last 69.60) - open/close 1512 (time 1788870729.22 total 20.01 last 81.55) - open/close 2392 (time 1788870739.22 total 30.01 last 87.98) - open/close 3143 (time 1788870749.23 total 40.01 last 75.07) - open/close 3868 (time 1788870759.23 total 50.02 last 72.45) - open/close 4714 (time 1788870769.24 total 60.02 last 84.58) - open/close 5590 (time 1788870779.24 total 70.03 last 87.57) - open/close 6393 (time 1788870789.24 total 80.03 last 80.26) - open/close 7213 (time 1788870799.25 total 90.04 last 81.95) - open/close 8057 (time 1788870809.25 total 100.04 last 84.36) - open/close 8810 (time 1788870819.26 total 110.05 last 75.22) - open/close 9701 (time 1788870829.27 total 120.05 last 89.09) total: 10000 open/close in 123.72 seconds: 80.83 ops/second - unlinked 0 (time 1788870835 ; total 0 ; last 0) total: 10000 unlinks in 70 seconds: 142.857147 unlinks/second - open/close 782 (time 1788870920.31 total 10.00 last 78.16) - open/close 1584 (time 1788870930.32 total 20.02 last 80.11) - open/close 2361 (time 1788870940.33 total 30.02 last 77.69) - open/close 3152 (time 1788870950.34 total 40.03 last 79.00) - open/close 3998 (time 1788870960.35 total 50.04 last 84.49) - open/close 4841 (time 1788870970.37 total 60.06 last 84.14) - open/close 5723 (time 1788870980.38 total 70.07 last 88.09) - open/close 6622 (time 1788870990.38 total 80.07 last 89.89) - open/close 7457 (time 1788871000.39 total 90.08 last 83.44) - open/close 8298 (time 1788871010.40 total 100.09 last 84.02) - open/close 9207 (time 1788871020.40 total 110.09 last 90.86) total: 10000 open/close in 119.01 seconds: 84.03 ops/second - unlinked 0 (time 1788871033 ; total 0 ; last 0) total: 10000 unlinks in 68 seconds: 147.058823 unlinks/second - open/close 855 (time 1788871116.17 total 10.00 last 85.47) - open/close 1744 (time 1788871126.17 total 20.01 last 88.88) - open/close 2552 (time 1788871136.19 total 30.02 last 80.71) - open/close 3367 (time 1788871146.19 total 40.02 last 81.44) - open/close 4187 (time 1788871156.20 total 50.03 last 81.95) - open/close 5010 (time 1788871166.21 total 60.04 last 82.24) - open/close 5855 (time 1788871176.22 total 70.05 last 84.38) - open/close 6706 (time 1788871186.22 total 80.05 last 85.07) - open/close 7556 (time 1788871196.22 total 90.06 last 84.99) - open/close 8460 (time 1788871206.23 total 100.06 last 90.36) - open/close 9276 (time 1788871216.23 total 110.06 last 81.56) total: 10000 open/close in 119.41 seconds: 83.75 ops/second - unlinked 0 (time 1788871229 ; total 0 ; last 0) total: 10000 unlinks in 75 seconds: 133.333328 unlinks/second - open/close 715 (time 1788871319.34 total 10.01 last 71.43) - open/close 1424 (time 1788871329.34 total 20.01 last 70.87) - open/close 2349 (time 1788871339.35 total 30.02 last 92.44) - open/close 3204 (time 1788871349.37 total 40.03 last 85.38) - open/close 4004 (time 1788871359.37 total 50.04 last 79.96) - open/close 4815 (time 1788871369.37 total 60.04 last 81.07) - open/close 5586 (time 1788871379.38 total 70.05 last 77.06) - open/close 6485 (time 1788871389.38 total 80.05 last 89.89) - open/close 7387 (time 1788871399.38 total 90.05 last 90.20) - open/close 8219 (time 1788871409.38 total 100.05 last 83.19) - open/close 9107 (time 1788871419.39 total 110.05 last 88.76) - open/close 9976 (time 1788871429.40 total 120.07 last 86.81) total: 10000 open/close in 120.47 seconds: 83.01 ops/second - unlinked 0 (time 1788871434 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second - open/close 826 (time 1788871525.02 total 10.01 last 82.52) - open/close 1627 (time 1788871535.03 total 20.01 last 80.07) - open/close 2476 (time 1788871545.03 total 30.02 last 84.87) - open/close 3270 (time 1788871555.05 total 40.03 last 79.27) - open/close 4171 (time 1788871565.05 total 50.04 last 90.05) - open/close 4970 (time 1788871575.05 total 60.04 last 79.89) - open/close 5902 (time 1788871585.06 total 70.05 last 93.15) - open/close 6672 (time 1788871595.06 total 80.05 last 76.98) - open/close 7516 (time 1788871605.07 total 90.06 last 84.30) - open/close 8444 (time 1788871615.08 total 100.07 last 92.74) - open/close 9290 (time 1788871625.09 total 110.07 last 84.55) total: 10000 open/close in 118.83 seconds: 84.16 ops/second - unlinked 0 (time 1788871637 ; total 0 ; last 0) total: 10000 unlinks in 65 seconds: 153.846161 unlinks/second - open/close 889 (time 1788871716.99 total 10.00 last 88.87) - open/close 1790 (time 1788871726.99 total 20.01 last 90.05) - open/close 2715 (time 1788871737.00 total 30.01 last 92.47) - open/close 3627 (time 1788871747.01 total 40.02 last 91.11) - open/close 4426 (time 1788871757.01 total 50.03 last 79.89) - open/close 5268 (time 1788871767.01 total 60.03 last 84.17) - open/close 6063 (time 1788871777.02 total 70.03 last 79.47) - open/close 7028 (time 1788871787.03 total 80.04 last 96.42) - open/close 7981 (time 1788871797.03 total 90.04 last 95.27) - open/close 8844 (time 1788871807.03 total 100.05 last 86.25) - open/close 9713 (time 1788871817.05 total 110.06 last 86.80) total: 10000 open/close in 113.18 seconds: 88.35 ops/second - unlinked 0 (time 1788871824 ; total 0 ; last 0) total: 10000 unlinks in 67 seconds: 149.253738 unlinks/second - open/close 827 (time 1788871904.87 total 10.00 last 82.67) - open/close 1690 (time 1788871914.88 total 20.01 last 86.24) - open/close 2551 (time 1788871924.88 total 30.01 last 86.10) - open/close 3435 (time 1788871934.90 total 40.03 last 88.20) - open/close 4286 (time 1788871944.92 total 50.05 last 84.99) - open/close 5070 (time 1788871954.92 total 60.05 last 78.36) - open/close 5836 (time 1788871964.92 total 70.05 last 76.59) - open/close 6714 (time 1788871974.93 total 80.06 last 87.76) - open/close 7423 (time 1788871984.94 total 90.07 last 70.84) - open/close 8272 (time 1788871994.94 total 100.07 last 84.89) - open/close 9024 (time 1788872004.96 total 110.09 last 75.06) - open/close 9688 (time 1788872014.97 total 120.10 last 66.31) total: 10000 open/close in 124.82 seconds: 80.12 ops/second - unlinked 0 (time 1788872025 ; total 0 ; last 0) total: 10000 unlinks in 68 seconds: 147.058823 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg446-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.146@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg446-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-OST0000 oleg446-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg446-server: oleg446-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg446-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg446-server: oleg446-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg446-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg446-client.virtnet: -o user_xattr,flock 192.168.204.146@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg446-client: oleg446-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg446-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.146@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.146@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.146@tcp sys.timeout=20 start ost1 service on oleg446-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-OST0000 oleg446-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg446-server: oleg446-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg446-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg446-server: oleg446-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg446-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg446-client.virtnet: -o user_xattr,flock 192.168.204.146@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg446-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg446-server unloading modules via unload_modules_local on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing unload_modules_local oleg446-server: modules unloaded. pdsh@oleg446-client: oleg446-client: ssh exited with exit code 2 pdsh@oleg446-client: oleg446-server: ssh exited with exit code 2 pdsh@oleg446-client: oleg446-server: ssh exited with exit code 2 pdsh@oleg446-client: oleg446-client: ssh exited with exit code 2 PASS 69 (2327s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 08:57:53 (1788872273) oleg446-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg446-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg446-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg446-client: oleg446-server: ssh exited with exit code 2 oleg446-server: oleg446-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing load_modules_local oleg446-server: Loading modules from /home/green/git/lustre-release/lustre oleg446-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg446-server: detected 4 online CPUs by sysfs oleg446-server: MODOPTS_LIBCFS= oleg446-server: Force libcfs to create 2 CPU partitions oleg446-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg446-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg446-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg446-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg446-client.virtnet /mnt/lustre2 (opts:-f) oleg446-server: oleg446-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing load_modules_local oleg446-server: Loading modules from /home/green/git/lustre-release/lustre oleg446-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg446-server: detected 4 online CPUs by sysfs oleg446-server: MODOPTS_LIBCFS= oleg446-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg446-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg446-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg446-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg446-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg446-server: oleg446-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg446-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg446-server: oleg446-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg446-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg446-server SKIP 111 (252s) Stopping clients: oleg446-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg446-client.virtnet /mnt/lustre2 (opts:-f) oleg446-server: oleg446-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing load_modules_local oleg446-server: Loading modules from /home/green/git/lustre-release/lustre oleg446-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg446-server: detected 4 online CPUs by sysfs oleg446-server: MODOPTS_LIBCFS= oleg446-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3191 sec ========== 09:03:14 (1788872594) === conf-sanity: start cleanup 09:03:16 (1788872596) === === conf-sanity: finish cleanup 09:03:20 (1788872600) ===