-----============= acceptance-small: conf-sanity ============----- Tue Jun 9 05:18:17 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg313-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682369 > 34553653) for LU-16938, go 81 excepting tests: 32b 32c 32newtarball Stopping clients: oleg313-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg313-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg313-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg313-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg313-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg313-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg313-server oleg313-server: oleg313-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg313-server' oleg313-server: oleg313-server.virtnet: executing load_modules_local oleg313-server: Loading modules from /home/green/git/lustre-release/lustre oleg313-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg313-server: detected 4 online CPUs by sysfs oleg313-server: MODOPTS_LIBCFS= oleg313-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg313-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg313-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg313-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg313-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg313-server: oleg313-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg313-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg313-server: oleg313-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg313-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg313-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg313-server == conf-sanity test 45: long unlink handling in ptlrpcd == 05:22:00 (1780996920) start mds service on oleg313-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg313-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg313-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-OST0000 oleg313-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg313-client.virtnet: -o user_xattr,flock 192.168.203.113@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg313-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg313-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg313-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg313-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg313-client.virtnet: -o user_xattr,flock 192.168.203.113@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg313-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg313-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg313-server unloading modules via unload_modules_local on: 'oleg313-server' oleg313-server: oleg313-server.virtnet: executing unload_modules_local oleg313-server: modules unloaded. pdsh@oleg313-client: oleg313-client: ssh exited with exit code 2 pdsh@oleg313-client: oleg313-server: ssh exited with exit code 2 pdsh@oleg313-client: oleg313-client: ssh exited with exit code 2 pdsh@oleg313-client: oleg313-server: ssh exited with exit code 2 PASS 45 (262s) == conf-sanity test 69: replace an OST with the same index ========================================================== 05:26:23 (1780997183) start mds service on oleg313-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg313-server' oleg313-server: oleg313-server.virtnet: executing load_modules_local oleg313-server: Loading modules from /home/green/git/lustre-release/lustre oleg313-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg313-server: detected 4 online CPUs by sysfs oleg313-server: MODOPTS_LIBCFS= oleg313-server: Force libcfs to create 2 CPU partitions oleg313-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg313-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg313-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg313-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg313-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-OST0000 oleg313-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg313-client.virtnet: -o user_xattr,flock 192.168.203.113@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 715 (time 1780997295.89 total 10.00 last 71.50) - open/close 1424 (time 1780997305.90 total 20.01 last 70.82) - open/close 2066 (time 1780997315.91 total 30.02 last 64.14) - open/close 2785 (time 1780997325.92 total 40.03 last 71.83) - open/close 3444 (time 1780997335.93 total 50.04 last 65.85) - open/close 4084 (time 1780997345.94 total 60.05 last 63.95) - open/close 4636 (time 1780997355.94 total 70.05 last 55.17) - open/close 5346 (time 1780997365.95 total 80.05 last 70.98) - open/close 6079 (time 1780997375.95 total 90.06 last 73.27) - open/close 6766 (time 1780997385.95 total 100.06 last 68.69) - open/close 7467 (time 1780997395.96 total 110.07 last 70.05) - open/close 8069 (time 1780997405.97 total 120.08 last 60.12) - open/close 8742 (time 1780997415.98 total 130.08 last 67.28) - open/close 9471 (time 1780997425.98 total 140.09 last 72.85) total: 10000 open/close in 146.50 seconds: 68.26 ops/second - unlinked 0 (time 1780997436 ; total 0 ; last 0) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second - open/close 718 (time 1780997528.74 total 10.01 last 71.74) - open/close 1433 (time 1780997538.74 total 20.01 last 71.47) - open/close 2122 (time 1780997548.74 total 30.02 last 68.88) - open/close 2845 (time 1780997558.77 total 40.04 last 72.09) - open/close 3560 (time 1780997568.78 total 50.05 last 71.46) - open/close 4257 (time 1780997578.81 total 60.08 last 69.47) - open/close 4990 (time 1780997588.82 total 70.09 last 73.24) - open/close 5765 (time 1780997598.83 total 80.10 last 77.40) - open/close 6504 (time 1780997608.83 total 90.11 last 73.90) - open/close 7260 (time 1780997618.84 total 100.11 last 75.57) - open/close 8050 (time 1780997628.84 total 110.11 last 78.97) - open/close 8738 (time 1780997638.86 total 120.13 last 68.69) - open/close 9459 (time 1780997648.88 total 130.15 last 71.95) total: 10000 open/close in 138.14 seconds: 72.39 ops/second - unlinked 0 (time 1780997661 ; total 0 ; last 0) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second - open/close 715 (time 1780997753.38 total 10.02 last 71.39) - open/close 1527 (time 1780997763.39 total 20.02 last 81.15) - open/close 2275 (time 1780997773.39 total 30.02 last 74.79) - open/close 2967 (time 1780997783.40 total 40.04 last 69.12) - open/close 3667 (time 1780997793.41 total 50.05 last 69.93) - open/close 4475 (time 1780997803.42 total 60.05 last 80.75) - open/close 5168 (time 1780997813.43 total 70.06 last 69.22) - open/close 5811 (time 1780997823.44 total 80.07 last 64.27) - open/close 6500 (time 1780997833.44 total 90.07 last 68.90) - open/close 7222 (time 1780997843.45 total 100.08 last 72.09) - open/close 7895 (time 1780997853.46 total 110.09 last 67.25) - open/close 8670 (time 1780997863.46 total 120.09 last 77.50) - open/close 9402 (time 1780997873.46 total 130.09 last 73.19) total: 10000 open/close in 139.18 seconds: 71.85 ops/second - unlinked 0 (time 1780997887 ; total 0 ; last 0) total: 10000 unlinks in 79 seconds: 126.582275 unlinks/second - open/close 710 (time 1780997981.86 total 10.00 last 71.00) - open/close 1383 (time 1780997991.87 total 20.01 last 67.21) - open/close 2034 (time 1780998001.87 total 30.02 last 65.09) - open/close 2742 (time 1780998011.87 total 40.02 last 70.80) - open/close 3446 (time 1780998021.88 total 50.03 last 70.33) - open/close 4145 (time 1780998031.89 total 60.03 last 69.86) - open/close 4832 (time 1780998041.90 total 70.05 last 68.60) - open/close 5534 (time 1780998051.91 total 80.05 last 70.17) - open/close 6256 (time 1780998061.91 total 90.05 last 72.18) - open/close 6928 (time 1780998071.92 total 100.06 last 67.16) - open/close 7626 (time 1780998081.92 total 110.06 last 69.79) - open/close 8365 (time 1780998091.94 total 120.08 last 73.78) - open/close 9137 (time 1780998101.94 total 130.08 last 77.15) - open/close 9884 (time 1780998111.95 total 140.09 last 74.66) total: 10000 open/close in 141.63 seconds: 70.61 ops/second - unlinked 0 (time 1780998118 ; total 0 ; last 0) total: 10000 unlinks in 80 seconds: 125.000000 unlinks/second - open/close 725 (time 1780998213.54 total 10.01 last 72.44) - open/close 1472 (time 1780998223.55 total 20.02 last 74.58) - open/close 2218 (time 1780998233.57 total 30.04 last 74.48) - open/close 2978 (time 1780998243.58 total 40.05 last 75.94) - open/close 3726 (time 1780998253.58 total 50.05 last 74.76) - open/close 4516 (time 1780998263.59 total 60.06 last 78.96) - open/close 5191 (time 1780998273.60 total 70.07 last 67.43) - open/close 5999 (time 1780998283.60 total 80.07 last 80.77) - open/close 6771 (time 1780998293.61 total 90.08 last 77.12) - open/close 7490 (time 1780998303.62 total 100.09 last 71.88) - open/close 8258 (time 1780998313.62 total 110.09 last 76.79) - open/close 8894 (time 1780998323.62 total 120.09 last 63.56) - open/close 9598 (time 1780998333.63 total 130.10 last 70.33) total: 10000 open/close in 135.46 seconds: 73.83 ops/second - unlinked 0 (time 1780998343 ; total 0 ; last 0) total: 10000 unlinks in 82 seconds: 121.951218 unlinks/second - open/close 691 (time 1780998443.25 total 10.00 last 69.08) - open/close 1379 (time 1780998453.25 total 20.01 last 68.76) - open/close 2177 (time 1780998463.26 total 30.01 last 79.77) - open/close 2877 (time 1780998473.27 total 40.03 last 69.90) - open/close 3460 (time 1780998483.29 total 50.05 last 58.18) - open/close 4102 (time 1780998493.29 total 60.05 last 64.18) - open/close 4695 (time 1780998503.32 total 70.07 last 59.17) - open/close 5385 (time 1780998513.32 total 80.07 last 69.00) - open/close 6058 (time 1780998523.33 total 90.08 last 67.24) - open/close 6780 (time 1780998533.34 total 100.09 last 72.11) - open/close 7518 (time 1780998543.35 total 110.11 last 73.71) - open/close 8271 (time 1780998553.35 total 120.11 last 75.26) - open/close 8963 (time 1780998563.35 total 130.11 last 69.20) - open/close 9741 (time 1780998573.37 total 140.12 last 77.72) total: 10000 open/close in 144.22 seconds: 69.34 ops/second - unlinked 0 (time 1780998582 ; total 0 ; last 0) total: 10000 unlinks in 82 seconds: 121.951218 unlinks/second - open/close 832 (time 1780998678.74 total 10.00 last 83.17) - open/close 1530 (time 1780998688.75 total 20.01 last 69.75) - open/close 2315 (time 1780998698.76 total 30.02 last 78.41) - open/close 2997 (time 1780998708.77 total 40.03 last 68.15) - open/close 3741 (time 1780998718.77 total 50.03 last 74.37) - open/close 4381 (time 1780998728.78 total 60.04 last 63.95) - open/close 5119 (time 1780998738.78 total 70.05 last 73.75) - open/close 5868 (time 1780998748.79 total 80.05 last 74.86) - open/close 6579 (time 1780998758.80 total 90.06 last 71.05) - open/close 7284 (time 1780998768.80 total 100.07 last 70.46) - open/close 7878 (time 1780998778.81 total 110.07 last 59.37) - open/close 8383 (time 1780998788.81 total 120.08 last 50.49) - open/close 9016 (time 1780998798.82 total 130.09 last 63.22) - open/close 9650 (time 1780998808.83 total 140.10 last 63.33) total: 10000 open/close in 144.74 seconds: 69.09 ops/second - unlinked 0 (time 1780998818 ; total 0 ; last 0) total: 10000 unlinks in 82 seconds: 121.951218 unlinks/second - open/close 719 (time 1780998915.99 total 10.01 last 71.85) - open/close 1422 (time 1780998926.00 total 20.01 last 70.25) - open/close 2153 (time 1780998936.01 total 30.03 last 73.01) - open/close 2894 (time 1780998946.03 total 40.05 last 73.93) - open/close 3587 (time 1780998956.04 total 50.06 last 69.26) - open/close 4305 (time 1780998966.04 total 60.06 last 71.77) - open/close 4951 (time 1780998976.05 total 70.07 last 64.55) - open/close 5578 (time 1780998986.07 total 80.08 last 62.60) - open/close 6293 (time 1780998996.07 total 90.08 last 71.50) - open/close 6946 (time 1780999006.08 total 100.09 last 65.23) - open/close 7571 (time 1780999016.08 total 110.10 last 62.49) - open/close 8340 (time 1780999026.09 total 120.10 last 76.85) - open/close 9069 (time 1780999036.10 total 130.12 last 72.80) - open/close 9821 (time 1780999046.10 total 140.12 last 75.17) total: 10000 open/close in 142.47 seconds: 70.19 ops/second - unlinked 0 (time 1780999053 ; total 0 ; last 0) total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second - open/close 454 (time 1780999151.79 total 10.01 last 45.38) - open/close 1029 (time 1780999161.80 total 20.01 last 57.45) - open/close 1670 (time 1780999171.81 total 30.02 last 64.06) - open/close 2351 (time 1780999181.81 total 40.02 last 68.08) - open/close 2883 (time 1780999191.82 total 50.03 last 53.18) - open/close 3442 (time 1780999201.82 total 60.04 last 55.85) - open/close 3963 (time 1780999211.83 total 70.04 last 52.08) - open/close 4517 (time 1780999221.84 total 80.05 last 55.33) - open/close 5190 (time 1780999231.85 total 90.06 last 67.25) - open/close 5928 (time 1780999241.86 total 100.07 last 73.75) - open/close 6615 (time 1780999251.86 total 110.07 last 68.68) - open/close 7227 (time 1780999261.87 total 120.08 last 61.13) - open/close 7931 (time 1780999271.88 total 130.09 last 70.34) - open/close 8652 (time 1780999281.89 total 140.10 last 72.04) - open/close 9322 (time 1780999291.89 total 150.10 last 66.97) total: 10000 open/close in 159.13 seconds: 62.84 ops/second - unlinked 0 (time 1780999306 ; total 0 ; last 0) total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second - open/close 759 (time 1780999404.41 total 10.01 last 75.82) - open/close 1448 (time 1780999414.42 total 20.02 last 68.83) - open/close 2153 (time 1780999424.43 total 30.03 last 70.44) - open/close 2791 (time 1780999434.46 total 40.06 last 63.59) - open/close 3496 (time 1780999444.48 total 50.08 last 70.38) - open/close 4213 (time 1780999454.49 total 60.08 last 71.66) - open/close 4954 (time 1780999464.50 total 70.10 last 73.98) - open/close 5674 (time 1780999474.51 total 80.11 last 71.95) - open/close 6416 (time 1780999484.51 total 90.11 last 74.19) - open/close 7164 (time 1780999494.52 total 100.12 last 74.75) - open/close 7874 (time 1780999504.52 total 110.12 last 70.96) - open/close 8595 (time 1780999514.53 total 120.13 last 72.07) - open/close 9355 (time 1780999524.53 total 130.13 last 75.95) total: 10000 open/close in 138.73 seconds: 72.08 ops/second - unlinked 0 (time 1780999537 ; total 0 ; last 0) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg313-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg313-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg313-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.113@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg313-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-OST0000 oleg313-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg313-server: oleg313-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg313-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg313-server: oleg313-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg313-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg313-client.virtnet: -o user_xattr,flock 192.168.203.113@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg313-client: oleg313-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg313-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg313-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg313-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.113@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.113@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.113@tcp sys.timeout=20 start ost1 service on oleg313-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Started lustre-OST0000 oleg313-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg313-server: oleg313-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg313-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg313-server: oleg313-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg313-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg313-client.virtnet: -o user_xattr,flock 192.168.203.113@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg313-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg313-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg313-server unloading modules via unload_modules_local on: 'oleg313-server' oleg313-server: oleg313-server.virtnet: executing unload_modules_local oleg313-server: modules unloaded. pdsh@oleg313-client: oleg313-server: ssh exited with exit code 2 pdsh@oleg313-client: oleg313-client: ssh exited with exit code 2 pdsh@oleg313-client: oleg313-server: ssh exited with exit code 2 pdsh@oleg313-client: oleg313-client: ssh exited with exit code 2 PASS 69 (2585s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 06:09:29 (1780999769) oleg313-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg313-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg313-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg313-client: oleg313-server: ssh exited with exit code 2 oleg313-server: oleg313-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg313-server' oleg313-server: oleg313-server.virtnet: executing load_modules_local oleg313-server: Loading modules from /home/green/git/lustre-release/lustre oleg313-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg313-server: detected 4 online CPUs by sysfs oleg313-server: MODOPTS_LIBCFS= oleg313-server: Force libcfs to create 2 CPU partitions oleg313-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg313-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg313-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg313-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg313-client.virtnet /mnt/lustre2 (opts:-f) oleg313-server: oleg313-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg313-server' oleg313-server: oleg313-server.virtnet: executing load_modules_local oleg313-server: Loading modules from /home/green/git/lustre-release/lustre oleg313-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg313-server: detected 4 online CPUs by sysfs oleg313-server: MODOPTS_LIBCFS= oleg313-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg313-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg313-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg313-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg313-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg313-server: oleg313-server.virtnet: executing set_default_debug -1 all pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg313-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg313-server: oleg313-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg313-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg313-server: oleg313-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg313-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg313-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg313-server stop mds service on oleg313-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg313-server SKIP 111 (235s) Stopping clients: oleg313-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg313-client.virtnet /mnt/lustre2 (opts:-f) oleg313-server: oleg313-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg313-server' oleg313-server: oleg313-server.virtnet: executing load_modules_local oleg313-server: Loading modules from /home/green/git/lustre-release/lustre oleg313-server: detected 4 online CPUs by sysfs oleg313-server: MODOPTS_LIBCFS= oleg313-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg313-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3370 sec ========== 06:14:29 (1781000069) === conf-sanity: start cleanup 06:14:32 (1781000072) === === conf-sanity: finish cleanup 06:14:36 (1781000076) ===