-----============= acceptance-small: conf-sanity ============----- Mon Aug 31 01:12:49 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg260-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682651 > 34553653) for LU-16938, go 81 excepting tests: 32b 32c 32newtarball Stopping clients: oleg260-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg260-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg260-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg260-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg260-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg260-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg260-server oleg260-server: oleg260-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg260-server' oleg260-server: oleg260-server.virtnet: executing load_modules_local oleg260-server: Loading modules from /home/green/git/lustre-release/lustre oleg260-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg260-server: detected 4 online CPUs by sysfs oleg260-server: MODOPTS_LIBCFS= oleg260-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg260-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg260-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg260-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg260-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg260-server: oleg260-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg260-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg260-server: oleg260-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg260-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg260-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg260-server == conf-sanity test 45: long unlink handling in ptlrpcd == 01:16:51 (1788153411) start mds service on oleg260-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg260-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg260-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-OST0000 oleg260-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg260-client.virtnet: -o user_xattr,flock 192.168.202.160@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg260-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg260-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg260-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg260-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg260-client.virtnet: -o user_xattr,flock 192.168.202.160@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg260-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg260-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg260-server unloading modules via unload_modules_local on: 'oleg260-server' oleg260-server: oleg260-server.virtnet: executing unload_modules_local oleg260-server: modules unloaded. pdsh@oleg260-client: oleg260-server: ssh exited with exit code 2 pdsh@oleg260-client: oleg260-client: ssh exited with exit code 2 pdsh@oleg260-client: oleg260-server: ssh exited with exit code 2 pdsh@oleg260-client: oleg260-client: ssh exited with exit code 2 PASS 45 (295s) == conf-sanity test 69: replace an OST with the same index ========================================================== 01:21:47 (1788153707) start mds service on oleg260-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg260-server' oleg260-server: oleg260-server.virtnet: executing load_modules_local oleg260-server: Loading modules from /home/green/git/lustre-release/lustre oleg260-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg260-server: detected 4 online CPUs by sysfs oleg260-server: MODOPTS_LIBCFS= oleg260-server: Force libcfs to create 2 CPU partitions oleg260-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg260-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg260-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg260-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg260-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-OST0000 oleg260-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg260-client.virtnet: -o user_xattr,flock 192.168.202.160@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 826 (time 1788153821.74 total 10.02 last 82.46) - open/close 1658 (time 1788153831.74 total 20.03 last 83.13) - open/close 2434 (time 1788153841.75 total 30.03 last 77.54) - open/close 3267 (time 1788153851.75 total 40.04 last 83.28) - open/close 4141 (time 1788153861.76 total 50.04 last 87.39) - open/close 4939 (time 1788153871.76 total 60.05 last 79.73) - open/close 5816 (time 1788153881.77 total 70.05 last 87.66) - open/close 6579 (time 1788153891.77 total 80.05 last 76.28) - open/close 7330 (time 1788153901.77 total 90.06 last 75.07) - open/close 8150 (time 1788153911.78 total 100.06 last 81.99) - open/close 9015 (time 1788153921.78 total 110.06 last 86.47) - open/close 9759 (time 1788153931.79 total 120.07 last 74.34) total: 10000 open/close in 122.97 seconds: 81.32 ops/second - unlinked 0 (time 1788153939 ; total 0 ; last 0) total: 10000 unlinks in 70 seconds: 142.857147 unlinks/second - open/close 707 (time 1788154024.27 total 10.00 last 70.68) - open/close 1457 (time 1788154034.27 total 20.01 last 74.98) - open/close 2322 (time 1788154044.28 total 30.01 last 86.46) - open/close 3093 (time 1788154054.29 total 40.02 last 77.02) - open/close 3886 (time 1788154064.29 total 50.03 last 79.26) - open/close 4726 (time 1788154074.30 total 60.03 last 83.96) - open/close 5677 (time 1788154084.31 total 70.04 last 95.03) - open/close 6448 (time 1788154094.31 total 80.04 last 77.10) - open/close 7163 (time 1788154104.32 total 90.05 last 71.43) - open/close 7907 (time 1788154114.32 total 100.05 last 74.36) - open/close 8657 (time 1788154124.35 total 110.08 last 74.77) - open/close 9448 (time 1788154134.36 total 120.09 last 79.04) total: 10000 open/close in 127.89 seconds: 78.19 ops/second - unlinked 0 (time 1788154149 ; total 0 ; last 0) total: 10000 unlinks in 81 seconds: 123.456787 unlinks/second - open/close 783 (time 1788154244.86 total 10.01 last 78.24) - open/close 1528 (time 1788154254.86 total 20.01 last 74.45) - open/close 2283 (time 1788154264.87 total 30.02 last 75.42) - open/close 3147 (time 1788154274.88 total 40.03 last 86.34) - open/close 3914 (time 1788154284.88 total 50.03 last 76.68) - open/close 4752 (time 1788154294.89 total 60.04 last 83.70) - open/close 5618 (time 1788154304.90 total 70.05 last 86.57) - open/close 6464 (time 1788154314.91 total 80.06 last 84.52) - open/close 7291 (time 1788154324.92 total 90.07 last 82.59) - open/close 8111 (time 1788154334.93 total 100.08 last 81.89) - open/close 8953 (time 1788154344.94 total 110.09 last 84.12) - open/close 9739 (time 1788154354.95 total 120.10 last 78.55) total: 10000 open/close in 123.81 seconds: 80.77 ops/second - unlinked 0 (time 1788154363 ; total 0 ; last 0) total: 10000 unlinks in 77 seconds: 129.870132 unlinks/second - open/close 792 (time 1788154455.47 total 10.02 last 79.04) - open/close 1529 (time 1788154465.47 total 20.02 last 73.69) - open/close 2328 (time 1788154475.49 total 30.04 last 79.78) - open/close 3144 (time 1788154485.49 total 40.04 last 81.57) - open/close 3912 (time 1788154495.49 total 50.04 last 76.77) - open/close 4725 (time 1788154505.50 total 60.05 last 81.27) - open/close 5530 (time 1788154515.52 total 70.07 last 80.32) - open/close 6157 (time 1788154525.53 total 80.08 last 62.66) - open/close 6832 (time 1788154535.53 total 90.08 last 67.49) - open/close 7518 (time 1788154545.55 total 100.10 last 68.45) - open/close 8168 (time 1788154555.55 total 110.10 last 65.00) - open/close 8884 (time 1788154565.56 total 120.11 last 71.56) - open/close 9668 (time 1788154575.56 total 130.11 last 78.39) total: 10000 open/close in 134.10 seconds: 74.57 ops/second - unlinked 0 (time 1788154585 ; total 1 ; last 1) total: 10000 unlinks in 62 seconds: 161.290329 unlinks/second - open/close 946 (time 1788154661.30 total 10.01 last 94.53) - open/close 1835 (time 1788154671.31 total 20.02 last 88.82) - open/close 2771 (time 1788154681.31 total 30.02 last 93.58) - open/close 3594 (time 1788154691.31 total 40.02 last 82.26) - open/close 4485 (time 1788154701.33 total 50.04 last 88.94) - open/close 5238 (time 1788154711.34 total 60.05 last 75.27) - open/close 6104 (time 1788154721.34 total 70.05 last 86.57) - open/close 7053 (time 1788154731.37 total 80.08 last 94.64) - open/close 8006 (time 1788154741.37 total 90.08 last 95.29) - open/close 8864 (time 1788154751.37 total 100.08 last 85.79) - open/close 9795 (time 1788154761.37 total 110.08 last 93.05) total: 10000 open/close in 112.28 seconds: 89.06 ops/second - unlinked 0 (time 1788154768 ; total 0 ; last 0) total: 10000 unlinks in 69 seconds: 144.927536 unlinks/second - open/close 945 (time 1788154851.75 total 10.01 last 94.44) - open/close 1772 (time 1788154861.77 total 20.03 last 82.54) - open/close 2631 (time 1788154871.77 total 30.03 last 85.85) - open/close 3409 (time 1788154881.79 total 40.05 last 77.66) - open/close 4071 (time 1788154891.80 total 50.06 last 66.14) - open/close 4775 (time 1788154901.80 total 60.06 last 70.39) - open/close 5485 (time 1788154911.81 total 70.06 last 70.97) - open/close 6286 (time 1788154921.81 total 80.07 last 80.04) - open/close 7073 (time 1788154931.82 total 90.08 last 78.64) - open/close 7770 (time 1788154941.83 total 100.09 last 69.65) - open/close 8608 (time 1788154951.84 total 110.10 last 83.72) - open/close 9404 (time 1788154961.85 total 120.11 last 79.53) total: 10000 open/close in 127.54 seconds: 78.41 ops/second - unlinked 0 (time 1788154975 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second - open/close 735 (time 1788155066.23 total 10.00 last 73.48) - open/close 1502 (time 1788155076.24 total 20.01 last 76.67) - open/close 2114 (time 1788155086.24 total 30.01 last 61.18) - open/close 2875 (time 1788155096.24 total 40.01 last 76.10) - open/close 3493 (time 1788155106.24 total 50.02 last 61.77) - open/close 4327 (time 1788155116.25 total 60.02 last 83.37) - open/close 5031 (time 1788155126.27 total 70.04 last 70.28) - open/close 5736 (time 1788155136.27 total 80.04 last 70.47) - open/close 6551 (time 1788155146.28 total 90.05 last 81.44) - open/close 7391 (time 1788155156.28 total 100.05 last 83.98) - open/close 8227 (time 1788155166.29 total 110.06 last 83.50) - open/close 9028 (time 1788155176.30 total 120.07 last 80.06) - open/close 9772 (time 1788155186.30 total 130.07 last 74.35) total: 10000 open/close in 132.54 seconds: 75.45 ops/second - unlinked 0 (time 1788155193 ; total 0 ; last 0) total: 10000 unlinks in 72 seconds: 138.888885 unlinks/second - open/close 846 (time 1788155279.01 total 10.03 last 84.37) - open/close 1487 (time 1788155289.02 total 20.04 last 64.02) - open/close 2237 (time 1788155299.05 total 30.07 last 74.80) - open/close 3143 (time 1788155309.05 total 40.07 last 90.53) - open/close 3915 (time 1788155319.06 total 50.08 last 77.16) - open/close 4729 (time 1788155329.08 total 60.10 last 81.27) - open/close 5507 (time 1788155339.08 total 70.10 last 77.77) - open/close 6212 (time 1788155349.09 total 80.11 last 70.43) - open/close 6788 (time 1788155359.09 total 90.11 last 57.58) - open/close 7415 (time 1788155369.09 total 100.12 last 62.69) - open/close 8005 (time 1788155379.10 total 110.12 last 58.97) - open/close 8891 (time 1788155389.12 total 120.14 last 88.43) - open/close 9724 (time 1788155399.12 total 130.14 last 83.25) total: 10000 open/close in 132.73 seconds: 75.34 ops/second - unlinked 0 (time 1788155406 ; total 0 ; last 0) total: 10000 unlinks in 72 seconds: 138.888885 unlinks/second - open/close 799 (time 1788155492.63 total 10.01 last 79.83) - open/close 1647 (time 1788155502.65 total 20.03 last 84.60) - open/close 2330 (time 1788155512.69 total 30.07 last 68.07) - open/close 3036 (time 1788155522.70 total 40.08 last 70.52) - open/close 3747 (time 1788155532.70 total 50.08 last 71.10) - open/close 4631 (time 1788155542.70 total 60.08 last 88.38) - open/close 5503 (time 1788155552.71 total 70.09 last 87.14) - open/close 6276 (time 1788155562.71 total 80.09 last 77.29) - open/close 7160 (time 1788155572.71 total 90.09 last 88.38) - open/close 8059 (time 1788155582.71 total 100.09 last 89.88) - open/close 8834 (time 1788155592.71 total 110.09 last 77.49) - open/close 9686 (time 1788155602.72 total 120.10 last 85.17) total: 10000 open/close in 123.62 seconds: 80.89 ops/second - unlinked 0 (time 1788155610 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second - open/close 786 (time 1788155699.09 total 10.01 last 78.56) - open/close 1590 (time 1788155709.09 total 20.01 last 80.36) - open/close 2181 (time 1788155719.10 total 30.02 last 59.06) - open/close 2761 (time 1788155729.13 total 40.05 last 57.84) - open/close 3424 (time 1788155739.13 total 50.05 last 66.25) - open/close 4273 (time 1788155749.14 total 60.06 last 84.84) - open/close 5111 (time 1788155759.16 total 70.07 last 83.69) - open/close 5859 (time 1788155769.16 total 80.08 last 74.77) - open/close 6525 (time 1788155779.17 total 90.09 last 66.52) - open/close 7141 (time 1788155789.18 total 100.09 last 61.57) - open/close 7874 (time 1788155799.18 total 110.10 last 73.25) - open/close 8672 (time 1788155809.20 total 120.12 last 79.67) - open/close 9394 (time 1788155819.21 total 130.13 last 72.13) total: 10000 open/close in 138.51 seconds: 72.19 ops/second - unlinked 0 (time 1788155832 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg260-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg260-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg260-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.202.160@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg260-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-OST0000 oleg260-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg260-server: oleg260-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg260-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg260-server: oleg260-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg260-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg260-client.virtnet: -o user_xattr,flock 192.168.202.160@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg260-client: oleg260-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg260-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg260-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg260-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.202.160@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.202.160@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.202.160@tcp sys.timeout=20 start ost1 service on oleg260-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Started lustre-OST0000 oleg260-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg260-server: oleg260-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg260-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg260-server: oleg260-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg260-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg260-client.virtnet: -o user_xattr,flock 192.168.202.160@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg260-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg260-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg260-server unloading modules via unload_modules_local on: 'oleg260-server' oleg260-server: oleg260-server.virtnet: executing unload_modules_local oleg260-server: modules unloaded. pdsh@oleg260-client: oleg260-server: ssh exited with exit code 2 pdsh@oleg260-client: oleg260-client: ssh exited with exit code 2 pdsh@oleg260-client: oleg260-server: ssh exited with exit code 2 pdsh@oleg260-client: oleg260-client: ssh exited with exit code 2 PASS 69 (2373s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 02:01:22 (1788156082) oleg260-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg260-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg260-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg260-client: oleg260-server: ssh exited with exit code 2 oleg260-server: oleg260-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg260-server' oleg260-server: oleg260-server.virtnet: executing load_modules_local oleg260-server: Loading modules from /home/green/git/lustre-release/lustre oleg260-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg260-server: detected 4 online CPUs by sysfs oleg260-server: MODOPTS_LIBCFS= oleg260-server: Force libcfs to create 2 CPU partitions oleg260-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg260-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg260-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg260-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg260-client.virtnet /mnt/lustre2 (opts:-f) oleg260-server: oleg260-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg260-server' oleg260-server: oleg260-server.virtnet: executing load_modules_local oleg260-server: Loading modules from /home/green/git/lustre-release/lustre oleg260-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg260-server: detected 4 online CPUs by sysfs oleg260-server: MODOPTS_LIBCFS= oleg260-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg260-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg260-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg260-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg260-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg260-server: oleg260-server.virtnet: executing set_default_debug -1 all pdsh@oleg260-client: oleg260-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg260-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg260-server: oleg260-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg260-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg260-server: oleg260-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg260-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg260-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg260-server stop mds service on oleg260-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg260-server SKIP 111 (239s) Stopping clients: oleg260-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg260-client.virtnet /mnt/lustre2 (opts:-f) oleg260-server: oleg260-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg260-server' oleg260-server: oleg260-server.virtnet: executing load_modules_local oleg260-server: Loading modules from /home/green/git/lustre-release/lustre oleg260-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg260-server: detected 4 online CPUs by sysfs oleg260-server: MODOPTS_LIBCFS= oleg260-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3214 sec ========== 02:06:24 (1788156384) === conf-sanity: start cleanup 02:06:26 (1788156386) === === conf-sanity: finish cleanup 02:06:29 (1788156389) ===