-----============= acceptance-small: conf-sanity ============----- Sun Sep 6 05:14:24 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg324-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683394 >= 34553653) for LU-16938, go 81 - see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683394 >= 34554143) for LU-18348, go 32b 32c - see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683394 >= 34617107) for LU-17920, go 123ae 123ag - see CLIENT_VERSION >= v2_17_52-94-g86904ef943 (34683394 >= 34681950) for LU-19740, go 115 excepting tests: 32b 32c 32newtarball Stopping clients: oleg324-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg324-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg324-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg324-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg324-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg324-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg324-server oleg324-server: oleg324-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg324-server' oleg324-server: oleg324-server.virtnet: executing load_modules_local oleg324-server: kmemleak disabled oleg324-server: Loading modules from /home/green/git/lustre-release/lustre oleg324-server: detected 4 online CPUs by sysfs oleg324-server: MODOPTS_LIBCFS= oleg324-server: Force libcfs to create 2 CPU partitions oleg324-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg324-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg324-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg324-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg324-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg324-server: oleg324-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg324-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg324-server: oleg324-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg324-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg324-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg324-server == conf-sanity test 45: long unlink handling in ptlrpcd == 05:17:32 (1788686252) start mds service on oleg324-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg324-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg324-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-OST0000 oleg324-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg324-client.virtnet: -o user_xattr,flock 192.168.203.124@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg324-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg324-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg324-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg324-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg324-client.virtnet: -o user_xattr,flock 192.168.203.124@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg324-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg324-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg324-server unloading modules via unload_modules_local on: 'oleg324-server' oleg324-server: oleg324-server.virtnet: executing unload_modules_local oleg324-server: kmemleak disabled modules unloaded. pdsh@oleg324-client: oleg324-server: ssh exited with exit code 2 pdsh@oleg324-client: oleg324-client: ssh exited with exit code 2 pdsh@oleg324-client: oleg324-server: ssh exited with exit code 2 pdsh@oleg324-client: oleg324-client: ssh exited with exit code 2 PASS 45 (253s) == conf-sanity test 69: replace an OST with the same index ========================================================== 05:21:44 (1788686504) start mds service on oleg324-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x. 1 green green 1921056 Sep 5 18:57 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg324-server' oleg324-server: oleg324-server.virtnet: executing load_modules_local oleg324-server: kmemleak disabled oleg324-server: Loading modules from /home/green/git/lustre-release/lustre oleg324-server: detected 4 online CPUs by sysfs oleg324-server: MODOPTS_LIBCFS= oleg324-server: Force libcfs to create 2 CPU partitions oleg324-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg324-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg324-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg324-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg324-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg324-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-OST0000 oleg324-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg324-client.virtnet: -o user_xattr,flock 192.168.203.124@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 752 (time 1788686613.14 total 10.00 last 75.20) - open/close 1534 (time 1788686623.14 total 20.00 last 78.19) - open/close 2275 (time 1788686633.15 total 30.01 last 74.04) - open/close 3022 (time 1788686643.16 total 40.02 last 74.66) - open/close 3615 (time 1788686653.17 total 50.03 last 59.24) - open/close 4217 (time 1788686663.17 total 60.03 last 60.16) - open/close 4903 (time 1788686673.18 total 70.04 last 68.56) - open/close 5667 (time 1788686683.18 total 80.04 last 76.37) - open/close 6426 (time 1788686693.18 total 90.04 last 75.90) - open/close 7103 (time 1788686703.19 total 100.05 last 67.65) - open/close 7859 (time 1788686713.20 total 110.06 last 75.56) - open/close 8569 (time 1788686723.20 total 120.06 last 71.00) - open/close 9365 (time 1788686733.21 total 130.06 last 79.52) total: 10000 open/close in 137.91 seconds: 72.51 ops/second - unlinked 0 (time 1788686745 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second - open/close 682 (time 1788686833.69 total 10.01 last 68.15) - open/close 1393 (time 1788686843.70 total 20.02 last 71.03) - open/close 2128 (time 1788686853.71 total 30.02 last 73.47) - open/close 2737 (time 1788686863.71 total 40.02 last 60.88) - open/close 3425 (time 1788686873.71 total 50.03 last 68.79) - open/close 4084 (time 1788686883.73 total 60.04 last 65.78) - open/close 4820 (time 1788686893.75 total 70.06 last 73.45) - open/close 5527 (time 1788686903.77 total 80.08 last 70.57) - open/close 6204 (time 1788686913.78 total 90.09 last 67.63) - open/close 6949 (time 1788686923.78 total 100.10 last 74.48) - open/close 7692 (time 1788686933.78 total 110.10 last 74.30) - open/close 8459 (time 1788686943.79 total 120.11 last 76.61) - open/close 9201 (time 1788686953.79 total 130.11 last 74.20) - open/close 9923 (time 1788686963.80 total 140.12 last 72.11) total: 10000 open/close in 141.27 seconds: 70.79 ops/second - unlinked 0 (time 1788686969 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second - open/close 656 (time 1788687059.85 total 10.00 last 65.59) - open/close 1361 (time 1788687069.85 total 20.00 last 70.49) - open/close 2062 (time 1788687079.85 total 30.01 last 70.06) - open/close 2791 (time 1788687089.86 total 40.01 last 72.87) - open/close 3541 (time 1788687099.87 total 50.02 last 74.90) - open/close 4296 (time 1788687109.88 total 60.03 last 75.43) - open/close 5037 (time 1788687119.88 total 70.04 last 74.05) - open/close 5743 (time 1788687129.89 total 80.04 last 70.59) - open/close 6416 (time 1788687139.90 total 90.05 last 67.21) - open/close 7067 (time 1788687149.90 total 100.05 last 65.09) - open/close 7680 (time 1788687159.91 total 110.06 last 61.25) - open/close 8433 (time 1788687169.92 total 120.08 last 75.19) - open/close 9245 (time 1788687179.93 total 130.08 last 81.16) - open/close 9778 (time 1788687189.95 total 140.10 last 53.18) total: 10000 open/close in 143.86 seconds: 69.51 ops/second - unlinked 0 (time 1788687198 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second - open/close 751 (time 1788687289.31 total 10.00 last 75.07) - open/close 1328 (time 1788687299.34 total 20.04 last 57.49) - open/close 1983 (time 1788687309.35 total 30.05 last 65.45) - open/close 2697 (time 1788687319.36 total 40.06 last 71.32) - open/close 3460 (time 1788687329.36 total 50.06 last 76.29) - open/close 4212 (time 1788687339.37 total 60.07 last 75.12) - open/close 4938 (time 1788687349.38 total 70.08 last 72.58) - open/close 5695 (time 1788687359.39 total 80.09 last 75.62) - open/close 6429 (time 1788687369.39 total 90.09 last 73.36) - open/close 7222 (time 1788687379.41 total 100.11 last 79.16) - open/close 7983 (time 1788687389.42 total 110.12 last 76.05) - open/close 8703 (time 1788687399.42 total 120.12 last 72.00) - open/close 9481 (time 1788687409.43 total 130.13 last 77.75) total: 10000 open/close in 137.38 seconds: 72.79 ops/second - unlinked 0 (time 1788687421 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second - open/close 717 (time 1788687509.97 total 10.01 last 71.61) - open/close 1525 (time 1788687519.98 total 20.02 last 80.73) - open/close 2224 (time 1788687529.98 total 30.02 last 69.89) - open/close 2958 (time 1788687540.02 total 40.06 last 73.12) - open/close 3721 (time 1788687550.03 total 50.07 last 76.20) - open/close 4470 (time 1788687560.03 total 60.07 last 74.90) - open/close 5192 (time 1788687570.04 total 70.08 last 72.17) - open/close 5917 (time 1788687580.05 total 80.09 last 72.42) - open/close 6653 (time 1788687590.06 total 90.10 last 73.50) - open/close 7264 (time 1788687600.09 total 100.13 last 60.96) - open/close 7925 (time 1788687610.09 total 110.13 last 66.05) - open/close 8689 (time 1788687620.10 total 120.14 last 76.32) - open/close 9445 (time 1788687630.11 total 130.15 last 75.59) total: 10000 open/close in 137.84 seconds: 72.55 ops/second - unlinked 0 (time 1788687642 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second - open/close 749 (time 1788687733.00 total 10.00 last 74.90) - open/close 1412 (time 1788687743.01 total 20.01 last 66.24) - open/close 2175 (time 1788687753.01 total 30.01 last 76.30) - open/close 2910 (time 1788687763.03 total 40.03 last 73.37) - open/close 3565 (time 1788687773.03 total 50.04 last 65.45) - open/close 4221 (time 1788687783.05 total 60.05 last 65.51) - open/close 4925 (time 1788687793.05 total 70.05 last 70.38) - open/close 5661 (time 1788687803.06 total 80.06 last 73.53) - open/close 6359 (time 1788687813.07 total 90.07 last 69.74) - open/close 7126 (time 1788687823.07 total 100.07 last 76.67) - open/close 7683 (time 1788687833.08 total 110.08 last 55.65) - open/close 8316 (time 1788687843.09 total 120.09 last 63.24) - open/close 9075 (time 1788687853.10 total 130.10 last 75.85) - open/close 9776 (time 1788687863.11 total 140.11 last 70.01) total: 10000 open/close in 143.04 seconds: 69.91 ops/second - unlinked 0 (time 1788687869 ; total 0 ; last 0) total: 10000 unlinks in 73 seconds: 136.986298 unlinks/second - open/close 793 (time 1788687957.10 total 10.00 last 79.27) - open/close 1532 (time 1788687967.12 total 20.01 last 73.82) - open/close 2345 (time 1788687977.14 total 30.04 last 81.09) - open/close 3085 (time 1788687987.14 total 40.04 last 73.99) - open/close 3907 (time 1788687997.14 total 50.04 last 82.19) - open/close 4697 (time 1788688007.14 total 60.04 last 78.99) - open/close 5496 (time 1788688017.16 total 70.06 last 79.80) - open/close 6266 (time 1788688027.16 total 80.06 last 76.99) - open/close 7065 (time 1788688037.16 total 90.06 last 79.89) - open/close 7817 (time 1788688047.17 total 100.06 last 75.15) - open/close 8561 (time 1788688057.17 total 110.07 last 74.37) - open/close 9374 (time 1788688067.18 total 120.08 last 81.21) total: 10000 open/close in 127.76 seconds: 78.27 ops/second - unlinked 0 (time 1788688078 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second - open/close 738 (time 1788688167.76 total 10.01 last 73.76) - open/close 1491 (time 1788688177.77 total 20.01 last 75.24) - open/close 2297 (time 1788688187.77 total 30.02 last 80.59) - open/close 3067 (time 1788688197.77 total 40.02 last 76.99) - open/close 3871 (time 1788688207.78 total 50.02 last 80.37) - open/close 4584 (time 1788688217.79 total 60.03 last 71.23) - open/close 5394 (time 1788688227.79 total 70.03 last 80.99) - open/close 6103 (time 1788688237.80 total 80.04 last 70.84) - open/close 6724 (time 1788688247.80 total 90.04 last 62.08) - open/close 7413 (time 1788688257.80 total 100.04 last 68.90) - open/close 8140 (time 1788688267.81 total 110.05 last 72.66) - open/close 8922 (time 1788688277.81 total 120.05 last 78.19) - open/close 9658 (time 1788688287.81 total 130.05 last 73.59) total: 10000 open/close in 134.08 seconds: 74.58 ops/second - unlinked 0 (time 1788688295 ; total 0 ; last 0) total: 10000 unlinks in 73 seconds: 136.986298 unlinks/second - open/close 749 (time 1788688383.79 total 10.03 last 74.67) - open/close 1584 (time 1788688393.80 total 20.04 last 83.46) - open/close 2343 (time 1788688403.83 total 30.06 last 75.68) - open/close 3159 (time 1788688413.84 total 40.07 last 81.54) - open/close 3930 (time 1788688423.84 total 50.08 last 77.03) - open/close 4739 (time 1788688433.85 total 60.09 last 80.86) - open/close 5472 (time 1788688443.85 total 70.09 last 73.28) - open/close 6264 (time 1788688453.85 total 80.09 last 79.17) - open/close 7059 (time 1788688463.86 total 90.09 last 79.49) - open/close 7862 (time 1788688473.86 total 100.10 last 80.24) - open/close 8624 (time 1788688483.87 total 110.10 last 76.18) - open/close 9393 (time 1788688493.88 total 120.11 last 76.82) total: 10000 open/close in 127.87 seconds: 78.20 ops/second - unlinked 0 (time 1788688505 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second - open/close 767 (time 1788688595.61 total 10.03 last 76.48) - open/close 1496 (time 1788688605.61 total 20.03 last 72.86) - open/close 2327 (time 1788688615.61 total 30.03 last 83.09) - open/close 3067 (time 1788688625.62 total 40.04 last 73.94) - open/close 3745 (time 1788688635.62 total 50.05 last 67.78) - open/close 4463 (time 1788688645.63 total 60.05 last 71.79) - open/close 5097 (time 1788688655.63 total 70.05 last 63.40) - open/close 5819 (time 1788688665.63 total 80.05 last 72.19) - open/close 6556 (time 1788688675.64 total 90.06 last 73.60) - open/close 7249 (time 1788688685.64 total 100.06 last 69.29) - open/close 7831 (time 1788688695.66 total 110.08 last 58.10) - open/close 8589 (time 1788688705.66 total 120.08 last 75.79) - open/close 9410 (time 1788688715.67 total 130.09 last 82.04) total: 10000 open/close in 137.82 seconds: 72.56 ops/second - unlinked 0 (time 1788688727 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg324-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg324-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg324-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.124@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg324-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-OST0000 oleg324-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg324-server: oleg324-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg324-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg324-server: oleg324-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg324-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg324-client.virtnet: -o user_xattr,flock 192.168.203.124@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg324-client: oleg324-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg324-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg324-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg324-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.124@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.124@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.124@tcp sys.timeout=20 start ost1 service on oleg324-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Started lustre-OST0000 oleg324-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg324-server: oleg324-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg324-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg324-server: oleg324-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg324-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg324-client.virtnet: -o user_xattr,flock 192.168.203.124@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg324-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg324-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg324-server unloading modules via unload_modules_local on: 'oleg324-server' oleg324-server: oleg324-server.virtnet: executing unload_modules_local oleg324-server: kmemleak disabled modules unloaded. pdsh@oleg324-client: oleg324-client: ssh exited with exit code 2 pdsh@oleg324-client: oleg324-server: ssh exited with exit code 2 pdsh@oleg324-client: oleg324-server: ssh exited with exit code 2 pdsh@oleg324-client: oleg324-client: ssh exited with exit code 2 PASS 69 (2454s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 06:02:39 (1788688959) oleg324-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg324-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg324-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg324-client: oleg324-server: ssh exited with exit code 2 oleg324-server: oleg324-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x. 1 green green 1921056 Sep 5 18:57 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg324-server' oleg324-server: oleg324-server.virtnet: executing load_modules_local oleg324-server: kmemleak disabled oleg324-server: Loading modules from /home/green/git/lustre-release/lustre oleg324-server: detected 4 online CPUs by sysfs oleg324-server: MODOPTS_LIBCFS= oleg324-server: Force libcfs to create 2 CPU partitions oleg324-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg324-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg324-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg324-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg324-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg324-client.virtnet /mnt/lustre2 (opts:-f) oleg324-server: oleg324-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg324-server' oleg324-server: oleg324-server.virtnet: executing load_modules_local oleg324-server: kmemleak disabled oleg324-server: Loading modules from /home/green/git/lustre-release/lustre oleg324-server: detected 4 online CPUs by sysfs oleg324-server: MODOPTS_LIBCFS= oleg324-server: Force libcfs to create 2 CPU partitions oleg324-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg324-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg324-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg324-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg324-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg324-server: oleg324-server.virtnet: executing set_default_debug -1 all pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg324-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg324-server: oleg324-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg324-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg324-server: oleg324-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg324-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg324-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg324-server stop mds service on oleg324-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg324-server SKIP 111 (228s) Stopping clients: oleg324-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg324-client.virtnet /mnt/lustre2 (opts:-f) oleg324-server: oleg324-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg324-server' oleg324-server: oleg324-server.virtnet: executing load_modules_local oleg324-server: kmemleak disabled oleg324-server: Loading modules from /home/green/git/lustre-release/lustre oleg324-server: detected 4 online CPUs by sysfs oleg324-server: MODOPTS_LIBCFS= oleg324-server: Force libcfs to create 2 CPU partitions oleg324-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3179 sec ========== 06:07:25 (1788689245) === conf-sanity: start cleanup 06:07:27 (1788689247) === === conf-sanity: finish cleanup 06:07:30 (1788689250) ===