-----============= acceptance-small: conf-sanity ============----- Wed Jul 29 04:58:18 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg436-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682881 > 34553653) for LU-16938, go 81 excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg436-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg436-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg436-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg436-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg436-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg436-server oleg436-server: oleg436-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg436-server' oleg436-server: oleg436-server.virtnet: executing load_modules_local oleg436-server: Loading modules from /home/green/git/lustre-release/lustre oleg436-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg436-server: detected 4 online CPUs by sysfs oleg436-server: MODOPTS_LIBCFS= oleg436-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg436-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg436-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg436-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg436-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg436-server: oleg436-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg436-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg436-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg436-server stop mds service on oleg436-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg436-server == conf-sanity test 45: long unlink handling in ptlrpcd == 05:02:34 (1785315754) start mds service on oleg436-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg436-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg436-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Started lustre-OST0000 oleg436-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg436-client.virtnet: -o user_xattr,flock 192.168.204.136@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg436-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg436-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg436-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg436-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg436-client.virtnet: -o user_xattr,flock 192.168.204.136@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg436-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg436-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg436-server stop mds service on oleg436-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg436-server unloading modules via unload_modules_local on: 'oleg436-server' oleg436-server: oleg436-server.virtnet: executing unload_modules_local oleg436-server: modules unloaded. pdsh@oleg436-client: oleg436-client: ssh exited with exit code 2 pdsh@oleg436-client: oleg436-server: ssh exited with exit code 2 pdsh@oleg436-client: oleg436-server: ssh exited with exit code 2 pdsh@oleg436-client: oleg436-client: ssh exited with exit code 2 PASS 45 (250s) == conf-sanity test 69: replace an OST with the same index ========================================================== 05:06:45 (1785316005) start mds service on oleg436-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg436-server' oleg436-server: oleg436-server.virtnet: executing load_modules_local oleg436-server: Loading modules from /home/green/git/lustre-release/lustre oleg436-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg436-server: detected 4 online CPUs by sysfs oleg436-server: MODOPTS_LIBCFS= oleg436-server: Force libcfs to create 2 CPU partitions oleg436-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg436-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg436-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg436-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg436-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Started lustre-OST0000 oleg436-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg436-client.virtnet: -o user_xattr,flock 192.168.204.136@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11904 inodes available. Want 99872. rc=0 - open/close 479 (time 1785316126.21 total 10.00 last 47.89) - open/close 1063 (time 1785316136.22 total 20.01 last 58.37) - open/close 1486 (time 1785316146.23 total 30.02 last 42.26) - open/close 1947 (time 1785316156.23 total 40.03 last 46.07) - open/close 2412 (time 1785316166.25 total 50.04 last 46.43) - open/close 2826 (time 1785316176.25 total 60.04 last 41.40) - open/close 3304 (time 1785316186.25 total 70.04 last 47.77) - open/close 3835 (time 1785316196.26 total 80.05 last 53.05) - open/close 4350 (time 1785316206.27 total 90.06 last 51.47) - open/close 4656 (time 1785316216.27 total 100.07 last 30.58) - open/close 5032 (time 1785316226.28 total 110.07 last 37.58) - open/close 5645 (time 1785316236.29 total 120.08 last 61.24) - open/close 6053 (time 1785316246.30 total 130.09 last 40.76) - open/close 6519 (time 1785316256.32 total 140.11 last 46.50) - open/close 6967 (time 1785316266.38 total 150.17 last 44.54) - open/close 7600 (time 1785316276.40 total 160.19 last 63.17) - open/close 8106 (time 1785316286.41 total 170.20 last 50.54) - open/close 8712 (time 1785316296.42 total 180.21 last 60.54) - open/close 9150 (time 1785316306.43 total 190.22 last 43.77) - open/close 9663 (time 1785316316.45 total 200.25 last 51.17) total: 10000 open/close in 205.98 seconds: 48.55 ops/second - unlinked 0 (time 1785316327 ; total 0 ; last 0) total: 10000 unlinks in 122 seconds: 81.967216 unlinks/second - open/close 467 (time 1785316465.41 total 10.02 last 46.60) - open/close 806 (time 1785316475.46 total 20.07 last 33.75) - open/close 1146 (time 1785316485.46 total 30.07 last 33.99) - open/close 1611 (time 1785316495.47 total 40.07 last 46.48) - open/close 1999 (time 1785316505.47 total 50.08 last 38.77) - open/close 2292 (time 1785316515.51 total 60.12 last 29.19) - open/close 2597 (time 1785316525.51 total 70.12 last 30.49) - open/close 3060 (time 1785316535.52 total 80.13 last 46.27) - open/close 3665 (time 1785316545.53 total 90.14 last 60.45) - open/close 4089 (time 1785316555.54 total 100.14 last 42.36) - open/close 4683 (time 1785316565.54 total 110.15 last 59.38) - open/close 5111 (time 1785316575.55 total 120.15 last 42.77) - open/close 5480 (time 1785316585.55 total 130.16 last 36.88) - open/close 6012 (time 1785316595.58 total 140.18 last 53.08) - open/close 6630 (time 1785316605.59 total 150.20 last 61.71) - open/close 7061 (time 1785316615.62 total 160.23 last 42.98) - open/close 7432 (time 1785316625.63 total 170.24 last 37.06) - open/close 7890 (time 1785316635.65 total 180.26 last 45.71) - open/close 8233 (time 1785316645.65 total 190.26 last 34.30) - open/close 8722 (time 1785316655.67 total 200.27 last 48.84) - open/close 9169 (time 1785316665.68 total 210.28 last 44.65) - open/close 9621 (time 1785316675.70 total 220.31 last 45.09) total: 10000 open/close in 228.65 seconds: 43.74 ops/second - unlinked 0 (time 1785316690 ; total 0 ; last 0) total: 10000 unlinks in 121 seconds: 82.644630 unlinks/second - open/close 565 (time 1785316827.78 total 10.02 last 56.41) - open/close 1045 (time 1785316837.81 total 20.04 last 47.88) - open/close 1489 (time 1785316847.81 total 30.04 last 44.39) - open/close 1904 (time 1785316857.84 total 40.07 last 41.38) - open/close 2311 (time 1785316867.84 total 50.08 last 40.69) - open/close 2703 (time 1785316877.85 total 60.09 last 39.16) - open/close 3192 (time 1785316887.86 total 70.10 last 48.86) - open/close 3738 (time 1785316897.87 total 80.11 last 54.53) - open/close 4336 (time 1785316907.88 total 90.12 last 59.74) - open/close 4762 (time 1785316917.90 total 100.14 last 42.52) - open/close 5147 (time 1785316927.91 total 110.14 last 38.49) - open/close 5631 (time 1785316937.95 total 120.18 last 48.19) - open/close 6093 (time 1785316947.97 total 130.21 last 46.09) - open/close 6639 (time 1785316957.99 total 140.22 last 54.52) - open/close 7160 (time 1785316968.00 total 150.23 last 52.05) - open/close 7664 (time 1785316978.00 total 160.23 last 50.39) - open/close 8146 (time 1785316988.00 total 170.24 last 48.18) - open/close 8796 (time 1785316998.01 total 180.25 last 64.93) - open/close 9350 (time 1785317008.03 total 190.27 last 55.29) - open/close 9852 (time 1785317018.03 total 200.27 last 50.20) total: 10000 open/close in 203.19 seconds: 49.21 ops/second - unlinked 0 (time 1785317028 ; total 0 ; last 0) total: 10000 unlinks in 132 seconds: 75.757576 unlinks/second - open/close 620 (time 1785317175.52 total 10.03 last 61.79) - open/close 1022 (time 1785317185.53 total 20.05 last 40.14) - open/close 1440 (time 1785317195.55 total 30.07 last 41.73) - open/close 2022 (time 1785317205.56 total 40.07 last 58.15) - open/close 2468 (time 1785317215.57 total 50.08 last 44.57) - open/close 2920 (time 1785317225.58 total 60.10 last 45.13) - open/close 3376 (time 1785317235.60 total 70.12 last 45.50) - open/close 3865 (time 1785317245.61 total 80.13 last 48.87) - open/close 4235 (time 1785317255.61 total 90.13 last 36.99) - open/close 4647 (time 1785317265.64 total 100.15 last 41.10) - open/close 5065 (time 1785317275.65 total 110.17 last 41.74) - open/close 5361 (time 1785317285.68 total 120.20 last 29.51) - open/close 5766 (time 1785317295.70 total 130.21 last 40.43) - open/close 6198 (time 1785317305.70 total 140.22 last 43.19) - open/close 6657 (time 1785317315.71 total 150.22 last 45.87) - open/close 7210 (time 1785317325.72 total 160.24 last 55.22) - open/close 7913 (time 1785317335.73 total 170.24 last 70.27) - open/close 8487 (time 1785317345.73 total 180.24 last 57.38) - open/close 9096 (time 1785317355.73 total 190.25 last 60.86) - open/close 9726 (time 1785317365.74 total 200.26 last 62.95) total: 10000 open/close in 206.07 seconds: 48.53 ops/second - unlinked 0 (time 1785317376 ; total 0 ; last 0) total: 10000 unlinks in 129 seconds: 77.519379 unlinks/second - open/close 428 (time 1785317521.11 total 10.00 last 42.79) - open/close 972 (time 1785317531.13 total 20.01 last 54.33) - open/close 1546 (time 1785317541.13 total 30.02 last 57.37) - open/close 1994 (time 1785317551.15 total 40.04 last 44.71) - open/close 2413 (time 1785317561.16 total 50.05 last 41.86) - open/close 2889 (time 1785317571.18 total 60.07 last 47.49) - open/close 3453 (time 1785317581.19 total 70.08 last 56.36) - open/close 4184 (time 1785317591.20 total 80.09 last 73.04) - open/close 4548 (time 1785317601.20 total 90.09 last 36.39) - open/close 5036 (time 1785317611.21 total 100.10 last 48.74) - open/close 5501 (time 1785317621.22 total 110.10 last 46.49) - open/close 6139 (time 1785317631.22 total 120.10 last 63.80) - open/close 6766 (time 1785317641.22 total 130.11 last 62.67) - open/close 7154 (time 1785317651.23 total 140.12 last 38.77) - open/close 7796 (time 1785317661.24 total 150.13 last 64.14) - open/close 8441 (time 1785317671.25 total 160.14 last 64.42) - open/close 9125 (time 1785317681.27 total 170.16 last 68.28) - open/close 9844 (time 1785317691.28 total 180.17 last 71.83) total: 10000 open/close in 182.51 seconds: 54.79 ops/second - unlinked 0 (time 1785317698 ; total 0 ; last 0) total: 10000 unlinks in 113 seconds: 88.495575 unlinks/second - open/close 462 (time 1785317828.01 total 10.02 last 46.13) - open/close 889 (time 1785317838.03 total 20.03 last 42.64) - open/close 1269 (time 1785317848.03 total 30.03 last 37.98) - open/close 1670 (time 1785317858.04 total 40.04 last 40.07) - open/close 2142 (time 1785317868.05 total 50.05 last 47.17) - open/close 2642 (time 1785317878.08 total 60.08 last 49.85) - open/close 3212 (time 1785317888.10 total 70.10 last 56.88) - open/close 3752 (time 1785317898.10 total 80.10 last 53.99) - open/close 4139 (time 1785317908.15 total 90.16 last 38.48) - open/close 4581 (time 1785317918.17 total 100.17 last 44.15) - open/close 5105 (time 1785317928.17 total 110.17 last 52.38) - open/close 5519 (time 1785317938.18 total 120.19 last 41.34) - open/close 6053 (time 1785317948.19 total 130.20 last 53.35) - open/close 6410 (time 1785317958.21 total 140.22 last 35.64) - open/close 6801 (time 1785317968.23 total 150.23 last 39.03) - open/close 7298 (time 1785317978.23 total 160.24 last 49.69) - open/close 8018 (time 1785317988.25 total 170.25 last 71.91) - open/close 8583 (time 1785317998.25 total 180.26 last 56.45) - open/close 9166 (time 1785318008.28 total 190.28 last 58.14) - open/close 9602 (time 1785318018.30 total 200.30 last 43.52) - open/close 9996 (time 1785318028.30 total 210.30 last 39.40) total: 10000 open/close in 210.45 seconds: 47.52 ops/second - unlinked 0 (time 1785318034 ; total 0 ; last 0) total: 10000 unlinks in 125 seconds: 80.000000 unlinks/second - open/close 452 (time 1785318176.40 total 10.01 last 45.15) - open/close 849 (time 1785318186.41 total 20.03 last 39.63) - open/close 1369 (time 1785318196.42 total 30.03 last 51.99) - open/close 1822 (time 1785318206.42 total 40.04 last 45.27) - open/close 2292 (time 1785318216.43 total 50.05 last 46.96) - open/close 2777 (time 1785318226.43 total 60.05 last 48.48) - open/close 3204 (time 1785318236.44 total 70.06 last 42.67) - open/close 3676 (time 1785318246.48 total 80.10 last 47.02) - open/close 4192 (time 1785318256.48 total 90.10 last 51.58) - open/close 4789 (time 1785318266.49 total 100.11 last 59.66) - open/close 5337 (time 1785318276.49 total 110.11 last 54.79) - open/close 5750 (time 1785318286.53 total 120.14 last 41.16) - open/close 6162 (time 1785318296.55 total 130.17 last 41.10) - open/close 6683 (time 1785318306.58 total 140.19 last 51.97) - open/close 7101 (time 1785318316.58 total 150.19 last 41.79) - open/close 7495 (time 1785318326.60 total 160.22 last 39.30) - open/close 7994 (time 1785318336.62 total 170.24 last 49.80) - open/close 8633 (time 1785318346.63 total 180.25 last 63.85) - open/close 9114 (time 1785318356.64 total 190.26 last 48.04) - open/close 9553 (time 1785318366.67 total 200.28 last 43.80) total: 10000 open/close in 209.85 seconds: 47.65 ops/second - unlinked 0 (time 1785318381 ; total 0 ; last 0) total: 10000 unlinks in 119 seconds: 84.033615 unlinks/second - open/close 738 (time 1785318516.16 total 10.02 last 73.67) - open/close 1274 (time 1785318526.17 total 20.03 last 53.54) - open/close 1799 (time 1785318536.18 total 30.04 last 52.46) - open/close 2556 (time 1785318546.18 total 40.04 last 75.69) - open/close 3030 (time 1785318556.19 total 50.04 last 47.37) - open/close 3602 (time 1785318566.20 total 60.06 last 57.11) - open/close 4153 (time 1785318576.25 total 70.10 last 54.86) - open/close 4696 (time 1785318586.25 total 80.11 last 54.27) - open/close 5182 (time 1785318596.27 total 90.12 last 48.54) - open/close 5685 (time 1785318606.28 total 100.14 last 50.22) - open/close 6158 (time 1785318616.28 total 110.14 last 47.30) - open/close 6583 (time 1785318626.30 total 120.16 last 42.41) - open/close 6895 (time 1785318636.32 total 130.17 last 31.16) - open/close 7306 (time 1785318646.32 total 140.18 last 41.09) - open/close 7696 (time 1785318656.33 total 150.18 last 38.98) - open/close 8230 (time 1785318666.38 total 160.24 last 53.11) - open/close 8637 (time 1785318676.38 total 170.24 last 40.69) - open/close 9007 (time 1785318686.40 total 180.25 last 36.95) - open/close 9439 (time 1785318696.41 total 190.27 last 43.15) - open/close 9924 (time 1785318706.41 total 200.27 last 48.49) total: 10000 open/close in 201.77 seconds: 49.56 ops/second - unlinked 0 (time 1785318715 ; total 0 ; last 0) total: 10000 unlinks in 110 seconds: 90.909088 unlinks/second - open/close 433 (time 1785318842.72 total 10.02 last 43.22) - open/close 868 (time 1785318852.72 total 20.02 last 43.48) - open/close 1360 (time 1785318862.75 total 30.05 last 49.07) - open/close 1760 (time 1785318872.75 total 40.05 last 40.00) - open/close 2355 (time 1785318882.77 total 50.07 last 59.39) - open/close 2858 (time 1785318892.78 total 60.08 last 50.25) - open/close 3324 (time 1785318902.79 total 70.09 last 46.55) - open/close 3764 (time 1785318912.84 total 80.14 last 43.78) - open/close 4187 (time 1785318922.87 total 90.17 last 42.16) - open/close 4513 (time 1785318932.88 total 100.18 last 32.57) - open/close 4854 (time 1785318942.89 total 110.19 last 34.08) - open/close 5300 (time 1785318952.89 total 120.19 last 44.58) - open/close 5760 (time 1785318962.91 total 130.21 last 45.91) - open/close 6322 (time 1785318972.93 total 140.23 last 56.11) - open/close 7089 (time 1785318982.93 total 150.24 last 76.65) - open/close 7674 (time 1785318992.94 total 160.24 last 58.48) - open/close 8174 (time 1785319002.94 total 170.24 last 49.99) - open/close 8876 (time 1785319012.94 total 180.25 last 70.17) - open/close 9287 (time 1785319022.97 total 190.27 last 40.99) - open/close 9888 (time 1785319033.01 total 200.31 last 59.88) total: 10000 open/close in 203.61 seconds: 49.11 ops/second - unlinked 0 (time 1785319042 ; total 0 ; last 0) total: 10000 unlinks in 125 seconds: 80.000000 unlinks/second - open/close 500 (time 1785319185.80 total 10.01 last 49.97) - open/close 956 (time 1785319195.81 total 20.01 last 45.58) - open/close 1406 (time 1785319205.81 total 30.01 last 44.99) - open/close 1948 (time 1785319215.81 total 40.02 last 54.18) - open/close 2400 (time 1785319225.82 total 50.02 last 45.19) - open/close 3040 (time 1785319235.82 total 60.02 last 63.96) - open/close 3467 (time 1785319245.84 total 70.04 last 42.63) - open/close 4137 (time 1785319255.84 total 80.04 last 66.99) - open/close 4657 (time 1785319265.85 total 90.05 last 51.95) - open/close 5213 (time 1785319275.85 total 100.05 last 55.59) - open/close 5743 (time 1785319285.88 total 110.09 last 52.82) - open/close 6431 (time 1785319295.89 total 120.09 last 68.77) - open/close 7095 (time 1785319305.92 total 130.12 last 66.20) - open/close 7587 (time 1785319315.92 total 140.13 last 49.17) - open/close 7998 (time 1785319325.93 total 150.13 last 41.09) - open/close 8359 (time 1785319335.95 total 160.15 last 36.02) - open/close 8767 (time 1785319345.95 total 170.15 last 40.79) - open/close 9347 (time 1785319355.96 total 180.17 last 57.93) - open/close 9731 (time 1785319366.00 total 190.20 last 38.25) total: 10000 open/close in 197.02 seconds: 50.76 ops/second - unlinked 0 (time 1785319378 ; total 0 ; last 0) total: 10000 unlinks in 112 seconds: 89.285713 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg436-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg436-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg436-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.136@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.136@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg436-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Started lustre-OST0000 oleg436-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg436-server: oleg436-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg436-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg436-client.virtnet: -o user_xattr,flock 192.168.204.136@tcp:/lustre /mnt/lustre On OST0, 18950 used inodes rc=0 pdsh@oleg436-client: oleg436-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg436-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg436-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg436-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.136@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.136@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.136@tcp autodegrade=on sys.timeout=20 Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.136@tcp autodegrade=on sys.timeout=20 autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.136@tcp lustre:autodegrade=on lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg436-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg436-server: oleg436-server.virtnet: executing set_default_debug -1 all pdsh@oleg436-client: oleg436-server: ssh exited with exit code 1 Started lustre-OST0000 oleg436-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg436-server: oleg436-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg436-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg436-client.virtnet: -o user_xattr,flock 192.168.204.136@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg436-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg436-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg436-server stop mds service on oleg436-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg436-server unloading modules via unload_modules_local on: 'oleg436-server' oleg436-server: oleg436-server.virtnet: executing unload_modules_local oleg436-server: modules unloaded. pdsh@oleg436-client: oleg436-client: ssh exited with exit code 2 pdsh@oleg436-client: oleg436-server: ssh exited with exit code 2 pdsh@oleg436-client: oleg436-client: ssh exited with exit code 2 pdsh@oleg436-client: oleg436-server: ssh exited with exit code 2 PASS 69 (3717s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 06:08:43 (1785319723) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (4s) Stopping clients: oleg436-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg436-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg436-client: oleg436-server: ssh exited with exit code 2 oleg436-server: oleg436-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg436-server' oleg436-server: oleg436-server.virtnet: executing load_modules_local oleg436-server: Loading modules from /home/green/git/lustre-release/lustre oleg436-server: detected 4 online CPUs by sysfs oleg436-server: MODOPTS_LIBCFS= oleg436-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg436-server: Force libcfs to create 2 CPU partitions oleg436-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg436-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg436-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 4324 sec ========== 06:10:25 (1785319825) === conf-sanity: start cleanup 06:10:29 (1785319829) === === conf-sanity: finish cleanup 06:10:34 (1785319834) ===