-----============= acceptance-small: conf-sanity ============----- Thu Aug 22 01:27:51 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 32newtarball 110 Stopping clients: oleg131-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg131-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg131-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg131-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg131-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg131-server oleg131-server: oleg131-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory loading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing load_modules_local oleg131-server: Loading modules from /home/green/git/lustre-release/lustre oleg131-server: detected 4 online CPUs by sysfs oleg131-server: Force libcfs to create 2 CPU partitions oleg131-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg131-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg131-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg131-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg131-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg131-server: oleg131-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg131-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg131-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg131-server stop mds service on oleg131-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg131-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 01:28:48 (1724304528) Stopping clients: oleg131-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg131-client.virtnet /mnt/lustre2 (opts:-f) oleg131-server: oleg131-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing load_modules_local oleg131-server: Loading modules from /home/green/git/lustre-release/lustre oleg131-server: detected 4 online CPUs by sysfs oleg131-server: Force libcfs to create 2 CPU partitions oleg131-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg131-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg131-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg131-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg131-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg131-client.virtnet: -o user_xattr,flock 192.168.201.131@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16134 326 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16137 329 15808 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 5455 (time 1724304561.84 total 10.00 last 545.41) - open/close 10000 (time 1724304570.17 total 18.34 last 545.11) - open/close 14974 (time 1724304580.17 total 28.34 last 497.36) - open/close 20000 (time 1724304589.31 total 37.48 last 550.14) - open/close 24833 (time 1724304599.31 total 47.48 last 483.13) - open/close 29441 (time 1724304609.31 total 57.48 last 460.80) - open/close 34367 (time 1724304619.32 total 67.48 last 492.55) - open/close 39646 (time 1724304629.32 total 77.48 last 527.86) - open/close 44563 (time 1724304639.32 total 87.48 last 491.69) - open/close 49985 (time 1724304649.32 total 97.48 last 542.14) - open/close 55763 (time 1724304659.32 total 107.48 last 577.75) - open/close 60000 (time 1724304667.27 total 115.43 last 533.09) total: 64768 open/close in 124.88 seconds: 518.64 ops/second - /unlink 7691 (time 1724304687.62 total 10.00 last 769.03) - /unlink 10000 (time 1724304690.81 total 13.19 last 723.54) - /unlink 18023 (time 1724304700.82 total 23.19 last 802.26) - /unlink 20000 (time 1724304703.18 total 25.56 last 835.26) - /unlink 29365 (time 1724304713.18 total 35.56 last 936.33) - /unlink 38809 (time 1724304723.18 total 45.56 last 944.31) - /unlink 47801 (time 1724304733.19 total 55.56 last 899.16) - /unlink 50000 (time 1724304735.70 total 58.08 last 873.46) - /unlink 59057 (time 1724304745.70 total 68.08 last 905.66) total: 64768 /unlink in 74.22 seconds: 872.68 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 5517 (time 1724304785.14 total 10.00 last 551.62) - open/close 10000 (time 1724304793.60 total 18.45 last 530.35) - open/close 15429 (time 1724304803.64 total 28.50 last 540.61) - open/close 20000 (time 1724304812.07 total 36.93 last 542.12) - open/close 25393 (time 1724304822.07 total 46.93 last 539.28) - open/close 30000 (time 1724304830.82 total 55.67 last 526.79) - open/close 35099 (time 1724304840.82 total 65.68 last 509.84) - open/close 40000 (time 1724304850.13 total 74.99 last 526.07) - open/close 45903 (time 1724304860.14 total 84.99 last 590.20) - open/close 50000 (time 1724304868.56 total 93.42 last 486.38) - open/close 52116 (time 1724304878.56 total 103.42 last 211.55) - open/close 53699 (time 1724304888.56 total 113.42 last 158.28) - open/close 56572 (time 1724304898.57 total 123.42 last 287.20) - open/close 59270 (time 1724304908.57 total 133.43 last 269.73) - open/close 60000 (time 1724304910.84 total 135.70 last 321.43) - open/close 62474 (time 1724304920.84 total 145.70 last 247.32) - open/close 64433 (time 1724304930.84 total 155.70 last 195.88) total: 64768 open/close in 157.28 seconds: 411.81 ops/second - /unlink 6026 (time 1724304943.50 total 10.00 last 602.59) - /unlink 10000 (time 1724304949.23 total 15.73 last 693.80) - /unlink 16575 (time 1724304959.23 total 25.73 last 657.43) - /unlink 20000 (time 1724304964.46 total 30.96 last 655.12) - /unlink 26279 (time 1724304974.46 total 40.96 last 627.75) - /unlink 30000 (time 1724304981.77 total 48.27 last 508.99) - /unlink 36895 (time 1724304991.77 total 58.27 last 689.40) - /unlink 40000 (time 1724304996.82 total 63.32 last 615.28) - /unlink 45525 (time 1724305006.82 total 73.32 last 552.49) - /unlink 50000 (time 1724305015.73 total 82.23 last 502.40) - /unlink 55121 (time 1724305025.73 total 92.23 last 512.04) - /unlink 60000 (time 1724305035.28 total 101.78 last 510.72) - /unlink 63586 (time 1724305045.29 total 111.79 last 358.15) total: 64768 /unlink in 118.57 seconds: 546.23 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 1936 (time 1724305082.55 total 10.00 last 193.59) - open/close 3617 (time 1724305092.56 total 20.01 last 167.88) - open/close 5374 (time 1724305102.56 total 30.01 last 175.69) - open/close 7009 (time 1724305112.57 total 40.02 last 163.42) - open/close 8420 (time 1724305122.57 total 50.02 last 141.10) - open/close 10000 (time 1724305132.50 total 59.95 last 159.08) - open/close 11807 (time 1724305142.50 total 69.95 last 180.70) - open/close 13422 (time 1724305152.50 total 79.95 last 161.50) - open/close 15282 (time 1724305162.50 total 89.95 last 185.96) - open/close 16728 (time 1724305172.51 total 99.96 last 144.47) - open/close 18359 (time 1724305182.51 total 109.96 last 163.08) - open/close 19872 (time 1724305192.52 total 119.97 last 151.19) - open/close 21336 (time 1724305202.53 total 129.98 last 146.30) - open/close 22680 (time 1724305212.53 total 139.98 last 134.33) - open/close 24103 (time 1724305222.54 total 149.99 last 142.16) - open/close 25657 (time 1724305232.55 total 160.00 last 155.31) - open/close 27414 (time 1724305242.55 total 170.00 last 175.68) - open/close 29141 (time 1724305252.56 total 180.01 last 172.58) - open/close 30000 (time 1724305257.16 total 184.61 last 186.64) - open/close 31844 (time 1724305267.16 total 194.61 last 184.31) - open/close 33413 (time 1724305277.16 total 204.61 last 156.90) - open/close 34970 (time 1724305287.17 total 214.62 last 155.60) - open/close 36508 (time 1724305297.18 total 224.63 last 153.70) - open/close 37991 (time 1724305307.18 total 234.63 last 148.21) - open/close 39645 (time 1724305317.19 total 244.64 last 165.33) - open/close 40000 (time 1724305319.36 total 246.81 last 163.58) - open/close 41725 (time 1724305329.37 total 256.82 last 172.29) - open/close 43513 (time 1724305339.37 total 266.82 last 178.74) - open/close 45205 (time 1724305349.38 total 276.82 last 169.18) - open/close 47121 (time 1724305359.38 total 286.83 last 191.53) - open/close 48928 (time 1724305369.38 total 296.83 last 180.70) - open/close 49955 (time 1724305379.39 total 306.83 last 102.64) - open/close 50954 (time 1724305389.39 total 316.84 last 99.86) - open/close 52255 (time 1724305399.39 total 326.84 last 130.09) - open/close 53539 (time 1724305409.39 total 336.84 last 128.36) - open/close 54891 (time 1724305419.39 total 346.84 last 135.20) - open/close 56220 (time 1724305429.39 total 356.84 last 132.89) - open/close 57459 (time 1724305439.40 total 366.85 last 123.83) - open/close 58701 (time 1724305449.40 total 376.85 last 124.15) - open/close 59983 (time 1724305459.41 total 386.86 last 128.13) - open/close 61283 (time 1724305469.41 total 396.86 last 129.96) - open/close 62659 (time 1724305479.42 total 406.87 last 137.47) - open/close 64227 (time 1724305489.43 total 416.88 last 156.74) total: 64768 open/close in 420.32 seconds: 154.09 ops/second - /unlink 2643 (time 1724305504.80 total 10.00 last 264.26) - /unlink 5625 (time 1724305514.80 total 20.00 last 298.19) - /unlink 7932 (time 1724305524.81 total 30.00 last 230.64) - /unlink 10000 (time 1724305534.68 total 39.87 last 209.53) - /unlink 12091 (time 1724305544.68 total 49.88 last 209.04) - /unlink 14230 (time 1724305554.68 total 59.88 last 213.83) - /unlink 16535 (time 1724305564.69 total 69.89 last 230.36) - /unlink 18946 (time 1724305574.69 total 79.89 last 240.99) - /unlink 20000 (time 1724305578.88 total 84.08 last 251.90) - /unlink 22266 (time 1724305588.88 total 94.08 last 226.58) - /unlink 24453 (time 1724305598.88 total 104.08 last 218.66) - /unlink 26678 (time 1724305608.88 total 114.08 last 222.42) - /unlink 28758 (time 1724305618.88 total 124.08 last 207.99) - /unlink 30000 (time 1724305625.13 total 130.33 last 198.92) - /unlink 32128 (time 1724305635.13 total 140.33 last 212.71) - /unlink 34096 (time 1724305645.13 total 150.33 last 196.74) - /unlink 36088 (time 1724305655.14 total 160.33 last 199.16) - /unlink 38074 (time 1724305665.14 total 170.34 last 198.60) - /unlink 40000 (time 1724305673.53 total 178.73 last 229.39) - /unlink 42528 (time 1724305683.53 total 188.73 last 252.79) - /unlink 45074 (time 1724305693.53 total 198.73 last 254.60) - /unlink 48037 (time 1724305703.54 total 208.73 last 296.27) - /unlink 50000 (time 1724305710.47 total 215.67 last 283.08) - /unlink 52792 (time 1724305720.47 total 225.67 last 279.14) - /unlink 55502 (time 1724305730.47 total 235.67 last 270.99) - /unlink 58401 (time 1724305740.47 total 245.67 last 289.90) - /unlink 60000 (time 1724305746.55 total 251.75 last 263.07) - /unlink 62493 (time 1724305756.55 total 261.75 last 249.24) total: 64768 /unlink in 270.07 seconds: 239.82 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 1535 (time 1724305791.92 total 10.00 last 153.48) - open/close 3328 (time 1724305801.92 total 20.00 last 179.28) - open/close 5101 (time 1724305811.92 total 30.01 last 177.24) - open/close 6801 (time 1724305821.92 total 40.01 last 169.98) - open/close 8206 (time 1724305831.93 total 50.01 last 140.43) - open/close 9650 (time 1724305841.93 total 60.01 last 144.37) - open/close 10000 (time 1724305844.39 total 62.47 last 142.44) - open/close 11414 (time 1724305854.39 total 72.47 last 141.36) - open/close 12775 (time 1724305864.40 total 82.48 last 136.04) - open/close 14144 (time 1724305874.40 total 92.49 last 136.78) - open/close 15595 (time 1724305884.41 total 102.49 last 145.06) - open/close 16995 (time 1724305894.41 total 112.49 last 139.91) - open/close 18141 (time 1724305904.42 total 122.50 last 114.53) - open/close 19296 (time 1724305914.42 total 132.50 last 115.47) - open/close 20000 (time 1724305920.46 total 138.54 last 116.56) - open/close 21130 (time 1724305930.47 total 148.55 last 112.92) - open/close 22236 (time 1724305940.47 total 158.56 last 110.54) - open/close 23352 (time 1724305950.48 total 168.56 last 111.54) - open/close 24528 (time 1724305960.49 total 178.57 last 117.50) - open/close 25718 (time 1724305970.50 total 188.58 last 118.88) - open/close 26871 (time 1724305980.50 total 198.58 last 115.28) - open/close 28084 (time 1724305990.51 total 208.59 last 121.19) - open/close 29277 (time 1724306000.51 total 218.59 last 119.28) - open/close 30000 (time 1724306006.75 total 224.83 last 115.86) - open/close 31178 (time 1724306016.77 total 234.85 last 117.53) - open/close 32454 (time 1724306026.78 total 244.86 last 127.56) - open/close 34016 (time 1724306036.79 total 254.87 last 156.01) - open/close 35485 (time 1724306046.80 total 264.88 last 146.71) - open/close 37032 (time 1724306056.81 total 274.89 last 154.57) - open/close 38628 (time 1724306066.81 total 284.90 last 159.54) - open/close 40000 (time 1724306075.43 total 293.51 last 159.26) - open/close 41630 (time 1724306085.43 total 303.51 last 162.93) - open/close 43187 (time 1724306095.44 total 313.52 last 155.60) - open/close 44688 (time 1724306105.45 total 323.54 last 149.89) - open/close 46079 (time 1724306115.46 total 333.54 last 139.05) - open/close 47739 (time 1724306125.46 total 343.54 last 165.98) - open/close 49094 (time 1724306135.46 total 353.54 last 135.47) - open/close 50000 (time 1724306142.38 total 360.46 last 130.90) - open/close 51309 (time 1724306152.39 total 370.47 last 130.87) - open/close 52853 (time 1724306162.39 total 380.47 last 154.37) - open/close 54339 (time 1724306172.39 total 390.47 last 148.59) - open/close 55918 (time 1724306182.39 total 400.47 last 157.89) - open/close 57315 (time 1724306192.39 total 410.48 last 139.61) - open/close 58588 (time 1724306202.40 total 420.48 last 127.27) - open/close 59981 (time 1724306212.40 total 430.48 last 139.23) - open/close 61358 (time 1724306222.41 total 440.49 last 137.61) - open/close 62764 (time 1724306232.41 total 450.50 last 140.54) - open/close 64077 (time 1724306242.42 total 460.50 last 131.20) total: 64768 open/close in 465.37 seconds: 139.17 ops/second - /unlink 2524 (time 1724306258.99 total 10.00 last 252.34) - /unlink 4833 (time 1724306268.99 total 20.00 last 230.89) - /unlink 7306 (time 1724306279.00 total 30.01 last 247.19) - /unlink 9890 (time 1724306289.00 total 40.01 last 258.39) - /unlink 12477 (time 1724306299.00 total 50.01 last 258.62) - /unlink 15295 (time 1724306309.00 total 60.01 last 281.74) - /unlink 18581 (time 1724306319.00 total 70.01 last 328.56) - /unlink 20000 (time 1724306323.66 total 74.67 last 304.47) - /unlink 22947 (time 1724306333.67 total 84.68 last 294.62) - /unlink 25914 (time 1724306343.67 total 94.68 last 296.65) - /unlink 28826 (time 1724306353.67 total 104.68 last 291.16) - /unlink 30000 (time 1724306356.65 total 107.66 last 393.43) - /unlink 33270 (time 1724306366.66 total 117.67 last 326.87) - /unlink 36120 (time 1724306376.66 total 127.67 last 284.99) - /unlink 39092 (time 1724306386.66 total 137.67 last 297.18) - /unlink 40000 (time 1724306389.36 total 140.37 last 336.23) - /unlink 43076 (time 1724306399.36 total 150.37 last 307.54) - /unlink 46300 (time 1724306409.37 total 160.38 last 322.22) - /unlink 49564 (time 1724306419.37 total 170.38 last 326.33) - /unlink 52638 (time 1724306429.37 total 180.38 last 307.32) - /unlink 55500 (time 1724306439.37 total 190.38 last 286.19) - /unlink 58076 (time 1724306449.37 total 200.38 last 257.57) - /unlink 60000 (time 1724306456.06 total 207.07 last 287.68) - /unlink 62749 (time 1724306466.06 total 217.07 last 274.85) total: 64768 /unlink in 225.65 seconds: 287.03 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 1207 (time 1724306503.56 total 10.01 last 120.58) - open/close 2539 (time 1724306513.56 total 20.01 last 133.18) - open/close 4498 (time 1724306523.57 total 30.01 last 195.83) - open/close 7378 (time 1724306533.57 total 40.02 last 287.99) - open/close 9249 (time 1724306543.57 total 50.02 last 187.04) - open/close 10000 (time 1724306547.11 total 53.55 last 212.43) - open/close 12319 (time 1724306557.11 total 63.56 last 231.82) - open/close 15045 (time 1724306567.11 total 73.56 last 272.55) - open/close 17423 (time 1724306577.11 total 83.56 last 237.77) - open/close 19597 (time 1724306587.12 total 93.57 last 217.27) - open/close 20000 (time 1724306589.12 total 95.57 last 201.10) - open/close 22289 (time 1724306599.13 total 105.57 last 228.85) - open/close 24621 (time 1724306609.13 total 115.57 last 233.17) - open/close 26579 (time 1724306619.13 total 125.57 last 195.79) - open/close 28593 (time 1724306629.13 total 135.58 last 201.35) - open/close 30000 (time 1724306637.35 total 143.80 last 171.20) - open/close 31877 (time 1724306647.35 total 153.80 last 187.62) - open/close 33666 (time 1724306657.35 total 163.80 last 178.87) - open/close 35510 (time 1724306667.36 total 173.80 last 184.38) - open/close 37404 (time 1724306677.36 total 183.81 last 189.34) - open/close 39231 (time 1724306687.36 total 193.81 last 182.66) - open/close 40000 (time 1724306691.35 total 197.79 last 192.93) - open/close 41942 (time 1724306701.35 total 207.80 last 194.12) - open/close 43746 (time 1724306711.35 total 217.80 last 180.40) - open/close 45569 (time 1724306721.35 total 227.80 last 182.29) - open/close 47276 (time 1724306731.36 total 237.80 last 170.62) - open/close 48728 (time 1724306741.36 total 247.81 last 145.16) - open/close 50000 (time 1724306749.03 total 255.48 last 165.83) - open/close 51417 (time 1724306759.04 total 265.49 last 141.54) - open/close 52610 (time 1724306769.05 total 275.49 last 119.24) - open/close 54308 (time 1724306779.05 total 285.50 last 169.75) - open/close 55610 (time 1724306789.05 total 295.50 last 130.18) - open/close 57460 (time 1724306799.05 total 305.50 last 184.98) - open/close 59169 (time 1724306809.05 total 315.50 last 170.86) - open/close 60000 (time 1724306813.52 total 319.97 last 185.93) - open/close 61587 (time 1724306823.53 total 329.97 last 158.64) - open/close 63432 (time 1724306833.53 total 339.98 last 184.45) total: 64768 open/close in 347.37 seconds: 186.45 ops/second - /unlink 3069 (time 1724306852.21 total 10.00 last 306.87) - /unlink 7041 (time 1724306862.21 total 20.00 last 397.16) - /unlink 10000 (time 1724306871.14 total 28.94 last 331.23) - /unlink 12805 (time 1724306881.15 total 38.94 last 280.37) - /unlink 15994 (time 1724306891.15 total 48.94 last 318.84) - /unlink 19229 (time 1724306901.15 total 58.94 last 323.48) - /unlink 20000 (time 1724306903.31 total 61.10 last 357.95) - /unlink 23563 (time 1724306913.31 total 71.10 last 356.28) - /unlink 26969 (time 1724306923.31 total 81.10 last 340.50) - /unlink 30000 (time 1724306932.33 total 90.12 last 336.09) - /unlink 33422 (time 1724306942.33 total 100.12 last 342.05) - /unlink 36816 (time 1724306952.34 total 110.13 last 339.27) - /unlink 40000 (time 1724306962.12 total 119.91 last 325.36) - /unlink 43430 (time 1724306972.12 total 129.91 last 342.92) - /unlink 46763 (time 1724306982.13 total 139.92 last 333.27) - /unlink 50000 (time 1724306992.06 total 149.85 last 325.79) - /unlink 53118 (time 1724307002.06 total 159.85 last 311.73) - /unlink 55889 (time 1724307012.07 total 169.86 last 276.92) - /unlink 58815 (time 1724307022.07 total 179.86 last 292.56) - /unlink 60000 (time 1724307025.17 total 182.96 last 382.20) - /unlink 63363 (time 1724307035.17 total 192.96 last 336.21) total: 64768 /unlink in 196.19 seconds: 330.12 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg131-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg131-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg131-server stop mds service on oleg131-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg131-server unloading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg131-client: oleg131-client: ssh exited with exit code 2 pdsh@oleg131-client: oleg131-server: ssh exited with exit code 2 pdsh@oleg131-client: oleg131-client: ssh exited with exit code 2 pdsh@oleg131-client: oleg131-server: ssh exited with exit code 2 PASS 106 (2544s) Stopping clients: oleg131-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg131-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg131-client: oleg131-server: ssh exited with exit code 2 oleg131-server: oleg131-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing load_modules_local oleg131-server: Loading modules from /home/green/git/lustre-release/lustre oleg131-server: detected 4 online CPUs by sysfs oleg131-server: Force libcfs to create 2 CPU partitions oleg131-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg131-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 2625 sec ========== 02:11:36 (1724307096) === conf-sanity: start cleanup 02:11:37 (1724307097) === === conf-sanity: finish cleanup 02:11:37 (1724307097) ===