-----============= acceptance-small: conf-sanity ============----- Thu Jun 18 17:18:25 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg240-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682408 > 34553653) for LU-16938, go 81 excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg240-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg240-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg240-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg240-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg240-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg240-server oleg240-server: oleg240-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg240-server' oleg240-server: oleg240-server.virtnet: executing load_modules_local oleg240-server: Loading modules from /home/green/git/lustre-release/lustre oleg240-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg240-server: detected 4 online CPUs by sysfs oleg240-server: MODOPTS_LIBCFS= oleg240-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg240-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg240-server: oleg240-server.virtnet: executing set_default_debug -1 all pdsh@oleg240-client: oleg240-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg240-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg240-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg240-server: oleg240-server.virtnet: executing set_default_debug -1 all pdsh@oleg240-client: oleg240-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg240-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg240-server: oleg240-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg240-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg240-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg240-server stop mds service on oleg240-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg240-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 17:20:23 (1781817623) start mds service on oleg240-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg240-server: oleg240-server.virtnet: executing set_default_debug -1 all pdsh@oleg240-client: oleg240-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg240-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg240-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg240-server: oleg240-server.virtnet: executing set_default_debug -1 all pdsh@oleg240-client: oleg240-server: ssh exited with exit code 1 Started lustre-OST0000 oleg240-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg240-client.virtnet: -o user_xattr,flock 192.168.202.140@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12329 425 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 401 (time 1781817671.14 total 10.00 last 40.09) - open/close/unlink 819 (time 1781817681.16 total 20.02 last 41.74) - open/close/unlink 1271 (time 1781817691.16 total 30.03 last 45.16) - open/close/unlink 1707 (time 1781817701.18 total 40.04 last 43.55) - open/close/unlink 2168 (time 1781817711.19 total 50.05 last 46.04) - open/close/unlink 2575 (time 1781817721.19 total 60.06 last 40.68) - open/close/unlink 3002 (time 1781817731.21 total 70.08 last 42.62) - open/close/unlink 3435 (time 1781817741.24 total 80.10 last 43.19) - open/close/unlink 3837 (time 1781817751.26 total 90.12 last 40.12) - open/close/unlink 4276 (time 1781817761.27 total 100.13 last 43.84) - open/close/unlink 4768 (time 1781817771.28 total 110.14 last 49.17) - open/close/unlink 5273 (time 1781817781.29 total 120.16 last 50.41) - open/close/unlink 5755 (time 1781817791.30 total 130.16 last 48.19) - open/close/unlink 6187 (time 1781817801.32 total 140.18 last 43.11) - open/close/unlink 6608 (time 1781817811.32 total 150.19 last 42.06) - open/close/unlink 7017 (time 1781817821.33 total 160.20 last 40.86) - open/close/unlink 7450 (time 1781817831.34 total 170.20 last 43.29) - open/close/unlink 7880 (time 1781817841.34 total 180.21 last 42.97) - open/close/unlink 8353 (time 1781817851.35 total 190.22 last 47.25) - open/close/unlink 8874 (time 1781817861.36 total 200.22 last 52.07) - open/close/unlink 9388 (time 1781817871.37 total 210.23 last 51.37) - open/close/unlink 9870 (time 1781817881.37 total 220.24 last 48.17) - open/close/unlink 10000 (time 1781817883.60 total 222.46 last 58.44) - open/close/unlink 10751 (time 1781817893.60 total 232.46 last 75.09) - open/close/unlink 11369 (time 1781817903.61 total 242.47 last 61.75) - open/close/unlink 12015 (time 1781817913.63 total 252.49 last 64.47) - open/close/unlink 12521 (time 1781817923.64 total 262.50 last 50.54) - open/close/unlink 13050 (time 1781817933.64 total 272.50 last 52.89) - open/close/unlink 13600 (time 1781817943.67 total 282.53 last 54.86) - open/close/unlink 14186 (time 1781817953.67 total 292.54 last 58.55) - open/close/unlink 14710 (time 1781817963.68 total 302.54 last 52.39) - open/close/unlink 16128 (time 1781817973.68 total 312.55 last 141.72) - open/close/unlink 17708 (time 1781817983.69 total 322.55 last 157.90) - open/close/unlink 19009 (time 1781817993.69 total 332.56 last 130.03) - open/close/unlink 20000 (time 1781818003.05 total 341.92 last 105.88) - open/close/unlink 21333 (time 1781818013.06 total 351.92 last 133.22) - open/close/unlink 22698 (time 1781818023.06 total 361.93 last 136.47) - open/close/unlink 24053 (time 1781818033.07 total 371.93 last 135.42) - open/close/unlink 25473 (time 1781818043.07 total 381.94 last 141.91) - open/close/unlink 27042 (time 1781818053.08 total 391.94 last 156.88) - open/close/unlink 28451 (time 1781818063.08 total 401.94 last 140.89) - open/close/unlink 29862 (time 1781818073.08 total 411.94 last 141.04) - open/close/unlink 31151 (time 1781818083.09 total 421.95 last 128.83) - open/close/unlink 32468 (time 1781818093.09 total 431.96 last 131.62) - open/close/unlink 33936 (time 1781818103.09 total 441.96 last 146.78) - open/close/unlink 35329 (time 1781818113.10 total 451.96 last 139.24) - open/close/unlink 36803 (time 1781818123.10 total 461.97 last 147.32) - open/close/unlink 38326 (time 1781818133.10 total 471.97 last 152.28) - open/close/unlink 39852 (time 1781818143.11 total 481.97 last 152.50) - open/close/unlink 41371 (time 1781818153.12 total 491.98 last 151.83) - open/close/unlink 42773 (time 1781818163.12 total 501.98 last 140.16) - open/close/unlink 44356 (time 1781818173.14 total 512.01 last 157.89) - open/close/unlink 45633 (time 1781818183.15 total 522.01 last 127.68) - open/close/unlink 47057 (time 1781818193.15 total 532.02 last 142.30) - open/close/unlink 48374 (time 1781818203.16 total 542.02 last 131.62) - open/close/unlink 49893 (time 1781818213.16 total 552.02 last 151.88) - open/close/unlink 51351 (time 1781818223.17 total 562.03 last 145.72) - open/close/unlink 401 (time 1781817671.23 total 10.01 last 40.05) - open/close/unlink 816 (time 1781817681.27 total 20.05 last 41.33) - open/close/unlink 1266 (time 1781817691.30 total 30.08 last 44.88) - open/close/unlink 1701 (time 1781817701.31 total 40.09 last 43.45) - open/close/unlink 2152 (time 1781817711.32 total 50.10 last 45.07) - open/close/unlink 2549 (time 1781817721.32 total 60.11 last 39.68) - open/close/unlink 2981 (time 1781817731.33 total 70.11 last 43.18) - open/close/unlink 3409 (time 1781817741.34 total 80.12 last 42.76) - open/close/unlink 3805 (time 1781817751.36 total 90.15 last 39.49) - open/close/unlink 4241 (time 1781817761.37 total 100.15 last 43.58) - open/close/unlink 4727 (time 1781817771.37 total 110.15 last 48.59) - open/close/unlink 5231 (time 1781817781.37 total 120.16 last 50.38) - open/close/unlink 5708 (time 1781817791.39 total 130.17 last 47.62) - open/close/unlink 6133 (time 1781817801.40 total 140.18 last 42.48) - open/close/unlink 6558 (time 1781817811.41 total 150.19 last 42.43) - open/close/unlink 6964 (time 1781817821.43 total 160.21 last 40.54) - open/close/unlink 7399 (time 1781817831.44 total 170.22 last 43.45) - open/close/unlink 7823 (time 1781817841.46 total 180.24 last 42.30) - open/close/unlink 8287 (time 1781817851.46 total 190.25 last 46.38) - open/close/unlink 8808 (time 1781817861.48 total 200.26 last 52.02) - open/close/unlink 9324 (time 1781817871.49 total 210.27 last 51.55) - open/close/unlink 9803 (time 1781817881.49 total 220.27 last 47.89) - open/close/unlink 10000 (time 1781817884.61 total 223.39 last 63.25) - open/close/unlink 10729 (time 1781817894.61 total 233.40 last 72.86) - open/close/unlink 11359 (time 1781817904.62 total 243.40 last 62.96) - open/close/unlink 11989 (time 1781817914.62 total 253.40 last 62.99) - open/close/unlink 12490 (time 1781817924.63 total 263.42 last 50.04) - open/close/unlink 13028 (time 1781817934.64 total 273.42 last 53.78) - open/close/unlink 13577 (time 1781817944.65 total 283.43 last 54.82) - open/close/unlink 14152 (time 1781817954.66 total 293.44 last 57.46) - open/close/unlink 14762 (time 1781817964.66 total 303.45 last 60.96) - open/close/unlink 16205 (time 1781817974.66 total 313.45 last 144.29) - open/close/unlink 17793 (time 1781817984.67 total 323.45 last 158.73) - open/close/unlink 19048 (time 1781817994.67 total 333.45 last 125.49) - open/close/unlink 20000 (time 1781818003.37 total 342.15 last 109.45) - open/close/unlink 21336 (time 1781818013.37 total 352.15 last 133.56) - open/close/unlink 22700 (time 1781818023.38 total 362.16 last 136.33) - open/close/unlink 24057 (time 1781818033.38 total 372.16 last 135.62) - open/close/unlink 25477 (time 1781818043.38 total 382.17 last 141.98) - open/close/unlink 27033 (time 1781818053.38 total 392.17 last 155.59) - open/close/unlink 28434 (time 1781818063.39 total 402.17 last 140.02) - open/close/unlink 29851 (time 1781818073.39 total 412.18 last 141.66) - open/close/unlink 31128 (time 1781818083.39 total 422.18 last 127.67) - open/close/unlink 32457 (time 1781818093.40 total 432.18 last 132.82) - open/close/unlink 33908 (time 1781818103.40 total 442.19 last 145.08) - open/close/unlink 35304 (time 1781818113.40 total 452.19 last 139.56) - open/close/unlink 36764 (time 1781818123.41 total 462.19 last 145.97) - open/close/unlink 38306 (time 1781818133.41 total 472.19 last 154.17) - open/close/unlink 39812 (time 1781818143.41 total 482.20 last 150.52) - open/close/unlink 41346 (time 1781818153.42 total 492.20 last 153.31) - open/close/unlink 42768 (time 1781818163.42 total 502.21 last 142.14) - open/close/unlink 44335 (time 1781818173.43 total 512.21 last 156.62) - open/close/unlink 45610 (time 1781818183.43 total 522.21 last 127.49) - open/close/unlink 47028 (time 1781818193.43 total 532.22 last 141.73) - open/close/unlink 48349 (time 1781818203.43 total 542.22 last 132.09) - open/close/unlink 49903 (time 1781818213.45 total 552.23 last 155.22) - open/close/unlink 51390 (time 1781818223.45 total 562.24 last 148.61) - open/close/unlink 399 (time 1781817671.09 total 10.02 last 39.81) - open/close/unlink 813 (time 1781817681.13 total 20.07 last 41.21) - open/close/unlink 1265 (time 1781817691.14 total 30.08 last 45.16) - open/close/unlink 1699 (time 1781817701.14 total 40.08 last 43.39) - open/close/unlink 2166 (time 1781817711.15 total 50.08 last 46.69) - open/close/unlink 2575 (time 1781817721.17 total 60.11 last 40.81) - open/close/unlink 2999 (time 1781817731.17 total 70.11 last 42.38) - open/close/unlink 3432 (time 1781817741.19 total 80.13 last 43.22) - open/close/unlink 3830 (time 1781817751.22 total 90.15 last 39.71) - open/close/unlink 4267 (time 1781817761.23 total 100.17 last 43.61) - open/close/unlink 4762 (time 1781817771.25 total 110.19 last 49.42) - open/close/unlink 5259 (time 1781817781.27 total 120.21 last 49.59) - open/close/unlink 5734 (time 1781817791.29 total 130.22 last 47.43) - open/close/unlink 6160 (time 1781817801.30 total 140.23 last 42.56) - open/close/unlink 6584 (time 1781817811.30 total 150.24 last 42.37) - open/close/unlink 6990 (time 1781817821.32 total 160.25 last 40.54) - open/close/unlink 7416 (time 1781817831.34 total 170.28 last 42.51) - open/close/unlink 7840 (time 1781817841.34 total 180.28 last 42.39) - open/close/unlink 8302 (time 1781817851.36 total 190.29 last 46.13) - open/close/unlink 8820 (time 1781817861.36 total 200.30 last 51.76) - open/close/unlink 9333 (time 1781817871.38 total 210.31 last 51.22) - open/close/unlink 9814 (time 1781817881.39 total 220.32 last 48.06) - open/close/unlink 10000 (time 1781817884.36 total 223.29 last 62.63) - open/close/unlink 10738 (time 1781817894.37 total 233.30 last 73.75) - open/close/unlink 11351 (time 1781817904.37 total 243.30 last 61.30) - open/close/unlink 11978 (time 1781817914.38 total 253.31 last 62.64) - open/close/unlink 12483 (time 1781817924.38 total 263.32 last 50.46) - open/close/unlink 13024 (time 1781817934.39 total 273.33 last 54.04) - open/close/unlink 13584 (time 1781817944.43 total 283.37 last 55.80) - open/close/unlink 14155 (time 1781817954.46 total 293.39 last 56.95) - open/close/unlink 14737 (time 1781817964.46 total 303.40 last 58.16) - open/close/unlink 16158 (time 1781817974.47 total 313.40 last 142.05) - open/close/unlink 17735 (time 1781817984.47 total 323.40 last 157.69) - open/close/unlink 19012 (time 1781817994.47 total 333.41 last 127.66) - open/close/unlink 20000 (time 1781818003.53 total 342.46 last 109.08) - open/close/unlink 21349 (time 1781818013.53 total 352.47 last 134.82) - open/close/unlink 22716 (time 1781818023.54 total 362.47 last 136.68) - open/close/unlink 24080 (time 1781818033.54 total 372.47 last 136.39) - open/close/unlink 25507 (time 1781818043.54 total 382.48 last 142.64) - open/close/unlink 27075 (time 1781818053.54 total 392.48 last 156.77) - open/close/unlink 28482 (time 1781818063.54 total 402.48 last 140.68) - open/close/unlink 29898 (time 1781818073.55 total 412.48 last 141.59) - open/close/unlink 31177 (time 1781818083.55 total 422.48 last 127.89) - open/close/unlink 32512 (time 1781818093.55 total 432.48 last 133.50) - open/close/unlink 33967 (time 1781818103.55 total 442.48 last 145.45) - open/close/unlink 35356 (time 1781818113.55 total 452.49 last 138.84) - open/close/unlink 36829 (time 1781818123.56 total 462.49 last 147.25) - open/close/unlink 38355 (time 1781818133.56 total 472.50 last 152.53) - open/close/unlink 39865 (time 1781818143.58 total 482.51 last 150.79) - open/close/unlink 41393 (time 1781818153.58 total 492.52 last 152.68) - open/close/unlink 42830 (time 1781818163.58 total 502.52 last 143.69) - open/close/unlink 44375 (time 1781818173.59 total 512.52 last 154.47) - open/close/unlink 45671 (time 1781818183.59 total 522.52 last 129.58) - open/close/unlink 47086 (time 1781818193.59 total 532.52 last 141.49) - open/close/unlink 48393 (time 1781818203.59 total 542.53 last 130.64) - open/close/unlink 49950 (time 1781818213.60 total 552.53 last 155.66) - open/close/unlink 51434 (time 1781818223.60 total 562.54 last 148.28) - open/close/unlink 402 (time 1781817671.35 total 10.02 last 40.14) - open/close/unlink 824 (time 1781817681.39 total 20.05 last 42.05) - open/close/unlink 1270 (time 1781817691.41 total 30.07 last 44.50) - open/close/unlink 1713 (time 1781817701.43 total 40.09 last 44.23) - open/close/unlink 2173 (time 1781817711.44 total 50.10 last 45.93) - open/close/unlink 2571 (time 1781817721.45 total 60.11 last 39.76) - open/close/unlink 2992 (time 1781817731.46 total 70.12 last 42.07) - open/close/unlink 3415 (time 1781817741.46 total 80.13 last 42.27) - open/close/unlink 3810 (time 1781817751.46 total 90.13 last 39.50) - open/close/unlink 4254 (time 1781817761.47 total 100.13 last 44.38) - open/close/unlink 4743 (time 1781817771.48 total 110.14 last 48.85) - open/close/unlink 5239 (time 1781817781.49 total 120.16 last 49.53) - open/close/unlink 5721 (time 1781817791.50 total 130.16 last 48.17) - open/close/unlink 6150 (time 1781817801.50 total 140.17 last 42.89) - open/close/unlink 6566 (time 1781817811.53 total 150.20 last 41.49) - open/close/unlink 6977 (time 1781817821.54 total 160.21 last 41.05) - open/close/unlink 7414 (time 1781817831.55 total 170.21 last 43.68) - open/close/unlink 7838 (time 1781817841.55 total 180.22 last 42.37) - open/close/unlink 8306 (time 1781817851.56 total 190.23 last 46.77) - open/close/unlink 8824 (time 1781817861.57 total 200.24 last 51.75) - open/close/unlink 9333 (time 1781817871.57 total 210.24 last 50.89) - open/close/unlink 9815 (time 1781817881.59 total 220.25 last 48.14) - open/close/unlink 10000 (time 1781817884.46 total 223.12 last 64.43) - open/close/unlink 10734 (time 1781817894.46 total 233.12 last 73.38) - open/close/unlink 11353 (time 1781817904.47 total 243.13 last 61.84) - open/close/unlink 11978 (time 1781817914.49 total 253.15 last 62.41) - open/close/unlink 12477 (time 1781817924.49 total 263.15 last 49.89) - open/close/unlink 13022 (time 1781817934.50 total 273.16 last 54.43) - open/close/unlink 13579 (time 1781817944.50 total 283.17 last 55.68) - open/close/unlink 14154 (time 1781817954.51 total 293.17 last 57.46) - open/close/unlink 14739 (time 1781817964.52 total 303.18 last 58.46) - open/close/unlink 16166 (time 1781817974.52 total 313.19 last 142.63) - open/close/unlink 17741 (time 1781817984.53 total 323.19 last 157.45) - open/close/unlink 19021 (time 1781817994.53 total 333.19 last 127.94) - open/close/unlink 20000 (time 1781818003.56 total 342.22 last 108.42) - open/close/unlink 21344 (time 1781818013.56 total 352.23 last 134.33) - open/close/unlink 22724 (time 1781818023.57 total 362.23 last 137.98) - open/close/unlink 24081 (time 1781818033.57 total 372.23 last 135.69) - open/close/unlink 25501 (time 1781818043.57 total 382.24 last 141.93) - open/close/unlink 27076 (time 1781818053.58 total 392.24 last 157.45) - open/close/unlink 28474 (time 1781818063.58 total 402.24 last 139.78) - open/close/unlink 29893 (time 1781818073.58 total 412.24 last 141.85) - open/close/unlink 31158 (time 1781818083.58 total 422.25 last 126.48) - open/close/unlink 32491 (time 1781818093.58 total 432.25 last 133.27) - open/close/unlink 33962 (time 1781818103.59 total 442.26 last 146.98) - open/close/unlink 35358 (time 1781818113.60 total 452.26 last 139.55) - open/close/unlink 36830 (time 1781818123.60 total 462.26 last 147.19) - open/close/unlink 38376 (time 1781818133.60 total 472.26 last 154.53) - open/close/unlink 39879 (time 1781818143.61 total 482.27 last 150.23) - open/close/unlink 41406 (time 1781818153.61 total 492.28 last 152.60) - open/close/unlink 42850 (time 1781818163.62 total 502.28 last 144.32) - open/close/unlink 44401 (time 1781818173.62 total 512.28 last 155.07) - open/close/unlink 45700 (time 1781818183.62 total 522.29 last 129.84) - open/close/unlink 47118 (time 1781818193.63 total 532.29 last 141.74) - open/close/unlink 48435 (time 1781818203.63 total 542.30 last 131.64) - open/close/unlink 49991 (time 1781818213.64 total 552.30 last 155.57) - open/close/unlink 51488 (time 1781818223.66 total 562.32 last 149.35) - open/close/unlink 399 (time 1781817671.33 total 10.01 last 39.85) - open/close/unlink 812 (time 1781817681.33 total 20.01 last 41.30) - open/close/unlink 1266 (time 1781817691.35 total 30.03 last 45.33) - open/close/unlink 1711 (time 1781817701.37 total 40.05 last 44.41) - open/close/unlink 2164 (time 1781817711.38 total 50.06 last 45.26) - open/close/unlink 2561 (time 1781817721.38 total 60.06 last 39.69) - open/close/unlink 2986 (time 1781817731.39 total 70.07 last 42.46) - open/close/unlink 3414 (time 1781817741.40 total 80.08 last 42.77) - open/close/unlink 3813 (time 1781817751.41 total 90.09 last 39.84) - open/close/unlink 4259 (time 1781817761.42 total 100.10 last 44.55) - open/close/unlink 4742 (time 1781817771.43 total 110.11 last 48.25) - open/close/unlink 5236 (time 1781817781.44 total 120.11 last 49.39) - open/close/unlink 5704 (time 1781817791.45 total 130.13 last 46.74) - open/close/unlink 6135 (time 1781817801.47 total 140.14 last 43.03) - open/close/unlink 6552 (time 1781817811.47 total 150.15 last 41.69) - open/close/unlink 6967 (time 1781817821.47 total 160.15 last 41.50) - open/close/unlink 7400 (time 1781817831.47 total 170.15 last 43.28) - open/close/unlink 7825 (time 1781817841.48 total 180.16 last 42.45) - open/close/unlink 8286 (time 1781817851.49 total 190.17 last 46.06) - open/close/unlink 8807 (time 1781817861.49 total 200.17 last 52.10) - open/close/unlink 9318 (time 1781817871.50 total 210.18 last 51.08) - open/close/unlink 9802 (time 1781817881.50 total 220.18 last 48.37) - open/close/unlink 10000 (time 1781817884.70 total 223.37 last 62.03) - open/close/unlink 10736 (time 1781817894.70 total 233.37 last 73.60) - open/close/unlink 11365 (time 1781817904.70 total 243.38 last 62.89) - open/close/unlink 11984 (time 1781817914.72 total 253.39 last 61.79) - open/close/unlink 12481 (time 1781817924.75 total 263.42 last 49.56) - open/close/unlink 13028 (time 1781817934.75 total 273.43 last 54.69) - open/close/unlink 13581 (time 1781817944.77 total 283.44 last 55.20) - open/close/unlink 14147 (time 1781817954.78 total 293.45 last 56.54) - open/close/unlink 14761 (time 1781817964.78 total 303.46 last 61.38) - open/close/unlink 16190 (time 1781817974.78 total 313.46 last 142.89) - open/close/unlink 17788 (time 1781817984.79 total 323.46 last 159.74) - open/close/unlink 19023 (time 1781817994.79 total 333.47 last 123.46) - open/close/unlink 20000 (time 1781818003.74 total 342.42 last 109.10) - open/close/unlink 21345 (time 1781818013.77 total 352.44 last 134.19) - open/close/unlink 22721 (time 1781818023.77 total 362.44 last 137.60) - open/close/unlink 24077 (time 1781818033.78 total 372.46 last 135.45) - open/close/unlink 25506 (time 1781818043.78 total 382.46 last 142.86) - open/close/unlink 27075 (time 1781818053.78 total 392.46 last 156.87) - open/close/unlink 28473 (time 1781818063.78 total 402.46 last 139.79) - open/close/unlink 29885 (time 1781818073.79 total 412.47 last 141.13) - open/close/unlink 31176 (time 1781818083.79 total 422.47 last 129.03) - open/close/unlink 32522 (time 1781818093.79 total 432.47 last 134.59) - open/close/unlink 33979 (time 1781818103.80 total 442.47 last 145.67) - open/close/unlink 35373 (time 1781818113.80 total 452.48 last 139.36) - open/close/unlink 36849 (time 1781818123.80 total 462.48 last 147.53) - open/close/unlink 38373 (time 1781818133.81 total 472.48 last 152.38) - open/close/unlink 39871 (time 1781818143.81 total 482.48 last 149.79) - open/close/unlink 41403 (time 1781818153.81 total 492.49 last 153.15) - open/close/unlink 42853 (time 1781818163.81 total 502.49 last 144.95) - open/close/unlink 44400 (time 1781818173.81 total 512.49 last 154.67) - open/close/unlink 45690 (time 1781818183.82 total 522.50 last 128.93) - open/close/unlink 47084 (time 1781818193.83 total 532.50 last 139.31) - open/close/unlink 48403 (time 1781818203.83 total 542.51 last 131.84) - open/close/unlink 49947 (time 1781818213.83 total 552.51 last 154.35) - open/close/unlink 51422 (time 1781818223.85 total 562.52 last 147.33) - open/close/unlink 52993 (time 1781818233.66 total 572.32 last 150.47) - open/close/unlink 54421 (time 1781818243.67 total 582.33 last 142.65) - open/close/unlink 55932 (time 1781818253.67 total 592.34 last 151.05) - open/close/unlink 57658 (time 1781818263.68 total 602.35 last 172.48) - open/close/unlink 59251 (time 1781818273.68 total 612.35 last 159.28) - open/close/unlink 60000 (time 1781818278.35 total 617.01 last 160.60) - open/close/unlink 61461 (time 1781818288.35 total 627.01 last 146.07) - open/close/unlink 62047 (time 1781818298.36 total 637.02 last 58.53) - open/close/unlink 62520 (time 1781818308.37 total 647.04 last 47.25) - open/close/unlink 63027 (time 1781818318.38 total 657.04 last 50.67) - open/close/unlink 63561 (time 1781818328.38 total 667.04 last 53.38) - open/close/unlink 64302 (time 1781818338.39 total 677.06 last 73.99) total: 64768 open/close/unlink in 681.97 seconds: 94.97 ops/second - open/close/unlink 52925 (time 1781818233.61 total 572.55 last 149.01) - open/close/unlink 54332 (time 1781818243.61 total 582.55 last 140.64) - open/close/unlink 55844 (time 1781818253.62 total 592.55 last 151.16) - open/close/unlink 57564 (time 1781818263.62 total 602.55 last 171.96) - open/close/unlink 59135 (time 1781818273.62 total 612.56 last 157.07) - open/close/unlink 60000 (time 1781818278.84 total 617.78 last 165.70) - open/close/unlink 61427 (time 1781818288.85 total 627.78 last 142.61) - open/close/unlink 61958 (time 1781818298.89 total 637.82 last 52.89) - open/close/unlink 62435 (time 1781818308.89 total 647.83 last 47.68) - open/close/unlink 62949 (time 1781818318.90 total 657.84 last 51.36) - open/close/unlink 63490 (time 1781818328.90 total 667.84 last 54.10) - open/close/unlink 64245 (time 1781818338.90 total 677.84 last 75.48) total: 64768 open/close/unlink in 684.59 seconds: 94.61 ops/second - open/close/unlink 52890 (time 1781818233.46 total 572.24 last 149.96) - open/close/unlink 54304 (time 1781818243.46 total 582.24 last 141.37) - open/close/unlink 55835 (time 1781818253.46 total 592.24 last 153.08) - open/close/unlink 57560 (time 1781818263.46 total 602.25 last 172.44) - open/close/unlink 59137 (time 1781818273.47 total 612.25 last 157.62) - open/close/unlink 60000 (time 1781818278.76 total 617.54 last 163.06) - open/close/unlink 61432 (time 1781818288.76 total 627.54 last 143.18) - open/close/unlink 61982 (time 1781818298.77 total 637.56 last 54.94) - open/close/unlink 62459 (time 1781818308.79 total 647.57 last 47.63) - open/close/unlink 62974 (time 1781818318.80 total 657.58 last 51.43) - open/close/unlink 63511 (time 1781818328.81 total 667.59 last 53.65) - open/close/unlink 64250 (time 1781818338.81 total 677.59 last 73.88) total: 64768 open/close/unlink in 684.46 seconds: 94.63 ops/second - open/close/unlink 52908 (time 1781818233.85 total 572.53 last 148.56) - open/close/unlink 54351 (time 1781818243.85 total 582.53 last 144.20) - open/close/unlink 55862 (time 1781818253.86 total 592.54 last 151.03) - open/close/unlink 57593 (time 1781818263.86 total 602.54 last 173.02) - open/close/unlink 59181 (time 1781818273.87 total 612.55 last 158.71) - open/close/unlink 60000 (time 1781818278.88 total 617.56 last 163.46) - open/close/unlink 61434 (time 1781818288.88 total 627.56 last 143.39) - open/close/unlink 61970 (time 1781818298.91 total 637.59 last 53.46) - open/close/unlink 62447 (time 1781818308.91 total 647.59 last 47.69) - open/close/unlink 62960 (time 1781818318.92 total 657.59 last 51.26) - open/close/unlink 63504 (time 1781818328.93 total 667.61 last 54.34) - open/close/unlink 64251 (time 1781818338.93 total 677.61 last 74.68) total: 64768 open/close/unlink in 684.43 seconds: 94.63 ops/second - open/close/unlink 52856 (time 1781818233.17 total 572.04 last 150.41) - open/close/unlink 54258 (time 1781818243.18 total 582.04 last 140.15) - open/close/unlink 55769 (time 1781818253.18 total 592.04 last 151.08) - open/close/unlink 57464 (time 1781818263.18 total 602.04 last 169.42) - open/close/unlink 59034 (time 1781818273.19 total 612.05 last 156.93) - open/close/unlink 60000 (time 1781818279.03 total 617.89 last 165.30) - open/close/unlink 61414 (time 1781818289.03 total 627.89 last 141.39) - open/close/unlink 61940 (time 1781818299.07 total 637.93 last 52.40) - open/close/unlink 62420 (time 1781818309.08 total 647.94 last 47.96) - open/close/unlink 62928 (time 1781818319.09 total 657.95 last 50.75) - open/close/unlink 63470 (time 1781818329.09 total 667.96 last 54.17) - open/close/unlink 64227 (time 1781818339.09 total 677.96 last 75.68) total: 64768 open/close/unlink in 685.79 seconds: 94.44 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg240-server: cannot open 'lustre-ost2': no such pool pdsh@oleg240-client: oleg240-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg240-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg240-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg240-server stop mds service on oleg240-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg240-server unloading modules via unload_modules_local on: 'oleg240-server' oleg240-server: oleg240-server.virtnet: executing unload_modules_local oleg240-server: modules unloaded. pdsh@oleg240-client: oleg240-client: ssh exited with exit code 2 pdsh@oleg240-client: oleg240-server: ssh exited with exit code 2 pdsh@oleg240-client: oleg240-client: ssh exited with exit code 2 pdsh@oleg240-client: oleg240-server: ssh exited with exit code 2 PASS 106 (765s) Stopping clients: oleg240-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg240-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg240-client: oleg240-server: ssh exited with exit code 2 oleg240-server: oleg240-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg240-server' oleg240-server: oleg240-server.virtnet: executing load_modules_local oleg240-server: Loading modules from /home/green/git/lustre-release/lustre oleg240-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg240-server: detected 4 online CPUs by sysfs oleg240-server: MODOPTS_LIBCFS= oleg240-server: Force libcfs to create 2 CPU partitions oleg240-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg240-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg240-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 912 sec =========== 17:33:38 (1781818418) === conf-sanity: start cleanup 17:33:38 (1781818418) === === conf-sanity: finish cleanup 17:33:40 (1781818420) ===