-----============= acceptance-small: conf-sanity ============----- Wed Sep 2 10:27:55 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg228-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682881 > 34553653) for LU-16938, go 81 excepting tests: 32newtarball Stopping clients: oleg228-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg228-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg228-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg228-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg228-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg228-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg228-server oleg228-server: oleg228-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg228-server' oleg228-server: oleg228-server.virtnet: executing load_modules_local oleg228-server: Loading modules from /home/green/git/lustre-release/lustre oleg228-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg228-server: detected 4 online CPUs by sysfs oleg228-server: MODOPTS_LIBCFS= oleg228-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg228-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg228-server: oleg228-server.virtnet: executing set_default_debug -1 all pdsh@oleg228-client: oleg228-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg228-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg228-server: oleg228-server.virtnet: executing set_default_debug -1 all pdsh@oleg228-client: oleg228-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg228-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg228-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg228-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg228-server: oleg228-server.virtnet: executing set_default_debug -1 all pdsh@oleg228-client: oleg228-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg228-server: oleg228-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg228-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg228-server: oleg228-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg228-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg228-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg228-server stop mds service on oleg228-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg228-server stop mds service on oleg228-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg228-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 10:31:10 (1788359470) start mds service on oleg228-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg228-server: oleg228-server.virtnet: executing set_default_debug -1 all pdsh@oleg228-client: oleg228-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg228-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg228-server: oleg228-server.virtnet: executing set_default_debug -1 all pdsh@oleg228-client: oleg228-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg228-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg228-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg228-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg228-server: oleg228-server.virtnet: executing set_default_debug -1 all pdsh@oleg228-client: oleg228-server: ssh exited with exit code 1 Started lustre-OST0000 oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg228-client.virtnet: -o user_xattr,flock 192.168.202.128@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50096 529 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 454 (time 1788359527.92 total 10.00 last 45.40) - open/close/unlink 856 (time 1788359537.92 total 20.00 last 40.20) - open/close/unlink 1399 (time 1788359547.94 total 30.01 last 54.24) - open/close/unlink 1912 (time 1788359557.94 total 40.01 last 51.30) - open/close/unlink 2407 (time 1788359567.96 total 50.03 last 49.40) - open/close/unlink 2950 (time 1788359577.98 total 60.05 last 54.18) - open/close/unlink 3476 (time 1788359587.98 total 70.06 last 52.57) - open/close/unlink 4008 (time 1788359597.99 total 80.06 last 53.17) - open/close/unlink 4507 (time 1788359608.00 total 90.08 last 49.84) - open/close/unlink 5036 (time 1788359618.01 total 100.09 last 52.83) - open/close/unlink 5680 (time 1788359628.01 total 110.09 last 64.40) - open/close/unlink 6337 (time 1788359638.02 total 120.10 last 65.65) - open/close/unlink 7046 (time 1788359648.03 total 130.10 last 70.86) - open/close/unlink 7844 (time 1788359658.03 total 140.11 last 79.75) - open/close/unlink 8944 (time 1788359668.03 total 150.11 last 109.99) - open/close/unlink 9973 (time 1788359678.04 total 160.11 last 102.85) - open/close/unlink 10628 (time 1788359688.05 total 170.13 last 65.41) - open/close/unlink 11290 (time 1788359698.06 total 180.13 last 66.18) - open/close/unlink 11971 (time 1788359708.06 total 190.14 last 68.07) - open/close/unlink 12644 (time 1788359718.07 total 200.14 last 67.25) - open/close/unlink 13214 (time 1788359728.08 total 210.15 last 56.94) - open/close/unlink 13871 (time 1788359738.08 total 220.15 last 65.70) - open/close/unlink 14579 (time 1788359748.08 total 230.16 last 70.78) - open/close/unlink 15196 (time 1788359758.08 total 240.16 last 61.70) - open/close/unlink 16019 (time 1788359768.12 total 250.19 last 82.02) - open/close/unlink 16668 (time 1788359778.13 total 260.20 last 64.83) - open/close/unlink 17321 (time 1788359788.13 total 270.20 last 65.30) - open/close/unlink 17913 (time 1788359798.13 total 280.21 last 59.17) - open/close/unlink 18510 (time 1788359808.13 total 290.21 last 59.69) - open/close/unlink 19170 (time 1788359818.14 total 300.22 last 65.95) - open/close/unlink 19960 (time 1788359828.14 total 310.22 last 78.99) - open/close/unlink 20916 (time 1788359838.15 total 320.23 last 95.52) - open/close/unlink 21796 (time 1788359848.16 total 330.24 last 87.89) - open/close/unlink 22504 (time 1788359858.17 total 340.25 last 70.76) - open/close/unlink 23327 (time 1788359868.17 total 350.25 last 82.27) - open/close/unlink 24189 (time 1788359878.18 total 360.26 last 86.14) - open/close/unlink 25021 (time 1788359888.18 total 370.26 last 83.19) - open/close/unlink 25841 (time 1788359898.18 total 380.26 last 82.00) - open/close/unlink 26731 (time 1788359908.19 total 390.26 last 88.94) - open/close/unlink 27652 (time 1788359918.19 total 400.27 last 92.06) - open/close/unlink 28559 (time 1788359928.21 total 410.28 last 90.57) - open/close/unlink 29273 (time 1788359938.21 total 420.28 last 71.40) - open/close/unlink 29996 (time 1788359948.21 total 430.29 last 72.29) - open/close/unlink 30773 (time 1788359958.21 total 440.29 last 77.69) - open/close/unlink 31467 (time 1788359968.23 total 450.30 last 69.29) - open/close/unlink 32158 (time 1788359978.23 total 460.31 last 69.07) - open/close/unlink 32809 (time 1788359988.23 total 470.31 last 65.07) - open/close/unlink 33650 (time 1788359998.24 total 480.31 last 84.08) - open/close/unlink 34536 (time 1788360008.25 total 490.33 last 88.46) - open/close/unlink 35334 (time 1788360018.25 total 500.33 last 79.79) - open/close/unlink 36296 (time 1788360028.26 total 510.34 last 96.12) - open/close/unlink 37161 (time 1788360038.26 total 520.34 last 86.50) - open/close/unlink 38314 (time 1788360048.27 total 530.35 last 115.19) - open/close/unlink 39457 (time 1788360058.27 total 540.35 last 114.29) - open/close/unlink 40000 (time 1788360061.76 total 543.84 last 155.64) - open/close/unlink 41185 (time 1788360071.77 total 553.84 last 118.45) - open/close/unlink 41979 (time 1788360081.77 total 563.84 last 79.39) - open/close - open/close/unlink 456 (time 1788359527.63 total 10.01 last 45.56) - open/close/unlink 864 (time 1788359537.64 total 20.02 last 40.77) - open/close/unlink 1388 (time 1788359547.65 total 30.03 last 52.32) - open/close/unlink 1891 (time 1788359557.66 total 40.04 last 50.28) - open/close/unlink 2383 (time 1788359567.66 total 50.04 last 49.19) - open/close/unlink 2916 (time 1788359577.67 total 60.04 last 53.27) - open/close/unlink 3435 (time 1788359587.67 total 70.05 last 51.87) - open/close/unlink 3957 (time 1788359597.69 total 80.07 last 52.09) - open/close/unlink 4458 (time 1788359607.71 total 90.09 last 50.00) - open/close/unlink 4984 (time 1788359617.71 total 100.09 last 52.58) - open/close/unlink 5614 (time 1788359627.72 total 110.10 last 62.94) - open/close/unlink 6274 (time 1788359637.73 total 120.10 last 65.98) - open/close/unlink 6966 (time 1788359647.73 total 130.11 last 69.14) - open/close/unlink 7766 (time 1788359657.74 total 140.12 last 79.96) - open/close/unlink 8850 (time 1788359667.74 total 150.12 last 108.34) - open/close/unlink 9895 (time 1788359677.75 total 160.13 last 104.46) - open/close/unlink 10568 (time 1788359687.76 total 170.14 last 67.25) - open/close/unlink 11228 (time 1788359697.77 total 180.15 last 65.91) - open/close/unlink 11921 (time 1788359707.78 total 190.16 last 69.20) - open/close/unlink 12592 (time 1788359717.79 total 200.17 last 67.05) - open/close/unlink 13159 (time 1788359727.81 total 210.19 last 56.58) - open/close/unlink 13818 (time 1788359737.84 total 220.21 last 65.75) - open/close/unlink 14532 (time 1788359747.86 total 230.24 last 71.24) - open/close/unlink 15139 (time 1788359757.88 total 240.26 last 60.54) - open/close/unlink 15965 (time 1788359767.89 total 250.27 last 82.52) - open/close/unlink 16609 (time 1788359777.90 total 260.28 last 64.33) - open/close/unlink 17269 (time 1788359787.92 total 270.29 last 65.93) - open/close/unlink 17857 (time 1788359797.93 total 280.31 last 58.74) - open/close/unlink 18446 (time 1788359807.93 total 290.31 last 58.89) - open/close/unlink 19100 (time 1788359817.95 total 300.33 last 65.27) - open/close/unlink 19897 (time 1788359827.96 total 310.34 last 79.62) - open/close/unlink 20860 (time 1788359837.97 total 320.35 last 96.19) - open/close/unlink 21735 (time 1788359847.97 total 330.35 last 87.45) - open/close/unlink 22447 (time 1788359857.98 total 340.36 last 71.15) - open/close/unlink 23288 (time 1788359867.99 total 350.37 last 84.00) - open/close/unlink 24149 (time 1788359877.99 total 360.37 last 86.10) - open/close/unlink 24986 (time 1788359888.00 total 370.38 last 83.64) - open/close/unlink 25798 (time 1788359898.01 total 380.39 last 81.14) - open/close/unlink 26688 (time 1788359908.01 total 390.39 last 88.96) - open/close/unlink 27607 (time 1788359918.02 total 400.40 last 91.86) - open/close/unlink 28508 (time 1788359928.03 total 410.41 last 90.01) - open/close/unlink 29221 (time 1788359938.04 total 420.42 last 71.18) - open/close/unlink 29952 (time 1788359948.06 total 430.44 last 72.99) - open/close/unlink 30730 (time 1788359958.06 total 440.44 last 77.77) - open/close/unlink 31425 (time 1788359968.07 total 450.44 last 69.49) - open/close/unlink 32110 (time 1788359978.07 total 460.44 last 68.50) - open/close/unlink 32761 (time 1788359988.07 total 470.45 last 65.08) - open/close/unlink 33598 (time 1788359998.08 total 480.46 last 83.61) - open/close/unlink 34495 (time 1788360008.08 total 490.46 last 89.67) - open/close/unlink 35283 (time 1788360018.08 total 500.46 last 78.79) - open/close/unlink 36243 (time 1788360028.09 total 510.47 last 95.95) - open/close/unlink 37089 (time 1788360038.09 total 520.47 last 84.58) - open/close/unlink 38247 (time 1788360048.09 total 530.47 last 115.77) - open/close/unlink 39392 (time 1788360058.10 total 540.48 last 114.38) - open/close/unlink 40000 (time 1788360062.09 total 544.47 last 152.66) - open/close/unlink 41162 (time 1788360072.09 total 554.47 last 116.19) - open/close/unlink 41972 (time 1788360082.09 total 564.47 last 80.98) - open/close - open/close/unlink 451 (time 1788359527.85 total 10.02 last 45.00) - open/close/unlink 858 (time 1788359537.85 total 20.02 last 40.69) - open/close/unlink 1384 (time 1788359547.85 total 30.03 last 52.59) - open/close/unlink 1897 (time 1788359557.85 total 40.03 last 51.30) - open/close/unlink 2395 (time 1788359567.86 total 50.03 last 49.79) - open/close/unlink 2936 (time 1788359577.86 total 60.04 last 54.06) - open/close/unlink 3454 (time 1788359587.87 total 70.04 last 51.77) - open/close/unlink 3976 (time 1788359597.88 total 80.05 last 52.13) - open/close/unlink 4473 (time 1788359607.88 total 90.06 last 49.69) - open/close/unlink 5004 (time 1788359617.89 total 100.07 last 53.05) - open/close/unlink 5637 (time 1788359627.90 total 110.07 last 63.25) - open/close/unlink 6293 (time 1788359637.91 total 120.08 last 65.53) - open/close/unlink 6992 (time 1788359647.91 total 130.09 last 69.89) - open/close/unlink 7786 (time 1788359657.92 total 140.09 last 79.38) - open/close/unlink 8880 (time 1788359667.92 total 150.09 last 109.34) - open/close/unlink 9918 (time 1788359677.92 total 160.09 last 103.80) - open/close/unlink 10581 (time 1788359687.93 total 170.11 last 66.22) - open/close/unlink 11245 (time 1788359697.93 total 180.11 last 66.40) - open/close/unlink 11927 (time 1788359707.94 total 190.12 last 68.13) - open/close/unlink 12584 (time 1788359717.97 total 200.15 last 65.49) - open/close/unlink 13146 (time 1788359727.98 total 210.15 last 56.19) - open/close/unlink 13807 (time 1788359737.98 total 220.15 last 66.08) - open/close/unlink 14521 (time 1788359747.99 total 230.16 last 71.32) - open/close/unlink 15125 (time 1788359757.99 total 240.17 last 60.36) - open/close/unlink 15950 (time 1788359768.00 total 250.17 last 82.47) - open/close/unlink 16594 (time 1788359778.01 total 260.18 last 64.34) - open/close/unlink 17253 (time 1788359788.01 total 270.19 last 65.88) - open/close/unlink 17831 (time 1788359798.01 total 280.19 last 57.79) - open/close/unlink 18420 (time 1788359808.03 total 290.20 last 58.83) - open/close/unlink 19072 (time 1788359818.04 total 300.21 last 65.14) - open/close/unlink 19866 (time 1788359828.04 total 310.21 last 79.39) - open/close/unlink 20829 (time 1788359838.04 total 320.21 last 96.28) - open/close/unlink 21706 (time 1788359848.05 total 330.22 last 87.65) - open/close/unlink 22420 (time 1788359858.05 total 340.22 last 71.37) - open/close/unlink 23254 (time 1788359868.06 total 350.24 last 83.28) - open/close/unlink 24116 (time 1788359878.09 total 360.26 last 86.00) - open/close/unlink 24951 (time 1788359888.09 total 370.26 last 83.49) - open/close/unlink 25766 (time 1788359898.10 total 380.27 last 81.45) - open/close/unlink 26662 (time 1788359908.10 total 390.27 last 89.57) - open/close/unlink 27582 (time 1788359918.10 total 400.27 last 91.99) - open/close/unlink 28483 (time 1788359928.11 total 410.28 last 90.05) - open/close/unlink 29187 (time 1788359938.11 total 420.28 last 70.39) - open/close/unlink 29921 (time 1788359948.12 total 430.29 last 73.35) - open/close/unlink 30697 (time 1788359958.12 total 440.29 last 77.58) - open/close/unlink 31392 (time 1788359968.13 total 450.30 last 69.45) - open/close/unlink 32083 (time 1788359978.13 total 460.31 last 69.04) - open/close/unlink 32730 (time 1788359988.15 total 470.32 last 64.63) - open/close/unlink 33574 (time 1788359998.15 total 480.32 last 84.35) - open/close/unlink 34465 (time 1788360008.16 total 490.33 last 89.03) - open/close/unlink 35265 (time 1788360018.17 total 500.34 last 79.91) - open/close/unlink 36223 (time 1788360028.18 total 510.35 last 95.76) - open/close/unlink 37080 (time 1788360038.20 total 520.38 last 85.46) - open/close/unlink 38229 (time 1788360048.22 total 530.39 last 114.72) - open/close/unlink 39371 (time 1788360058.23 total 540.40 last 114.11) - open/close/unlink 40000 (time 1788360062.30 total 544.47 last 154.51) - open/close/unlink 41143 (time 1788360072.31 total 554.49 last 114.12) - open/close/unlink 41968 (time 1788360082.31 total 564.49 last 82.50) - open/close - open/close/unlink 456 (time 1788359528.08 total 10.01 last 45.57) - open/close/unlink 862 (time 1788359538.09 total 20.02 last 40.57) - open/close/unlink 1400 (time 1788359548.09 total 30.02 last 53.76) - open/close/unlink 1911 (time 1788359558.12 total 40.05 last 50.95) - open/close/unlink 2411 (time 1788359568.13 total 50.06 last 49.94) - open/close/unlink 2947 (time 1788359578.15 total 60.09 last 53.49) - open/close/unlink 3469 (time 1788359588.16 total 70.09 last 52.19) - open/close/unlink 3999 (time 1788359598.16 total 80.09 last 52.99) - open/close/unlink 4483 (time 1788359608.16 total 90.09 last 48.40) - open/close/unlink 5009 (time 1788359618.18 total 100.11 last 52.51) - open/close/unlink 5644 (time 1788359628.18 total 110.11 last 63.46) - open/close/unlink 6301 (time 1788359638.19 total 120.12 last 65.64) - open/close/unlink 7020 (time 1788359648.20 total 130.13 last 71.84) - open/close/unlink 7816 (time 1788359658.22 total 140.15 last 79.43) - open/close/unlink 8909 (time 1788359668.22 total 150.15 last 109.29) - open/close/unlink 9922 (time 1788359678.23 total 160.16 last 101.19) - open/close/unlink 10575 (time 1788359688.24 total 170.17 last 65.27) - open/close/unlink 11249 (time 1788359698.24 total 180.17 last 67.35) - open/close/unlink 11925 (time 1788359708.26 total 190.19 last 67.52) - open/close/unlink 12577 (time 1788359718.26 total 200.19 last 65.20) - open/close/unlink 13146 (time 1788359728.29 total 210.22 last 56.74) - open/close/unlink 13807 (time 1788359738.30 total 220.23 last 66.03) - open/close/unlink 14514 (time 1788359748.32 total 230.25 last 70.50) - open/close/unlink 15120 (time 1788359758.34 total 240.27 last 60.53) - open/close/unlink 15931 (time 1788359768.35 total 250.28 last 81.02) - open/close/unlink 16579 (time 1788359778.36 total 260.29 last 64.72) - open/close/unlink 17237 (time 1788359788.37 total 270.30 last 65.71) - open/close/unlink 17820 (time 1788359798.40 total 280.33 last 58.17) - open/close/unlink 18410 (time 1788359808.40 total 290.33 last 59.00) - open/close/unlink 19072 (time 1788359818.41 total 300.34 last 66.13) - open/close/unlink 19869 (time 1788359828.42 total 310.35 last 79.62) - open/close/unlink 20831 (time 1788359838.42 total 320.35 last 96.16) - open/close/unlink 21708 (time 1788359848.42 total 330.35 last 87.70) - open/close/unlink 22406 (time 1788359858.43 total 340.36 last 69.76) - open/close/unlink 23235 (time 1788359868.43 total 350.36 last 82.87) - open/close/unlink 24104 (time 1788359878.44 total 360.37 last 86.83) - open/close/unlink 24953 (time 1788359888.44 total 370.37 last 84.87) - open/close/unlink 25773 (time 1788359898.44 total 380.37 last 81.99) - open/close/unlink 26669 (time 1788359908.44 total 390.37 last 89.60) - open/close/unlink 27580 (time 1788359918.45 total 400.38 last 91.06) - open/close/unlink 28469 (time 1788359928.45 total 410.38 last 88.85) - open/close/unlink 29184 (time 1788359938.48 total 420.41 last 71.32) - open/close/unlink 29922 (time 1788359948.48 total 430.41 last 73.78) - open/close/unlink 30703 (time 1788359958.48 total 440.41 last 78.09) - open/close/unlink 31393 (time 1788359968.49 total 450.42 last 68.94) - open/close/unlink 32088 (time 1788359978.50 total 460.43 last 69.46) - open/close/unlink 32735 (time 1788359988.51 total 470.44 last 64.63) - open/close/unlink 33575 (time 1788359998.52 total 480.45 last 83.95) - open/close/unlink 34471 (time 1788360008.52 total 490.45 last 89.52) - open/close/unlink 35269 (time 1788360018.53 total 500.46 last 79.77) - open/close/unlink 36223 (time 1788360028.54 total 510.47 last 95.34) - open/close/unlink 37085 (time 1788360038.54 total 520.47 last 86.15) - open/close/unlink 38235 (time 1788360048.55 total 530.48 last 114.95) - open/close/unlink 39401 (time 1788360058.55 total 540.48 last 116.55) - open/close/unlink 40000 (time 1788360062.39 total 544.32 last 156.14) - open/close/unlink 41138 (time 1788360072.39 total 554.33 last 113.70) - open/close/unlink 41973 (time 1788360082.40 total 564.33 last 83.48) - open/close - open/close/unlink 454 (time 1788359528.13 total 10.02 last 45.31) - open/close/unlink 869 (time 1788359538.15 total 20.04 last 41.40) - open/close/unlink 1412 (time 1788359548.16 total 30.05 last 54.26) - open/close/unlink 1914 (time 1788359558.17 total 40.07 last 50.13) - open/close/unlink 2408 (time 1788359568.18 total 50.07 last 49.39) - open/close/unlink 2950 (time 1788359578.19 total 60.08 last 54.12) - open/close/unlink 3470 (time 1788359588.20 total 70.09 last 51.96) - open/close/unlink 3987 (time 1788359598.21 total 80.10 last 51.66) - open/close/unlink 4486 (time 1788359608.22 total 90.11 last 49.83) - open/close/unlink 5009 (time 1788359618.25 total 100.15 last 52.14) - open/close/unlink 5649 (time 1788359628.27 total 110.16 last 63.92) - open/close/unlink 6300 (time 1788359638.28 total 120.17 last 65.01) - open/close/unlink 7008 (time 1788359648.29 total 130.18 last 70.76) - open/close/unlink 7802 (time 1788359658.29 total 140.18 last 79.35) - open/close/unlink 8918 (time 1788359668.29 total 150.19 last 111.57) - open/close/unlink 9933 (time 1788359678.30 total 160.19 last 101.41) - open/close/unlink 10592 (time 1788359688.32 total 170.21 last 65.80) - open/close/unlink 11269 (time 1788359698.32 total 180.21 last 67.70) - open/close/unlink 11943 (time 1788359708.32 total 190.21 last 67.38) - open/close/unlink 12605 (time 1788359718.33 total 200.22 last 66.15) - open/close/unlink 13182 (time 1788359728.34 total 210.23 last 57.63) - open/close/unlink 13839 (time 1788359738.34 total 220.23 last 65.68) - open/close/unlink 14535 (time 1788359748.36 total 230.25 last 69.51) - open/close/unlink 15149 (time 1788359758.36 total 240.25 last 61.38) - open/close/unlink 15964 (time 1788359768.37 total 250.26 last 81.40) - open/close/unlink 16608 (time 1788359778.38 total 260.27 last 64.36) - open/close/unlink 17266 (time 1788359788.38 total 270.27 last 65.77) - open/close/unlink 17841 (time 1788359798.40 total 280.29 last 57.43) - open/close/unlink 18436 (time 1788359808.40 total 290.29 last 59.48) - open/close/unlink 19091 (time 1788359818.40 total 300.29 last 65.48) - open/close/unlink 19891 (time 1788359828.41 total 310.30 last 79.90) - open/close/unlink 20837 (time 1788359838.41 total 320.30 last 94.59) - open/close/unlink 21731 (time 1788359848.42 total 330.31 last 89.36) - open/close/unlink 22426 (time 1788359858.43 total 340.32 last 69.44) - open/close/unlink 23254 (time 1788359868.43 total 350.32 last 82.75) - open/close/unlink 24120 (time 1788359878.44 total 360.33 last 86.55) - open/close/unlink 24969 (time 1788359888.44 total 370.33 last 84.86) - open/close/unlink 25779 (time 1788359898.46 total 380.35 last 80.88) - open/close/unlink 26680 (time 1788359908.46 total 390.35 last 90.10) - open/close/unlink 27599 (time 1788359918.46 total 400.35 last 91.88) - open/close/unlink 28481 (time 1788359928.47 total 410.36 last 88.11) - open/close/unlink 29189 (time 1788359938.48 total 420.37 last 70.76) - open/close/unlink 29917 (time 1788359948.48 total 430.37 last 72.77) - open/close/unlink 30684 (time 1788359958.49 total 440.38 last 76.66) - open/close/unlink 31374 (time 1788359968.49 total 450.38 last 68.96) - open/close/unlink 32058 (time 1788359978.50 total 460.39 last 68.37) - open/close/unlink 32711 (time 1788359988.51 total 470.40 last 65.25) - open/close/unlink 33552 (time 1788359998.51 total 480.40 last 84.08) - open/close/unlink 34431 (time 1788360008.52 total 490.42 last 87.76) - open/close/unlink 35234 (time 1788360018.53 total 500.42 last 80.28) - open/close/unlink 36186 (time 1788360028.53 total 510.42 last 95.16) - open/close/unlink 37045 (time 1788360038.54 total 520.43 last 85.83) - open/close/unlink 38195 (time 1788360048.54 total 530.44 last 114.95) - open/close/unlink 39359 (time 1788360058.55 total 540.44 last 116.35) - open/close/unlink 40000 (time 1788360062.69 total 544.58 last 154.79) - open/close/unlink 41119 (time 1788360072.70 total 554.59 last 111.84) - open/close/unlink 41977 (time 1788360082.70 total 564.59 last 85.78) - open/close/unlink 43210 (time 1788360091.77 total 573.85 last 123.08) - open/close/unlink 44356 (time 1788360101.77 total 583.85 last 114.55) - open/close/unlink 45478 (time 1788360111.78 total 593.85 last 112.17) - open/close/unlink 46551 (time 1788360121.78 total 603.86 last 107.25) - open/close/unlink 47562 (time 1788360131.78 total 613.86 last 101.08) - open/close/unlink 48514 (time 1788360141.79 total 623.87 last 95.09) - open/close/unlink 49409 (time 1788360151.80 total 633.88 last 89.44) - open/close/unlink 50000 (time 1788360158.14 total 640.21 last 93.26) - open/close/unlink 50861 (time 1788360168.14 total 650.22 last 86.08) - open/close/unlink 51793 (time 1788360178.15 total 660.23 last 93.11) - open/close/unlink 52653 (time 1788360188.16 total 670.23 last 85.94) - open/close/unlink 53501 (time 1788360198.16 total 680.24 last 84.78) - open/close/unlink 54219 (time 1788360208.16 total 690.24 last 71.78) - open/close/unlink 54901 (time 1788360218.18 total 700.26 last 68.06) - open/close/unlink 55622 (time 1788360228.19 total 710.27 last 72.05) - open/close/unlink 56890 (time 1788360238.19 total 720.27 last 126.76) - open/close/unlink 58087 (time 1788360248.20 total 730.28 last 119.59) - open/close/unlink 59003 (time 1788360258.21 total 740.28 last 91.53) - open/close/unlink 59873 (time 1788360268.21 total 750.29 last 86.97) - open/close/unlink 60931 (time 1788360278.21 total 760.29 last 105.77) - open/close/unlink 61953 (time 1788360288.22 total 770.30 last 102.12) - open/close/unlink 63072 (time 1788360298.23 total 780.31 last 111.80) - open/close/unlink 63787 (time 1788360308.24 total 790.31 last 71.45) - open/close/unlink 64688 (time 1788360318.25 total 800.32 last 90.02) total: 64768 open/close/unlink in 801.18 seconds: 80.84 ops/second /unlink 43206 (time 1788360092.10 total 574.48 last 123.31) - open/close/unlink 44349 (time 1788360102.10 total 584.48 last 114.26) - open/close/unlink 45461 (time 1788360112.11 total 594.49 last 111.13) - open/close/unlink 46538 (time 1788360122.12 total 604.50 last 107.55) - open/close/unlink 47548 (time 1788360132.13 total 614.51 last 100.94) - open/close/unlink 48487 (time 1788360142.13 total 624.51 last 93.87) - open/close/unlink 49382 (time 1788360152.13 total 634.51 last 89.47) - open/close/unlink 50000 (time 1788360158.89 total 641.27 last 91.40) - open/close/unlink 50857 (time 1788360168.90 total 651.28 last 85.64) - open/close/unlink 51762 (time 1788360178.91 total 661.29 last 90.44) - open/close/unlink 52637 (time 1788360188.92 total 671.29 last 87.43) - open/close/unlink 53473 (time 1788360198.92 total 681.30 last 83.56) - open/close/unlink 54157 (time 1788360208.93 total 691.31 last 68.36) - open/close/unlink 54847 (time 1788360218.93 total 701.31 last 68.99) - open/close/unlink 55578 (time 1788360228.94 total 711.32 last 73.00) - open/close/unlink 56889 (time 1788360238.95 total 721.32 last 131.05) - open/close/unlink 58059 (time 1788360248.95 total 731.33 last 116.97) - open/close/unlink 58967 (time 1788360258.95 total 741.33 last 90.75) - open/close/unlink 59866 (time 1788360268.96 total 751.34 last 89.85) - open/close/unlink 60901 (time 1788360278.97 total 761.35 last 103.44) - open/close/unlink 61958 (time 1788360288.97 total 771.35 last 105.68) - open/close/unlink 63034 (time 1788360298.97 total 781.35 last 107.54) - open/close/unlink 63747 (time 1788360308.97 total 791.35 last 71.30) - open/close/unlink 64669 (time 1788360318.99 total 801.36 last 92.09) total: 64768 open/close/unlink in 804.03 seconds: 80.55 ops/second /unlink 43198 (time 1788360092.40 total 574.33 last 122.46) - open/close/unlink 44339 (time 1788360102.40 total 584.33 last 114.06) - open/close/unlink 45448 (time 1788360112.41 total 594.34 last 110.89) - open/close/unlink 46519 (time 1788360122.41 total 604.34 last 107.09) - open/close/unlink 47552 (time 1788360132.41 total 614.34 last 103.28) - open/close/unlink 48474 (time 1788360142.41 total 624.34 last 92.16) - open/close/unlink 49368 (time 1788360152.42 total 634.35 last 89.31) - open/close/unlink 50000 (time 1788360159.10 total 641.03 last 94.62) - open/close/unlink 50858 (time 1788360169.11 total 651.04 last 85.73) - open/close/unlink 51769 (time 1788360179.12 total 661.05 last 90.98) - open/close/unlink 52644 (time 1788360189.13 total 671.06 last 87.48) - open/close/unlink 53478 (time 1788360199.13 total 681.06 last 83.36) - open/close/unlink 54151 (time 1788360209.13 total 691.06 last 67.29) - open/close/unlink 54847 (time 1788360219.16 total 701.09 last 69.42) - open/close/unlink 55576 (time 1788360229.17 total 711.10 last 72.83) - open/close/unlink 56903 (time 1788360239.18 total 721.11 last 132.56) - open/close/unlink 58081 (time 1788360249.18 total 731.11 last 117.71) - open/close/unlink 58984 (time 1788360259.19 total 741.12 last 90.21) - open/close/unlink 59875 (time 1788360269.20 total 751.13 last 89.04) - open/close/unlink 60908 (time 1788360279.21 total 761.14 last 103.22) - open/close/unlink 61987 (time 1788360289.21 total 771.14 last 107.89) - open/close/unlink 63033 (time 1788360299.21 total 781.14 last 104.56) - open/close/unlink 63753 (time 1788360309.22 total 791.15 last 71.98) - open/close/unlink 64670 (time 1788360319.23 total 801.16 last 91.58) total: 64768 open/close/unlink in 804.06 seconds: 80.55 ops/second /unlink 43195 (time 1788360092.32 total 574.49 last 122.66) - open/close/unlink 44328 (time 1788360102.32 total 584.50 last 113.24) - open/close/unlink 45433 (time 1788360112.35 total 594.53 last 110.14) - open/close/unlink 46501 (time 1788360122.37 total 604.55 last 106.61) - open/close/unlink 47522 (time 1788360132.38 total 614.55 last 102.06) - open/close/unlink 48445 (time 1788360142.38 total 624.55 last 92.30) - open/close/unlink 49341 (time 1788360152.38 total 634.55 last 89.56) - open/close/unlink 50000 (time 1788360159.32 total 641.49 last 94.96) - open/close/unlink 50845 (time 1788360169.33 total 651.50 last 84.45) - open/close/unlink 51749 (time 1788360179.33 total 661.50 last 90.37) - open/close/unlink 52636 (time 1788360189.34 total 671.51 last 88.65) - open/close/unlink 53468 (time 1788360199.34 total 681.51 last 83.18) - open/close/unlink 54141 (time 1788360209.34 total 691.51 last 67.28) - open/close/unlink 54841 (time 1788360219.34 total 701.52 last 69.99) - open/close/unlink 55576 (time 1788360229.35 total 711.52 last 73.47) - open/close/unlink 56912 (time 1788360239.35 total 721.53 last 133.51) - open/close/unlink 58073 (time 1788360249.36 total 731.53 last 116.05) - open/close/unlink 58962 (time 1788360259.37 total 741.54 last 88.81) - open/close/unlink 59878 (time 1788360269.38 total 751.55 last 91.48) - open/close/unlink 60899 (time 1788360279.39 total 761.56 last 102.06) - open/close/unlink 61982 (time 1788360289.39 total 771.57 last 108.21) - open/close/unlink 63020 (time 1788360299.40 total 781.57 last 103.78) - open/close/unlink 63746 (time 1788360309.41 total 791.58 last 72.53) - open/close/unlink 64655 (time 1788360319.42 total 801.59 last 90.76) total: 64768 open/close/unlink in 804.75 seconds: 80.48 ops/second /unlink 43193 (time 1788360092.70 total 574.59 last 121.57) - open/close/unlink 44339 (time 1788360102.70 total 584.60 last 114.56) - open/close/unlink 45431 (time 1788360112.71 total 594.60 last 109.16) - open/close/unlink 46497 (time 1788360122.72 total 604.61 last 106.45) - open/close/unlink 47539 (time 1788360132.72 total 614.61 last 104.19) - open/close/unlink 48456 (time 1788360142.73 total 624.62 last 91.67) - open/close/unlink 49345 (time 1788360152.73 total 634.62 last 88.84) - open/close/unlink 50000 (time 1788360159.55 total 641.44 last 96.11) - open/close/unlink 50840 (time 1788360169.55 total 651.45 last 83.94) - open/close/unlink 51741 (time 1788360179.56 total 661.45 last 90.05) - open/close/unlink 52624 (time 1788360189.57 total 671.46 last 88.25) - open/close/unlink 53451 (time 1788360199.57 total 681.46 last 82.67) - open/close/unlink 54120 (time 1788360209.58 total 691.48 last 66.81) - open/close/unlink 54832 (time 1788360219.59 total 701.49 last 71.12) - open/close/unlink 55554 (time 1788360229.60 total 711.50 last 72.13) - open/close/unlink 56895 (time 1788360239.63 total 721.52 last 133.80) - open/close/unlink 58056 (time 1788360249.63 total 731.53 last 116.00) - open/close/unlink 58945 (time 1788360259.65 total 741.54 last 88.80) - open/close/unlink 59877 (time 1788360269.65 total 751.54 last 93.15) - open/close/unlink 60874 (time 1788360279.66 total 761.55 last 99.63) - open/close/unlink 61949 (time 1788360289.66 total 771.55 last 107.45) - open/close/unlink 62996 (time 1788360299.68 total 781.57 last 104.53) - open/close/unlink 63705 (time 1788360309.68 total 791.57 last 70.90) - open/close/unlink 64601 (time 1788360319.68 total 801.57 last 89.59) total: 64768 open/close/unlink in 805.81 seconds: 80.38 ops/second Waiting for MDT destroys to complete oleg228-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg228-client: oleg228-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg228-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg228-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg228-server stop mds service on oleg228-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg228-server stop mds service on oleg228-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg228-server unloading modules via unload_modules_local on: 'oleg228-server' oleg228-server: oleg228-server.virtnet: executing unload_modules_local oleg228-server: modules unloaded. pdsh@oleg228-client: oleg228-server: ssh exited with exit code 2 pdsh@oleg228-client: oleg228-client: ssh exited with exit code 2 pdsh@oleg228-client: oleg228-client: ssh exited with exit code 2 pdsh@oleg228-client: oleg228-server: ssh exited with exit code 2 PASS 106 (901s) Stopping clients: oleg228-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg228-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg228-client: oleg228-server: ssh exited with exit code 2 oleg228-server: oleg228-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg228-server' oleg228-server: oleg228-server.virtnet: executing load_modules_local oleg228-server: Loading modules from /home/green/git/lustre-release/lustre oleg228-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg228-server: detected 4 online CPUs by sysfs oleg228-server: MODOPTS_LIBCFS= oleg228-server: Force libcfs to create 2 CPU partitions oleg228-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg228-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg228-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 1129 sec ========== 10:46:46 (1788360406) === conf-sanity: start cleanup 10:46:47 (1788360407) === === conf-sanity: finish cleanup 10:46:49 (1788360409) ===