-----============= acceptance-small: conf-sanity ============----- Tue Sep 1 09:29:28 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg355-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683218 >= 34553653) for LU-16938, go 81 - see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683218 >= 34554143) for LU-18348, go 32b 32c - see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683218 >= 34617107) for LU-17920, go 123ae 123ag excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg355-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg355-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg355-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg355-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg355-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg355-server oleg355-server: oleg355-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg355-server' oleg355-server: oleg355-server.virtnet: executing load_modules_local oleg355-server: Loading modules from /home/green/git/lustre-release/lustre oleg355-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg355-server: detected 4 online CPUs by sysfs oleg355-server: MODOPTS_LIBCFS= oleg355-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg355-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg355-server: oleg355-server.virtnet: executing set_default_debug -1 all pdsh@oleg355-client: oleg355-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg355-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg355-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg355-server: oleg355-server.virtnet: executing set_default_debug -1 all pdsh@oleg355-client: oleg355-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg355-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg355-server: oleg355-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg355-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg355-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg355-server stop mds service on oleg355-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg355-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 09:31:08 (1788269468) start mds service on oleg355-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg355-server: oleg355-server.virtnet: executing set_default_debug -1 all pdsh@oleg355-client: oleg355-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg355-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg355-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg355-server: oleg355-server.virtnet: executing set_default_debug -1 all pdsh@oleg355-client: oleg355-server: ssh exited with exit code 1 Started lustre-OST0000 oleg355-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg355-client.virtnet: -o user_xattr,flock 192.168.203.155@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12329 425 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 704 (time 1788269515.49 total 10.00 last 70.39) - open/close/unlink 1272 (time 1788269525.49 total 20.01 last 56.77) - open/close/unlink 1757 (time 1788269535.52 total 30.03 last 48.39) - open/close/unlink 2481 (time 1788269545.52 total 40.03 last 72.37) - open/close/unlink 3101 (time 1788269555.53 total 50.04 last 61.96) - open/close/unlink 3698 (time 1788269565.53 total 60.05 last 59.67) - open/close/unlink 4264 (time 1788269575.57 total 70.08 last 56.41) - open/close/unlink 4766 (time 1788269585.58 total 80.09 last 50.14) - open/close/unlink 5278 (time 1788269595.59 total 90.10 last 51.14) - open/close/unlink 5737 (time 1788269605.60 total 100.12 last 45.84) - open/close/unlink 6161 (time 1788269615.61 total 110.12 last 42.37) - open/close/unlink 6634 (time 1788269625.61 total 120.12 last 47.29) - open/close/unlink 7126 (time 1788269635.62 total 130.13 last 49.17) - open/close/unlink 7670 (time 1788269645.62 total 140.13 last 54.38) - open/close/unlink 8336 (time 1788269655.64 total 150.16 last 66.47) - open/close/unlink 9047 (time 1788269665.64 total 160.16 last 71.09) - open/close/unlink 9669 (time 1788269675.65 total 170.16 last 62.15) - open/close/unlink 10000 (time 1788269680.22 total 174.73 last 72.43) - open/close/unlink 10551 (time 1788269690.23 total 184.74 last 55.07) - open/close/unlink 11193 (time 1788269700.25 total 194.76 last 64.07) - open/close/unlink 11882 (time 1788269710.25 total 204.76 last 68.87) - open/close/unlink 12676 (time 1788269720.26 total 214.77 last 79.36) - open/close/unlink 13545 (time 1788269730.27 total 224.78 last 86.83) - open/close/unlink 14192 (time 1788269740.27 total 234.78 last 64.66) - open/close/unlink 14997 (time 1788269750.27 total 244.79 last 80.48) - open/close/unlink 15721 (time 1788269760.29 total 254.80 last 72.31) - open/close/unlink 16415 (time 1788269770.30 total 264.82 last 69.28) - open/close/unlink 17111 (time 1788269780.31 total 274.83 last 69.54) - open/close/unlink 17766 (time 1788269790.32 total 284.84 last 65.43) - open/close/unlink 18443 (time 1788269800.34 total 294.86 last 67.57) - open/close/unlink 19178 (time 1788269810.35 total 304.86 last 73.46) - open/close/unlink 19831 (time 1788269820.35 total 314.87 last 65.26) - open/close/unlink 20000 (time 1788269823.21 total 317.73 last 59.11) - open/close/unlink 20619 (time 1788269833.23 total 327.75 last 61.77) - open/close/unlink 21324 (time 1788269843.25 total 337.76 last 70.42) - open/close/unlink 22049 (time 1788269853.25 total 347.77 last 72.43) - open/close/unlink 22853 (time 1788269863.26 total 357.78 last 80.32) - open/close/unlink 23452 (time 1788269873.27 total 367.78 last 59.86) - open/close/unlink 24158 (time 1788269883.28 total 377.79 last 70.56) - open/close/unlink 24790 (time 1788269893.29 total 387.80 last 63.10) - open/close/unlink 25543 (time 1788269903.30 total 397.81 last 75.24) - open/close/unlink 26283 (time 1788269913.31 total 407.82 last 73.93) - open/close/unlink 26972 (time 1788269923.31 total 417.82 last 68.88) - open/close/unlink 27806 (time 1788269933.31 total 427.83 last 83.38) - open/close/unlink 28691 (time 1788269943.32 total 437.83 last 88.44) - open/close/unlink 29534 (time 1788269953.33 total 447.84 last 84.25) - open/close/unlink 30000 (time 1788269958.85 total 453.36 last 84.40) - open/close/unlink 30895 (time 1788269968.86 total 463.37 last 89.42) - open/close/unlink 31629 (time 1788269978.86 total 473.38 last 73.35) - open/close/unlink 32397 (time 1788269988.88 total 483.39 last 76.69) - open/close/unlink 33140 (time 1788269998.88 total 493.39 last 74.27) - open/close/unlink 34005 (time 1788270008.88 total 503.40 last 86.47) - open/close/unlink 34802 (time 1788270018.89 total 513.40 last 79.65) - open/close/unlink 35594 (time 1788270028.90 total 523.41 last 79.12) - open/close/unlink 36443 (time 1788270038.92 total 533.43 last 84.77) - open/close/unlink 37248 (time 1788270048.92 total 543.43 last 80.45) - open/close/unlink 38205 (time 1788270058.93 total 553.44 last 95.66) - open/close/unlin - open/close/unlink 710 (time 1788269515.30 total 10.00 last 70.99) - open/close/unlink 1290 (time 1788269525.31 total 20.01 last 57.94) - open/close/unlink 1776 (time 1788269535.32 total 30.02 last 48.56) - open/close/unlink 2483 (time 1788269545.32 total 40.03 last 70.67) - open/close/unlink 3114 (time 1788269555.34 total 50.04 last 63.00) - open/close/unlink 3705 (time 1788269565.34 total 60.05 last 59.07) - open/close/unlink 4277 (time 1788269575.34 total 70.05 last 57.19) - open/close/unlink 4784 (time 1788269585.36 total 80.06 last 50.64) - open/close/unlink 5296 (time 1788269595.38 total 90.08 last 51.09) - open/close/unlink 5755 (time 1788269605.40 total 100.10 last 45.80) - open/close/unlink 6177 (time 1788269615.41 total 110.11 last 42.16) - open/close/unlink 6657 (time 1788269625.42 total 120.12 last 47.96) - open/close/unlink 7144 (time 1788269635.44 total 130.14 last 48.61) - open/close/unlink 7684 (time 1788269645.44 total 140.14 last 54.00) - open/close/unlink 8336 (time 1788269655.44 total 150.14 last 65.20) - open/close/unlink 9031 (time 1788269665.44 total 160.15 last 69.45) - open/close/unlink 9664 (time 1788269675.45 total 170.15 last 63.29) - open/close/unlink 10000 (time 1788269680.08 total 174.78 last 72.53) - open/close/unlink 10555 (time 1788269690.10 total 184.80 last 55.37) - open/close/unlink 11203 (time 1788269700.12 total 194.82 last 64.70) - open/close/unlink 11883 (time 1788269710.12 total 204.83 last 67.97) - open/close/unlink 12659 (time 1788269720.12 total 214.83 last 77.60) - open/close/unlink 13525 (time 1788269730.13 total 224.83 last 86.55) - open/close/unlink 14173 (time 1788269740.13 total 234.83 last 64.78) - open/close/unlink 14971 (time 1788269750.14 total 244.84 last 79.76) - open/close/unlink 15705 (time 1788269760.16 total 254.86 last 73.22) - open/close/unlink 16400 (time 1788269770.19 total 264.89 last 69.32) - open/close/unlink 17088 (time 1788269780.19 total 274.89 last 68.78) - open/close/unlink 17753 (time 1788269790.20 total 284.90 last 66.43) - open/close/unlink 18430 (time 1788269800.22 total 294.92 last 67.59) - open/close/unlink 19146 (time 1788269810.22 total 304.92 last 71.56) - open/close/unlink 19809 (time 1788269820.22 total 314.93 last 66.28) - open/close/unlink 20000 (time 1788269823.47 total 318.17 last 58.88) - open/close/unlink 20612 (time 1788269833.48 total 328.18 last 61.13) - open/close/unlink 21337 (time 1788269843.48 total 338.18 last 72.49) - open/close/unlink 22070 (time 1788269853.49 total 348.19 last 73.24) - open/close/unlink 22868 (time 1788269863.50 total 358.20 last 79.74) - open/close/unlink 23466 (time 1788269873.51 total 368.21 last 59.74) - open/close/unlink 24173 (time 1788269883.51 total 378.21 last 70.67) - open/close/unlink 24803 (time 1788269893.51 total 388.22 last 62.98) - open/close/unlink 25561 (time 1788269903.52 total 398.22 last 75.76) - open/close/unlink 26291 (time 1788269913.54 total 408.24 last 72.86) - open/close/unlink 26993 (time 1788269923.54 total 418.24 last 70.17) - open/close/unlink 27837 (time 1788269933.55 total 428.25 last 84.34) - open/close/unlink 28727 (time 1788269943.55 total 438.26 last 88.96) - open/close/unlink 29548 (time 1788269953.56 total 448.26 last 82.07) - open/close/unlink 30000 (time 1788269958.92 total 453.62 last 84.28) - open/close/unlink 30907 (time 1788269968.93 total 463.63 last 90.62) - open/close/unlink 31636 (time 1788269978.93 total 473.63 last 72.89) - open/close/unlink 32414 (time 1788269988.94 total 483.64 last 77.73) - open/close/unlink 33152 (time 1788269998.94 total 493.64 last 73.79) - open/close/unlink 34014 (time 1788270008.95 total 503.65 last 86.11) - open/close/unlink 34815 (time 1788270018.96 total 513.66 last 80.05) - open/close/unlink 35604 (time 1788270028.97 total 523.68 last 78.76) - open/close/unlink 36448 (time 1788270038.98 total 533.68 last 84.37) - open/close/unlink 37264 (time 1788270048.99 total 543.69 last 81.51) - open/close/unlink 38219 (time 1788270058.99 total 553.70 last 95.45) - open/close/unlin - open/close/unlink 709 (time 1788269515.31 total 10.01 last 70.84) - open/close/unlink 1288 (time 1788269525.32 total 20.03 last 57.79) - open/close/unlink 1772 (time 1788269535.35 total 30.05 last 48.30) - open/close/unlink 2480 (time 1788269545.35 total 40.05 last 70.80) - open/close/unlink 3112 (time 1788269555.35 total 50.06 last 63.15) - open/close/unlink 3708 (time 1788269565.36 total 60.06 last 59.55) - open/close/unlink 4278 (time 1788269575.36 total 70.06 last 57.00) - open/close/unlink 4778 (time 1788269585.36 total 80.07 last 49.99) - open/close/unlink 5282 (time 1788269595.37 total 90.07 last 50.36) - open/close/unlink 5735 (time 1788269605.38 total 100.08 last 45.27) - open/close/unlink 6158 (time 1788269615.39 total 110.10 last 42.23) - open/close/unlink 6639 (time 1788269625.42 total 120.12 last 47.98) - open/close/unlink 7126 (time 1788269635.44 total 130.14 last 48.59) - open/close/unlink 7674 (time 1788269645.46 total 140.16 last 54.73) - open/close/unlink 8332 (time 1788269655.47 total 150.17 last 65.72) - open/close/unlink 9031 (time 1788269665.47 total 160.17 last 69.86) - open/close/unlink 9662 (time 1788269675.48 total 170.18 last 63.07) - open/close/unlink 10000 (time 1788269680.26 total 174.96 last 70.67) - open/close/unlink 10549 (time 1788269690.26 total 184.97 last 54.88) - open/close/unlink 11188 (time 1788269700.30 total 195.00 last 63.67) - open/close/unlink 11873 (time 1788269710.32 total 205.02 last 68.36) - open/close/unlink 12655 (time 1788269720.33 total 215.03 last 78.11) - open/close/unlink 13531 (time 1788269730.34 total 225.04 last 87.51) - open/close/unlink 14170 (time 1788269740.34 total 235.05 last 63.89) - open/close/unlink 14979 (time 1788269750.34 total 245.05 last 80.89) - open/close/unlink 15712 (time 1788269760.35 total 255.05 last 73.24) - open/close/unlink 16398 (time 1788269770.37 total 265.07 last 68.50) - open/close/unlink 17098 (time 1788269780.37 total 275.07 last 69.99) - open/close/unlink 17751 (time 1788269790.39 total 285.09 last 65.17) - open/close/unlink 18431 (time 1788269800.40 total 295.10 last 67.94) - open/close/unlink 19160 (time 1788269810.40 total 305.10 last 72.90) - open/close/unlink 19819 (time 1788269820.40 total 315.11 last 65.85) - open/close/unlink 20000 (time 1788269823.52 total 318.22 last 58.19) - open/close/unlink 20614 (time 1788269833.52 total 328.23 last 61.34) - open/close/unlink 21335 (time 1788269843.53 total 338.23 last 72.08) - open/close/unlink 22070 (time 1788269853.53 total 348.23 last 73.47) - open/close/unlink 22875 (time 1788269863.54 total 358.24 last 80.47) - open/close/unlink 23477 (time 1788269873.54 total 368.25 last 60.15) - open/close/unlink 24170 (time 1788269883.56 total 378.26 last 69.18) - open/close/unlink 24793 (time 1788269893.58 total 388.28 last 62.18) - open/close/unlink 25559 (time 1788269903.59 total 398.29 last 76.56) - open/close/unlink 26297 (time 1788269913.59 total 408.29 last 73.78) - open/close/unlink 26997 (time 1788269923.59 total 418.29 last 69.98) - open/close/unlink 27829 (time 1788269933.60 total 428.30 last 83.12) - open/close/unlink 28719 (time 1788269943.61 total 438.31 last 88.94) - open/close/unlink 29549 (time 1788269953.62 total 448.32 last 82.89) - open/close/unlink 30000 (time 1788269958.96 total 453.66 last 84.53) - open/close/unlink 30914 (time 1788269968.97 total 463.67 last 91.31) - open/close/unlink 31645 (time 1788269978.98 total 473.68 last 73.02) - open/close/unlink 32419 (time 1788269988.99 total 483.69 last 77.34) - open/close/unlink 33159 (time 1788269998.99 total 493.69 last 74.00) - open/close/unlink 34020 (time 1788270009.00 total 503.70 last 86.00) - open/close/unlink 34826 (time 1788270019.01 total 513.72 last 80.47) - open/close/unlink 35620 (time 1788270029.02 total 523.72 last 79.39) - open/close/unlink 36465 (time 1788270039.02 total 533.72 last 84.49) - open/close/unlink 37286 (time 1788270049.02 total 543.72 last 82.06) - open/close/unlink 38242 (time 1788270059.02 total 553.72 last 95.59) - open/close/unlin - open/close/unlink 704 (time 1788269515.45 total 10.01 last 70.36) - open/close/unlink 1281 (time 1788269525.47 total 20.03 last 57.58) - open/close/unlink 1763 (time 1788269535.49 total 30.04 last 48.12) - open/close/unlink 2477 (time 1788269545.49 total 40.05 last 71.35) - open/close/unlink 3103 (time 1788269555.52 total 50.07 last 62.46) - open/close/unlink 3706 (time 1788269565.52 total 60.07 last 60.29) - open/close/unlink 4281 (time 1788269575.52 total 70.08 last 57.47) - open/close/unlink 4780 (time 1788269585.55 total 80.11 last 49.76) - open/close/unlink 5286 (time 1788269595.57 total 90.13 last 50.50) - open/close/unlink 5745 (time 1788269605.58 total 100.13 last 45.88) - open/close/unlink 6167 (time 1788269615.58 total 110.14 last 42.17) - open/close/unlink 6648 (time 1788269625.59 total 120.14 last 48.08) - open/close/unlink 7137 (time 1788269635.59 total 130.15 last 48.89) - open/close/unlink 7682 (time 1788269645.61 total 140.16 last 54.40) - open/close/unlink 8329 (time 1788269655.61 total 150.17 last 64.66) - open/close/unlink 9028 (time 1788269665.62 total 160.17 last 69.89) - open/close/unlink 9652 (time 1788269675.62 total 170.18 last 62.34) - open/close/unlink 10000 (time 1788269680.55 total 175.11 last 70.62) - open/close/unlink 10553 (time 1788269690.56 total 185.12 last 55.25) - open/close/unlink 11210 (time 1788269700.58 total 195.14 last 65.58) - open/close/unlink 11887 (time 1788269710.60 total 205.16 last 67.55) - open/close/unlink 12683 (time 1788269720.60 total 215.16 last 79.59) - open/close/unlink 13549 (time 1788269730.60 total 225.16 last 86.60) - open/close/unlink 14174 (time 1788269740.61 total 235.16 last 62.49) - open/close/unlink 14993 (time 1788269750.61 total 245.16 last 81.89) - open/close/unlink 15712 (time 1788269760.61 total 255.17 last 71.85) - open/close/unlink 16414 (time 1788269770.61 total 265.17 last 70.19) - open/close/unlink 17104 (time 1788269780.62 total 275.17 last 68.99) - open/close/unlink 17756 (time 1788269790.62 total 285.17 last 65.18) - open/close/unlink 18439 (time 1788269800.62 total 295.18 last 68.27) - open/close/unlink 19185 (time 1788269810.64 total 305.19 last 74.49) - open/close/unlink 19837 (time 1788269820.64 total 315.20 last 65.18) - open/close/unlink 20000 (time 1788269823.39 total 317.95 last 59.20) - open/close/unlink 20606 (time 1788269833.40 total 327.96 last 60.55) - open/close/unlink 21321 (time 1788269843.41 total 337.97 last 71.43) - open/close/unlink 22050 (time 1788269853.43 total 347.99 last 72.77) - open/close/unlink 22858 (time 1788269863.43 total 357.99 last 80.77) - open/close/unlink 23449 (time 1788269873.44 total 368.00 last 59.06) - open/close/unlink 24159 (time 1788269883.45 total 378.00 last 70.97) - open/close/unlink 24791 (time 1788269893.46 total 388.01 last 63.12) - open/close/unlink 25549 (time 1788269903.46 total 398.02 last 75.77) - open/close/unlink 26279 (time 1788269913.47 total 408.02 last 72.95) - open/close/unlink 26979 (time 1788269923.48 total 418.03 last 69.95) - open/close/unlink 27809 (time 1788269933.48 total 428.04 last 82.94) - open/close/unlink 28697 (time 1788269943.49 total 438.04 last 88.76) - open/close/unlink 29535 (time 1788269953.49 total 448.04 last 83.78) - open/close/unlink 30000 (time 1788269959.05 total 453.60 last 83.63) - open/close/unlink 30914 (time 1788269969.06 total 463.61 last 91.33) - open/close/unlink 31648 (time 1788269979.06 total 473.61 last 73.39) - open/close/unlink 32419 (time 1788269989.07 total 483.62 last 77.01) - open/close/unlink 33158 (time 1788269999.07 total 493.63 last 73.88) - open/close/unlink 34015 (time 1788270009.08 total 503.64 last 85.62) - open/close/unlink 34818 (time 1788270019.08 total 513.64 last 80.29) - open/close/unlink 35609 (time 1788270029.09 total 523.64 last 79.07) - open/close/unlink 36461 (time 1788270039.09 total 533.65 last 85.13) - open/close/unlink 37273 (time 1788270049.10 total 543.65 last 81.17) - open/close/unlink 38229 (time 1788270059.11 total 553.66 last 95.50) - open/close/unlin - open/close/unlink 709 (time 1788269515.42 total 10.00 last 70.88) - open/close/unlink 1280 (time 1788269525.43 total 20.00 last 57.09) - open/close/unlink 1767 (time 1788269535.44 total 30.02 last 48.64) - open/close/unlink 2485 (time 1788269545.44 total 40.02 last 71.78) - open/close/unlink 3114 (time 1788269555.45 total 50.03 last 62.83) - open/close/unlink 3708 (time 1788269565.47 total 60.05 last 59.31) - open/close/unlink 4276 (time 1788269575.47 total 70.05 last 56.78) - open/close/unlink 4773 (time 1788269585.48 total 80.06 last 49.67) - open/close/unlink 5276 (time 1788269595.50 total 90.07 last 50.21) - open/close/unlink 5737 (time 1788269605.50 total 100.08 last 46.09) - open/close/unlink 6153 (time 1788269615.50 total 110.08 last 41.60) - open/close/unlink 6632 (time 1788269625.51 total 120.09 last 47.86) - open/close/unlink 7127 (time 1788269635.51 total 130.09 last 49.48) - open/close/unlink 7674 (time 1788269645.53 total 140.11 last 54.60) - open/close/unlink 8327 (time 1788269655.53 total 150.11 last 65.27) - open/close/unlink 9024 (time 1788269665.54 total 160.12 last 69.67) - open/close/unlink 9650 (time 1788269675.54 total 170.12 last 62.60) - open/close/unlink 10000 (time 1788269680.50 total 175.07 last 70.62) - open/close/unlink 10549 (time 1788269690.50 total 185.07 last 54.90) - open/close/unlink 11192 (time 1788269700.50 total 195.08 last 64.29) - open/close/unlink 11867 (time 1788269710.55 total 205.13 last 67.12) - open/close/unlink 12661 (time 1788269720.55 total 215.13 last 79.39) - open/close/unlink 13532 (time 1788269730.56 total 225.14 last 87.06) - open/close/unlink 14160 (time 1788269740.58 total 235.16 last 62.69) - open/close/unlink 14975 (time 1788269750.59 total 245.17 last 81.41) - open/close/unlink 15693 (time 1788269760.60 total 255.18 last 71.73) - open/close/unlink 16391 (time 1788269770.60 total 265.18 last 69.76) - open/close/unlink 17086 (time 1788269780.61 total 275.19 last 69.45) - open/close/unlink 17737 (time 1788269790.62 total 285.20 last 65.01) - open/close/unlink 18417 (time 1788269800.64 total 295.22 last 67.87) - open/close/unlink 19153 (time 1788269810.65 total 305.23 last 73.56) - open/close/unlink 19801 (time 1788269820.65 total 315.23 last 64.80) - open/close/unlink 20000 (time 1788269824.18 total 318.76 last 56.39) - open/close/unlink 20613 (time 1788269834.18 total 328.76 last 61.30) - open/close/unlink 21348 (time 1788269844.20 total 338.77 last 73.37) - open/close/unlink 22080 (time 1788269854.20 total 348.78 last 73.16) - open/close/unlink 22867 (time 1788269864.20 total 358.78 last 78.69) - open/close/unlink 23477 (time 1788269874.21 total 368.79 last 60.95) - open/close/unlink 24179 (time 1788269884.22 total 378.80 last 70.14) - open/close/unlink 24826 (time 1788269894.23 total 388.81 last 64.64) - open/close/unlink 25597 (time 1788269904.23 total 398.81 last 77.06) - open/close/unlink 26312 (time 1788269914.24 total 408.82 last 71.46) - open/close/unlink 27033 (time 1788269924.24 total 418.82 last 72.08) - open/close/unlink 27860 (time 1788269934.25 total 428.83 last 82.62) - open/close/unlink 28748 (time 1788269944.26 total 438.84 last 88.74) - open/close/unlink 29567 (time 1788269954.27 total 448.85 last 81.82) - open/close/unlink 30000 (time 1788269959.35 total 453.93 last 85.17) - open/close/unlink 30913 (time 1788269969.36 total 463.94 last 91.25) - open/close/unlink 31633 (time 1788269979.36 total 473.94 last 71.96) - open/close/unlink 32417 (time 1788269989.37 total 483.95 last 78.32) - open/close/unlink 33158 (time 1788269999.39 total 493.97 last 74.00) - open/close/unlink 34027 (time 1788270009.40 total 503.98 last 86.81) - open/close/unlink 34824 (time 1788270019.41 total 513.98 last 79.64) - open/close/unlink 35609 (time 1788270029.41 total 523.99 last 78.45) - open/close/unlink 36461 (time 1788270039.41 total 533.99 last 85.19) - open/close/unlink 37279 (time 1788270049.42 total 544.00 last 81.76) - open/close/unlink 38233 (time 1788270059.43 total 554.01 last 95.31) - open/close/unlink 39184 (time 1788270069.04 total 563.74 last 94.01) - open/close/unlink 40000 (time 1788270077.80 total 572.50 last 93.15) - open/close/unlink 40915 (time 1788270087.81 total 582.51 last 91.43) - open/close/unlink 41947 (time 1788270097.81 total 592.51 last 103.19) - open/close/unlink 43085 (time 1788270107.82 total 602.52 last 113.68) - open/close/unlink 44239 (time 1788270117.82 total 612.52 last 115.38) - open/close/unlink 45311 (time 1788270127.83 total 622.53 last 107.11) - open/close/unlink 46413 (time 1788270137.84 total 632.54 last 110.15) - open/close/unlink 47618 (time 1788270147.84 total 642.54 last 120.49) - open/close/unlink 48956 (time 1788270157.84 total 652.54 last 133.74) - open/close/unlink 50000 (time 1788270166.40 total 661.10 last 122.02) - open/close/unlink 51278 (time 1788270176.40 total 671.10 last 127.79) - open/close/unlink 52519 (time 1788270186.40 total 681.11 last 124.03) - open/close/unlink 53861 (time 1788270196.41 total 691.11 last 134.15) - open/close/unlink 55001 (time 1788270206.41 total 701.12 last 113.93) - open/close/unlink 56192 (time 1788270216.41 total 711.12 last 119.09) - open/close/unlink 57434 (time 1788270226.42 total 721.12 last 124.12) - open/close/unlink 58750 (time 1788270236.42 total 731.12 last 131.59) - open/close/unlink 60000 (time 1788270245.11 total 739.81 last 143.91) - open/close/unlink 61302 (time 1788270255.11 total 749.81 last 130.16) - open/close/unlink 62555 (time 1788270265.12 total 759.82 last 125.22) - open/close/unlink 63948 (time 1788270275.12 total 769.82 last 139.26) total: 64768 open/close/unlink in 776.78 seconds: 83.38 ops/second k 39172 (time 1788270069.11 total 563.67 last 94.27) - open/close/unlink 40000 (time 1788270077.90 total 572.45 last 94.25) - open/close/unlink 40906 (time 1788270087.90 total 582.46 last 90.52) - open/close/unlink 41942 (time 1788270097.91 total 592.46 last 103.57) - open/close/unlink 43069 (time 1788270107.91 total 602.47 last 112.63) - open/close/unlink 44222 (time 1788270117.92 total 612.48 last 115.22) - open/close/unlink 45293 (time 1788270127.93 total 622.49 last 107.00) - open/close/unlink 46387 (time 1788270137.94 total 632.50 last 109.28) - open/close/unlink 47616 (time 1788270147.94 total 642.50 last 122.88) - open/close/unlink 48955 (time 1788270157.94 total 652.50 last 133.90) - open/close/unlink 50000 (time 1788270166.54 total 661.10 last 121.51) - open/close/unlink 51289 (time 1788270176.54 total 671.10 last 128.87) - open/close/unlink 52555 (time 1788270186.55 total 681.10 last 126.57) - open/close/unlink 53895 (time 1788270196.55 total 691.10 last 133.99) - open/close/unlink 55027 (time 1788270206.55 total 701.11 last 113.17) - open/close/unlink 56211 (time 1788270216.55 total 711.11 last 118.34) - open/close/unlink 57456 (time 1788270226.56 total 721.12 last 124.43) - open/close/unlink 58765 (time 1788270236.57 total 731.12 last 130.81) - open/close/unlink 60000 (time 1788270245.21 total 739.77 last 142.90) - open/close/unlink 61305 (time 1788270255.22 total 749.77 last 130.40) - open/close/unlink 62550 (time 1788270265.22 total 759.77 last 124.48) - open/close/unlink 63953 (time 1788270275.22 total 769.78 last 140.25) total: 64768 open/close/unlink in 776.96 seconds: 83.36 ops/second k 39174 (time 1788270069.43 total 564.01 last 94.05) - open/close/unlink 40000 (time 1788270078.12 total 572.70 last 95.03) - open/close/unlink 40902 (time 1788270088.13 total 582.71 last 90.12) - open/close/unlink 41948 (time 1788270098.13 total 592.71 last 104.60) - open/close/unlink 43077 (time 1788270108.14 total 602.72 last 112.85) - open/close/unlink 44246 (time 1788270118.14 total 612.72 last 116.87) - open/close/unlink 45309 (time 1788270128.15 total 622.73 last 106.22) - open/close/unlink 46405 (time 1788270138.15 total 632.73 last 109.58) - open/close/unlink 47641 (time 1788270148.15 total 642.73 last 123.55) - open/close/unlink 48962 (time 1788270158.16 total 652.73 last 132.08) - open/close/unlink 50000 (time 1788270166.72 total 661.30 last 121.22) - open/close/unlink 51281 (time 1788270176.73 total 671.31 last 127.98) - open/close/unlink 52552 (time 1788270186.74 total 681.31 last 127.01) - open/close/unlink 53890 (time 1788270196.74 total 691.32 last 133.74) - open/close/unlink 55025 (time 1788270206.74 total 701.32 last 113.46) - open/close/unlink 56214 (time 1788270216.75 total 711.33 last 118.83) - open/close/unlink 57449 (time 1788270226.75 total 721.33 last 123.47) - open/close/unlink 58759 (time 1788270236.76 total 731.33 last 130.96) - open/close/unlink 60000 (time 1788270245.40 total 739.98 last 143.59) - open/close/unlink 61304 (time 1788270255.40 total 749.98 last 130.33) - open/close/unlink 62561 (time 1788270265.41 total 759.99 last 125.62) - open/close/unlink 63966 (time 1788270275.41 total 769.99 last 140.50) total: 64768 open/close/unlink in 777.28 seconds: 83.33 ops/second k 39174 (time 1788270069.00 total 563.71 last 95.39) - open/close/unlink 40000 (time 1788270077.94 total 572.64 last 92.47) - open/close/unlink 40905 (time 1788270087.94 total 582.64 last 90.47) - open/close/unlink 41936 (time 1788270097.95 total 592.65 last 103.03) - open/close/unlink 43068 (time 1788270107.96 total 602.66 last 113.07) - open/close/unlink 44232 (time 1788270117.96 total 612.66 last 116.35) - open/close/unlink 45304 (time 1788270127.97 total 622.67 last 107.09) - open/close/unlink 46399 (time 1788270137.97 total 632.68 last 109.50) - open/close/unlink 47606 (time 1788270147.97 total 642.68 last 120.69) - open/close/unlink 48936 (time 1788270157.98 total 652.68 last 132.92) - open/close/unlink 50000 (time 1788270166.83 total 661.53 last 120.23) - open/close/unlink 51281 (time 1788270176.83 total 671.54 last 128.06) - open/close/unlink 52544 (time 1788270186.83 total 681.54 last 126.30) - open/close/unlink 53892 (time 1788270196.83 total 691.54 last 134.80) - open/close/unlink 55027 (time 1788270206.84 total 701.54 last 113.43) - open/close/unlink 56207 (time 1788270216.84 total 711.55 last 117.95) - open/close/unlink 57442 (time 1788270226.85 total 721.55 last 123.42) - open/close/unlink 58758 (time 1788270236.85 total 731.55 last 131.60) - open/close/unlink 60000 (time 1788270245.54 total 740.24 last 142.96) - open/close/unlink 61301 (time 1788270255.54 total 750.25 last 130.03) - open/close/unlink 62554 (time 1788270265.54 total 760.25 last 125.27) - open/close/unlink 63983 (time 1788270275.55 total 770.25 last 142.82) total: 64768 open/close/unlink in 777.60 seconds: 83.29 ops/second k 39147 (time 1788270068.93 total 563.44 last 94.17) - open/close/unlink 40000 (time 1788270078.14 total 572.65 last 92.66) - open/close/unlink 40903 (time 1788270088.15 total 582.66 last 90.19) - open/close/unlink 41952 (time 1788270098.15 total 592.66 last 104.89) - open/close/unlink 43079 (time 1788270108.15 total 602.67 last 112.66) - open/close/unlink 44244 (time 1788270118.15 total 612.67 last 116.48) - open/close/unlink 45296 (time 1788270128.16 total 622.68 last 105.09) - open/close/unlink 46392 (time 1788270138.17 total 632.68 last 109.59) - open/close/unlink 47632 (time 1788270148.17 total 642.68 last 123.95) - open/close/unlink 48952 (time 1788270158.18 total 652.69 last 131.90) - open/close/unlink 50000 (time 1788270166.80 total 661.31 last 121.59) - open/close/unlink 51285 (time 1788270176.80 total 671.31 last 128.48) - open/close/unlink 52541 (time 1788270186.80 total 681.32 last 125.52) - open/close/unlink 53884 (time 1788270196.81 total 691.32 last 134.27) - open/close/unlink 55016 (time 1788270206.81 total 701.32 last 113.15) - open/close/unlink 56194 (time 1788270216.81 total 711.33 last 117.77) - open/close/unlink 57433 (time 1788270226.82 total 721.33 last 123.88) - open/close/unlink 58740 (time 1788270236.82 total 731.33 last 130.64) - open/close/unlink 60000 (time 1788270245.63 total 740.14 last 143.09) - open/close/unlink 61296 (time 1788270255.63 total 750.14 last 129.53) - open/close/unlink 62536 (time 1788270265.64 total 760.15 last 123.91) - open/close/unlink 63970 (time 1788270275.64 total 770.15 last 143.37) total: 64768 open/close/unlink in 777.68 seconds: 83.28 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg355-server: cannot open 'lustre-ost2': no such pool pdsh@oleg355-client: oleg355-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg355-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg355-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg355-server stop mds service on oleg355-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg355-server unloading modules via unload_modules_local on: 'oleg355-server' oleg355-server: oleg355-server.virtnet: executing unload_modules_local oleg355-server: modules unloaded. pdsh@oleg355-client: oleg355-client: ssh exited with exit code 2 pdsh@oleg355-client: oleg355-server: ssh exited with exit code 2 pdsh@oleg355-client: oleg355-client: ssh exited with exit code 2 pdsh@oleg355-client: oleg355-server: ssh exited with exit code 2 PASS 106 (865s) Stopping clients: oleg355-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg355-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg355-client: oleg355-server: ssh exited with exit code 2 oleg355-server: oleg355-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg355-server' oleg355-server: oleg355-server.virtnet: executing load_modules_local oleg355-server: Loading modules from /home/green/git/lustre-release/lustre oleg355-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg355-server: detected 4 online CPUs by sysfs oleg355-server: MODOPTS_LIBCFS= oleg355-server: Force libcfs to create 2 CPU partitions oleg355-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg355-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg355-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 1030 sec ========== 09:46:39 (1788270399) === conf-sanity: start cleanup 09:46:40 (1788270400) === === conf-sanity: finish cleanup 09:46:43 (1788270403) ===