-----============= acceptance-small: conf-sanity ============----- Thu Jun 11 20:47:50 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg603-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg603-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg603-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg603-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg603-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg603-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg603-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg603-server oleg603-server: oleg603-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg603-server' oleg603-server: oleg603-server.virtnet: executing load_modules_local oleg603-server: Loading modules from /home/green/git/lustre-release/lustre oleg603-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg603-server: detected 4 online CPUs by sysfs oleg603-server: MODOPTS_LIBCFS= oleg603-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg603-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg603-server: oleg603-server.virtnet: executing set_default_debug -1 all pdsh@oleg603-client: oleg603-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg603-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg603-server: oleg603-server.virtnet: executing set_default_debug -1 all pdsh@oleg603-client: oleg603-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg603-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg603-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg603-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg603-server: oleg603-server.virtnet: executing set_default_debug -1 all pdsh@oleg603-client: oleg603-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg603-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg603-server: oleg603-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg603-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg603-server: oleg603-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg603-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg603-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg603-server stop mds service on oleg603-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg603-server stop mds service on oleg603-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg603-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 20:50:14 (1781225414) start mds service on oleg603-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg603-server: oleg603-server.virtnet: executing set_default_debug -1 all pdsh@oleg603-client: oleg603-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg603-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg603-server: oleg603-server.virtnet: executing set_default_debug -1 all pdsh@oleg603-client: oleg603-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg603-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg603-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg603-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg603-server: oleg603-server.virtnet: executing set_default_debug -1 all pdsh@oleg603-client: oleg603-server: ssh exited with exit code 1 Started lustre-OST0000 oleg603-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg603-client.virtnet: -o user_xattr,flock 192.168.206.103@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50096 529 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 784 (time 1781225466.12 total 10.00 last 78.36) - open/close/unlink 1641 (time 1781225476.12 total 20.01 last 85.68) - open/close/unlink 2432 (time 1781225486.14 total 30.02 last 78.99) - open/close/unlink 3254 (time 1781225496.15 total 40.04 last 82.08) - open/close/unlink 4034 (time 1781225506.15 total 50.04 last 78.00) - open/close/unlink 4884 (time 1781225516.17 total 60.05 last 84.89) - open/close/unlink 5875 (time 1781225526.19 total 70.08 last 98.84) - open/close/unlink 6687 (time 1781225536.20 total 80.09 last 81.12) - open/close/unlink 7469 (time 1781225546.21 total 90.09 last 78.17) - open/close/unlink 8248 (time 1781225556.21 total 100.09 last 77.89) - open/close/unlink 9015 (time 1781225566.21 total 110.09 last 76.70) - open/close/unlink 9815 (time 1781225576.22 total 120.10 last 79.93) - open/close/unlink 10000 (time 1781225578.86 total 122.74 last 70.00) - open/close/unlink 10748 (time 1781225588.86 total 132.75 last 74.77) - open/close/unlink 11480 (time 1781225598.87 total 142.75 last 73.15) - open/close/unlink 12244 (time 1781225608.88 total 152.76 last 76.36) - open/close/unlink 13081 (time 1781225618.89 total 162.77 last 83.58) - open/close/unlink 13997 (time 1781225628.90 total 172.78 last 91.53) - open/close/unlink 14720 (time 1781225638.90 total 182.78 last 72.29) - open/close/unlink 15589 (time 1781225648.90 total 192.78 last 86.88) - open/close/unlink 16530 (time 1781225658.91 total 202.80 last 93.98) - open/close/unlink 17241 (time 1781225668.93 total 212.81 last 71.01) - open/close/unlink 17948 (time 1781225678.94 total 222.83 last 70.58) - open/close/unlink 18618 (time 1781225688.95 total 232.83 last 66.96) - open/close/unlink 19255 (time 1781225698.95 total 242.84 last 63.67) - open/close/unlink 19828 (time 1781225708.97 total 252.85 last 57.23) - open/close/unlink 20000 (time 1781225711.76 total 255.65 last 61.49) - open/close/unlink 20715 (time 1781225721.77 total 265.65 last 71.44) - open/close/unlink 21587 (time 1781225731.77 total 275.66 last 87.16) - open/close/unlink 22447 (time 1781225741.78 total 285.66 last 86.00) - open/close/unlink 23412 (time 1781225751.78 total 295.66 last 96.49) - open/close/unlink 24479 (time 1781225761.78 total 305.67 last 106.62) - open/close/unlink 25394 (time 1781225771.79 total 315.68 last 91.42) - open/close/unlink 26054 (time 1781225781.80 total 325.69 last 65.94) - open/close/unlink 26831 (time 1781225791.81 total 335.69 last 77.64) - open/close/unlink 27812 (time 1781225801.81 total 345.69 last 98.09) - open/close/unlink 28633 (time 1781225811.82 total 355.70 last 82.05) - open/close/unlink 29555 (time 1781225821.82 total 365.70 last 92.18) - open/close/unlink 30000 (time 1781225826.57 total 370.45 last 93.66) - open/close/unlink 30832 (time 1781225836.58 total 380.46 last 83.15) - open/close/unlink 31603 (time 1781225846.58 total 390.46 last 77.08) - open/close/unlink 32355 (time 1781225856.59 total 400.47 last 75.15) - open/close/unlink 33463 (time 1781225866.59 total 410.47 last 110.73) - open/close/unlink 34313 (time 1781225876.61 total 420.50 last 84.82) - open/close/unlink 35161 (time 1781225886.63 total 430.51 last 84.67) - open/close/unlink 36032 (time 1781225896.64 total 440.52 last 87.00) - open/close/unlink 36968 (time 1781225906.65 total 450.53 last 93.53) - open/close/unlink 38078 (time 1781225916.65 total 460.53 last 110.98) - open/close/unlink 39176 (time 1781225926.65 total 470.54 last 109.77) - open/close/unlink 40000 (time 1781225934.85 total 478.74 last 100.46) - open/close/unlink 40924 (time 1781225944.86 total 488.75 last 92.31) - open/close/unlink 41877 (time 1781225954.88 total 498.76 last 95.20) - open/close/unlink 42692 (time 1781225964.88 total 508.76 last 81.50) - open/close/unlink 43477 (time 1781225974.88 total 518.76 last 78.48) - open/close/unlink 44326 (time 1781225984.88 total 528.77 last 84.87) - open/close/unlink 45297 (time 1781225994.88 total 538.77 last 97.08) - open/close/unlink 46409 (time 1781226004.89 total 548.77 last 111.17) - open/ - open/close/unlink 784 (time 1781225466.17 total 10.01 last 78.32) - open/close/unlink 1645 (time 1781225476.18 total 20.02 last 86.03) - open/close/unlink 2430 (time 1781225486.18 total 30.02 last 78.50) - open/close/unlink 3252 (time 1781225496.19 total 40.03 last 82.12) - open/close/unlink 4039 (time 1781225506.19 total 50.04 last 78.64) - open/close/unlink 4896 (time 1781225516.20 total 60.04 last 85.67) - open/close/unlink 5877 (time 1781225526.23 total 70.08 last 97.77) - open/close/unlink 6695 (time 1781225536.25 total 80.09 last 81.69) - open/close/unlink 7481 (time 1781225546.26 total 90.10 last 78.50) - open/close/unlink 8259 (time 1781225556.27 total 100.11 last 77.74) - open/close/unlink 9025 (time 1781225566.27 total 110.11 last 76.57) - open/close/unlink 9821 (time 1781225576.29 total 120.13 last 79.43) - open/close/unlink 10000 (time 1781225578.96 total 122.81 last 67.01) - open/close/unlink 10757 (time 1781225588.96 total 132.81 last 75.69) - open/close/unlink 11490 (time 1781225598.97 total 142.81 last 73.26) - open/close/unlink 12246 (time 1781225608.97 total 152.82 last 75.58) - open/close/unlink 13082 (time 1781225618.97 total 162.82 last 83.58) - open/close/unlink 14005 (time 1781225628.98 total 172.82 last 92.26) - open/close/unlink 14728 (time 1781225638.98 total 182.82 last 72.29) - open/close/unlink 15599 (time 1781225648.99 total 192.83 last 87.04) - open/close/unlink 16542 (time 1781225659.00 total 202.84 last 94.21) - open/close/unlink 17248 (time 1781225669.00 total 212.84 last 70.58) - open/close/unlink 17948 (time 1781225679.00 total 222.85 last 69.97) - open/close/unlink 18610 (time 1781225689.03 total 232.87 last 66.05) - open/close/unlink 19245 (time 1781225699.04 total 242.88 last 63.43) - open/close/unlink 19818 (time 1781225709.05 total 252.89 last 57.23) - open/close/unlink 20000 (time 1781225712.05 total 255.89 last 60.66) - open/close/unlink 20721 (time 1781225722.06 total 265.90 last 72.02) - open/close/unlink 21588 (time 1781225732.07 total 275.92 last 86.58) - open/close/unlink 22448 (time 1781225742.08 total 285.93 last 85.93) - open/close/unlink 23418 (time 1781225752.09 total 295.94 last 96.91) - open/close/unlink 24478 (time 1781225762.09 total 305.94 last 105.97) - open/close/unlink 25378 (time 1781225772.11 total 315.95 last 89.91) - open/close/unlink 26031 (time 1781225782.11 total 325.95 last 65.28) - open/close/unlink 26822 (time 1781225792.12 total 335.96 last 79.04) - open/close/unlink 27818 (time 1781225802.12 total 345.96 last 99.57) - open/close/unlink 28642 (time 1781225812.12 total 355.97 last 82.36) - open/close/unlink 29552 (time 1781225822.13 total 365.97 last 90.95) - open/close/unlink 30000 (time 1781225826.81 total 370.65 last 95.69) - open/close/unlink 30838 (time 1781225836.82 total 380.66 last 83.73) - open/close/unlink 31610 (time 1781225846.82 total 390.67 last 77.16) - open/close/unlink 32385 (time 1781225856.83 total 400.67 last 77.47) - open/close/unlink 33482 (time 1781225866.84 total 410.68 last 109.59) - open/close/unlink 34310 (time 1781225876.84 total 420.69 last 82.74) - open/close/unlink 35161 (time 1781225886.85 total 430.69 last 85.05) - open/close/unlink 36035 (time 1781225896.85 total 440.70 last 87.36) - open/close/unlink 36974 (time 1781225906.86 total 450.71 last 93.83) - open/close/unlink 38087 (time 1781225916.87 total 460.71 last 111.24) - open/close/unlink 39180 (time 1781225926.87 total 470.71 last 109.26) - open/close/unlink 40000 (time 1781225935.01 total 478.86 last 100.71) - open/close/unlink 40920 (time 1781225945.03 total 488.87 last 91.83) - open/close/unlink 41875 (time 1781225955.03 total 498.88 last 95.46) - open/close/unlink 42687 (time 1781225965.04 total 508.89 last 81.13) - open/close/unlink 43482 (time 1781225975.04 total 518.89 last 79.49) - open/close/unlink 44324 (time 1781225985.05 total 528.90 last 84.13) - open/close/unlink 45294 (time 1781225995.06 total 538.90 last 96.98) - open/close/unlink 46413 (time 1781226005.06 total 548.90 last 111.83) - open/ - open/close/unlink 781 (time 1781225466.10 total 10.00 last 78.10) - open/close/unlink 1638 (time 1781225476.10 total 20.00 last 85.67) - open/close/unlink 2431 (time 1781225486.13 total 30.03 last 79.08) - open/close/unlink 3253 (time 1781225496.14 total 40.04 last 82.12) - open/close/unlink 4031 (time 1781225506.16 total 50.06 last 77.67) - open/close/unlink 4877 (time 1781225516.16 total 60.06 last 84.59) - open/close/unlink 5868 (time 1781225526.19 total 70.09 last 98.78) - open/close/unlink 6676 (time 1781225536.20 total 80.10 last 80.75) - open/close/unlink 7459 (time 1781225546.20 total 90.10 last 78.24) - open/close/unlink 8233 (time 1781225556.21 total 100.11 last 77.34) - open/close/unlink 8986 (time 1781225566.22 total 110.12 last 75.26) - open/close/unlink 9782 (time 1781225576.23 total 120.13 last 79.53) - open/close/unlink 10000 (time 1781225579.47 total 123.37 last 67.19) - open/close/unlink 10756 (time 1781225589.48 total 133.38 last 75.51) - open/close/unlink 11505 (time 1781225599.49 total 143.39 last 74.85) - open/close/unlink 12274 (time 1781225609.50 total 153.39 last 76.86) - open/close/unlink 13129 (time 1781225619.50 total 163.40 last 85.48) - open/close/unlink 14040 (time 1781225629.50 total 173.40 last 91.04) - open/close/unlink 14778 (time 1781225639.51 total 183.41 last 73.77) - open/close/unlink 15637 (time 1781225649.52 total 193.42 last 85.77) - open/close/unlink 16573 (time 1781225659.53 total 203.43 last 93.54) - open/close/unlink 17252 (time 1781225669.53 total 213.43 last 67.89) - open/close/unlink 17979 (time 1781225679.53 total 223.43 last 72.68) - open/close/unlink 18628 (time 1781225689.55 total 233.44 last 64.83) - open/close/unlink 19269 (time 1781225699.55 total 243.45 last 64.07) - open/close/unlink 19838 (time 1781225709.56 total 253.46 last 56.82) - open/close/unlink 20000 (time 1781225712.28 total 256.17 last 59.76) - open/close/unlink 20728 (time 1781225722.29 total 266.18 last 72.72) - open/close/unlink 21609 (time 1781225732.29 total 276.19 last 88.07) - open/close/unlink 22463 (time 1781225742.30 total 286.20 last 85.31) - open/close/unlink 23432 (time 1781225752.31 total 296.20 last 96.85) - open/close/unlink 24489 (time 1781225762.31 total 306.21 last 105.67) - open/close/unlink 25391 (time 1781225772.31 total 316.21 last 90.20) - open/close/unlink 26037 (time 1781225782.31 total 326.21 last 64.56) - open/close/unlink 26832 (time 1781225792.32 total 336.22 last 79.46) - open/close/unlink 27806 (time 1781225802.32 total 346.22 last 97.39) - open/close/unlink 28634 (time 1781225812.32 total 356.22 last 82.79) - open/close/unlink 29544 (time 1781225822.33 total 366.22 last 90.96) - open/close/unlink 30000 (time 1781225827.13 total 371.03 last 94.82) - open/close/unlink 30829 (time 1781225837.14 total 381.04 last 82.88) - open/close/unlink 31599 (time 1781225847.14 total 391.04 last 76.95) - open/close/unlink 32383 (time 1781225857.15 total 401.05 last 78.37) - open/close/unlink 33477 (time 1781225867.15 total 411.05 last 109.33) - open/close/unlink 34313 (time 1781225877.16 total 421.06 last 83.53) - open/close/unlink 35169 (time 1781225887.17 total 431.07 last 85.52) - open/close/unlink 36028 (time 1781225897.17 total 441.07 last 85.87) - open/close/unlink 36962 (time 1781225907.18 total 451.08 last 93.34) - open/close/unlink 38095 (time 1781225917.19 total 461.09 last 113.20) - open/close/unlink 39186 (time 1781225927.21 total 471.11 last 108.85) - open/close/unlink 40000 (time 1781225935.42 total 479.32 last 99.13) - open/close/unlink 40912 (time 1781225945.43 total 489.33 last 91.12) - open/close/unlink 41870 (time 1781225955.44 total 499.33 last 95.78) - open/close/unlink 42683 (time 1781225965.44 total 509.34 last 81.22) - open/close/unlink 43475 (time 1781225975.45 total 519.35 last 79.17) - open/close/unlink 44319 (time 1781225985.45 total 529.35 last 84.39) - open/close/unlink 45303 (time 1781225995.45 total 539.35 last 98.37) - open/close/unlink 46424 (time 1781226005.46 total 549.36 last 112.04) - open/c - open/close/unlink 781 (time 1781225466.06 total 10.02 last 77.98) - open/close/unlink 1640 (time 1781225476.07 total 20.02 last 85.86) - open/close/unlink 2437 (time 1781225486.08 total 30.03 last 79.61) - open/close/unlink 3252 (time 1781225496.12 total 40.07 last 81.18) - open/close/unlink 4029 (time 1781225506.15 total 50.10 last 77.44) - open/close/unlink 4874 (time 1781225516.15 total 60.11 last 84.49) - open/close/unlink 5863 (time 1781225526.16 total 70.11 last 98.85) - open/close/unlink 6673 (time 1781225536.16 total 80.12 last 80.95) - open/close/unlink 7463 (time 1781225546.17 total 90.12 last 78.98) - open/close/unlink 8238 (time 1781225556.18 total 100.13 last 77.43) - open/close/unlink 9006 (time 1781225566.18 total 110.13 last 76.78) - open/close/unlink 9805 (time 1781225576.18 total 120.14 last 79.86) - open/close/unlink 10000 (time 1781225579.05 total 123.00 last 67.98) - open/close/unlink 10755 (time 1781225589.06 total 133.01 last 75.48) - open/close/unlink 11487 (time 1781225599.06 total 143.01 last 73.18) - open/close/unlink 12248 (time 1781225609.07 total 153.02 last 76.00) - open/close/unlink 13096 (time 1781225619.08 total 163.03 last 84.72) - open/close/unlink 14004 (time 1781225629.08 total 173.03 last 90.79) - open/close/unlink 14728 (time 1781225639.09 total 183.04 last 72.33) - open/close/unlink 15599 (time 1781225649.10 total 193.05 last 87.07) - open/close/unlink 16537 (time 1781225659.10 total 203.05 last 93.74) - open/close/unlink 17225 (time 1781225669.10 total 213.06 last 68.78) - open/close/unlink 17937 (time 1781225679.11 total 223.06 last 71.16) - open/close/unlink 18602 (time 1781225689.12 total 233.07 last 66.46) - open/close/unlink 19234 (time 1781225699.12 total 243.08 last 63.15) - open/close/unlink 19807 (time 1781225709.15 total 253.10 last 57.17) - open/close/unlink 20000 (time 1781225712.34 total 256.29 last 60.51) - open/close/unlink 20722 (time 1781225722.34 total 266.29 last 72.20) - open/close/unlink 21600 (time 1781225732.34 total 276.29 last 87.78) - open/close/unlink 22456 (time 1781225742.35 total 286.30 last 85.54) - open/close/unlink 23428 (time 1781225752.35 total 296.31 last 97.12) - open/close/unlink 24492 (time 1781225762.36 total 306.31 last 106.36) - open/close/unlink 25399 (time 1781225772.36 total 316.31 last 90.68) - open/close/unlink 26046 (time 1781225782.37 total 326.32 last 64.64) - open/close/unlink 26846 (time 1781225792.37 total 336.33 last 79.97) - open/close/unlink 27821 (time 1781225802.38 total 346.33 last 97.44) - open/close/unlink 28648 (time 1781225812.38 total 356.34 last 82.68) - open/close/unlink 29559 (time 1781225822.39 total 366.34 last 91.05) - open/close/unlink 30000 (time 1781225827.11 total 371.06 last 93.48) - open/close/unlink 30834 (time 1781225837.11 total 381.06 last 83.36) - open/close/unlink 31605 (time 1781225847.11 total 391.06 last 77.09) - open/close/unlink 32379 (time 1781225857.11 total 401.07 last 77.39) - open/close/unlink 33474 (time 1781225867.13 total 411.08 last 109.37) - open/close/unlink 34310 (time 1781225877.13 total 421.08 last 83.56) - open/close/unlink 35164 (time 1781225887.14 total 431.10 last 85.30) - open/close/unlink 36023 (time 1781225897.15 total 441.11 last 85.81) - open/close/unlink 36948 (time 1781225907.16 total 451.11 last 92.47) - open/close/unlink 38079 (time 1781225917.16 total 461.11 last 113.07) - open/close/unlink 39165 (time 1781225927.17 total 471.12 last 108.53) - open/close/unlink 40000 (time 1781225935.66 total 479.61 last 98.33) - open/close/unlink 40921 (time 1781225945.67 total 489.62 last 92.01) - open/close/unlink 41871 (time 1781225955.67 total 499.62 last 94.95) - open/close/unlink 42682 (time 1781225965.67 total 509.63 last 81.08) - open/close/unlink 43472 (time 1781225975.68 total 519.64 last 78.92) - open/close/unlink 44324 (time 1781225985.69 total 529.64 last 85.17) - open/close/unlink 45312 (time 1781225995.70 total 539.65 last 98.73) - open/close/unlink 46441 (time 1781226005.70 total 549.65 last 112.89) - open/c - open/close/unlink 781 (time 1781225465.95 total 10.01 last 78.05) - open/close/unlink 1630 (time 1781225475.95 total 20.01 last 84.89) - open/close/unlink 2425 (time 1781225485.96 total 30.02 last 79.40) - open/close/unlink 3245 (time 1781225495.96 total 40.02 last 81.99) - open/close/unlink 4020 (time 1781225505.96 total 50.02 last 77.50) - open/close/unlink 4872 (time 1781225515.97 total 60.02 last 85.18) - open/close/unlink 5857 (time 1781225525.97 total 70.03 last 98.44) - open/close/unlink 6668 (time 1781225535.99 total 80.04 last 81.00) - open/close/unlink 7454 (time 1781225545.99 total 90.05 last 78.56) - open/close/unlink 8236 (time 1781225555.99 total 100.05 last 78.20) - open/close/unlink 8998 (time 1781225565.99 total 110.05 last 76.20) - open/close/unlink 9796 (time 1781225575.99 total 120.05 last 79.78) - open/close/unlink 10000 (time 1781225579.00 total 123.05 last 67.98) - open/close/unlink 10749 (time 1781225589.01 total 133.06 last 74.82) - open/close/unlink 11482 (time 1781225599.02 total 143.08 last 73.20) - open/close/unlink 12245 (time 1781225609.03 total 153.09 last 76.23) - open/close/unlink 13086 (time 1781225619.03 total 163.09 last 84.09) - open/close/unlink 13998 (time 1781225629.03 total 173.09 last 91.19) - open/close/unlink 14716 (time 1781225639.03 total 183.09 last 71.79) - open/close/unlink 15588 (time 1781225649.03 total 193.09 last 87.20) - open/close/unlink 16540 (time 1781225659.04 total 203.10 last 95.10) - open/close/unlink 17242 (time 1781225669.05 total 213.10 last 70.17) - open/close/unlink 17952 (time 1781225679.05 total 223.11 last 70.96) - open/close/unlink 18618 (time 1781225689.06 total 233.11 last 66.56) - open/close/unlink 19251 (time 1781225699.07 total 243.13 last 63.21) - open/close/unlink 19824 (time 1781225709.09 total 253.15 last 57.17) - open/close/unlink 20000 (time 1781225711.96 total 256.02 last 61.40) - open/close/unlink 20723 (time 1781225721.97 total 266.02 last 72.25) - open/close/unlink 21579 (time 1781225731.98 total 276.04 last 85.50) - open/close/unlink 22436 (time 1781225741.98 total 286.04 last 85.65) - open/close/unlink 23395 (time 1781225751.99 total 296.05 last 95.86) - open/close/unlink 24459 (time 1781225761.99 total 306.05 last 106.35) - open/close/unlink 25371 (time 1781225772.00 total 316.06 last 91.11) - open/close/unlink 26023 (time 1781225782.01 total 326.07 last 65.12) - open/close/unlink 26803 (time 1781225792.02 total 336.08 last 77.92) - open/close/unlink 27791 (time 1781225802.03 total 346.09 last 98.73) - open/close/unlink 28614 (time 1781225812.04 total 356.09 last 82.27) - open/close/unlink 29529 (time 1781225822.05 total 366.10 last 91.41) - open/close/unlink 30000 (time 1781225827.11 total 371.17 last 93.02) - open/close/unlink 30827 (time 1781225837.11 total 381.17 last 82.67) - open/close/unlink 31600 (time 1781225847.12 total 391.17 last 77.27) - open/close/unlink 32371 (time 1781225857.12 total 401.18 last 77.08) - open/close/unlink 33467 (time 1781225867.13 total 411.19 last 109.48) - open/close/unlink 34304 (time 1781225877.14 total 421.19 last 83.65) - open/close/unlink 35155 (time 1781225887.15 total 431.20 last 85.02) - open/close/unlink 36016 (time 1781225897.15 total 441.21 last 86.06) - open/close/unlink 36938 (time 1781225907.16 total 451.22 last 92.11) - open/close/unlink 38079 (time 1781225917.19 total 461.25 last 113.73) - open/close/unlink 39153 (time 1781225927.21 total 471.27 last 107.19) - open/close/unlink 40000 (time 1781225935.76 total 479.82 last 99.08) - open/close/unlink 40918 (time 1781225945.77 total 489.82 last 91.74) - open/close/unlink 41860 (time 1781225955.77 total 499.83 last 94.18) - open/close/unlink 42667 (time 1781225965.78 total 509.84 last 80.58) - open/close/unlink 43457 (time 1781225975.79 total 519.84 last 78.97) - open/close/unlink 44304 (time 1781225985.79 total 529.85 last 84.65) - open/close/unlink 45277 (time 1781225995.79 total 539.85 last 97.28) - open/close/unlink 46400 (time 1781226005.80 total 549.86 last 112.25) - open/cclose/unlink 47723 (time 1781226014.90 total 558.78 last 131.28) - open/close/unlink 49042 (time 1781226024.90 total 568.78 last 131.88) - open/close/unlink 50000 (time 1781226033.61 total 577.49 last 109.98) - open/close/unlink 51128 (time 1781226043.61 total 587.49 last 112.76) - open/close/unlink 52554 (time 1781226053.61 total 597.50 last 142.56) - open/close/unlink 53755 (time 1781226063.62 total 607.50 last 120.02) - open/close/unlink 54866 (time 1781226073.62 total 617.51 last 111.08) - open/close/unlink 55993 (time 1781226083.63 total 627.51 last 112.67) - open/close/unlink 56922 (time 1781226093.63 total 637.52 last 92.82) - open/close/unlink 58020 (time 1781226103.64 total 647.52 last 109.78) - open/close/unlink 59127 (time 1781226113.64 total 657.53 last 110.62) - open/close/unlink 60000 (time 1781226121.28 total 665.17 last 114.26) - open/close/unlink 61135 (time 1781226131.28 total 675.17 last 113.49) - open/close/unlink 62119 (time 1781226141.29 total 685.17 last 98.34) - open/close/unlink 63056 (time 1781226151.30 total 695.18 last 93.64) - open/close/unlink 64073 (time 1781226161.30 total 705.18 last 101.67) total: 64768 open/close/unlink in 712.09 seconds: 90.95 ops/second close/unlink 47716 (time 1781226015.06 total 558.91 last 130.26) - open/close/unlink 49022 (time 1781226025.07 total 568.91 last 130.56) - open/close/unlink 50000 (time 1781226034.09 total 577.93 last 108.39) - open/close/unlink 51155 (time 1781226044.10 total 587.94 last 115.41) - open/close/unlink 52593 (time 1781226054.10 total 597.95 last 143.74) - open/close/unlink 53762 (time 1781226064.11 total 607.95 last 116.84) - open/close/unlink 54883 (time 1781226074.11 total 617.95 last 112.07) - open/close/unlink 55985 (time 1781226084.11 total 627.96 last 110.16) - open/close/unlink 56921 (time 1781226094.12 total 637.96 last 93.54) - open/close/unlink 58033 (time 1781226104.13 total 647.97 last 111.09) - open/close/unlink 59124 (time 1781226114.14 total 657.98 last 109.00) - open/close/unlink 60000 (time 1781226121.70 total 665.55 last 115.77) - open/close/unlink 61117 (time 1781226131.71 total 675.55 last 111.69) - open/close/unlink 62097 (time 1781226141.71 total 685.56 last 97.93) - open/close/unlink 63043 (time 1781226151.71 total 695.56 last 94.59) - open/close/unlink 64066 (time 1781226161.72 total 705.56 last 102.27) total: 64768 open/close/unlink in 713.22 seconds: 90.81 ops/second lose/unlink 47752 (time 1781226015.70 total 559.65 last 131.07) - open/close/unlink 49075 (time 1781226025.71 total 569.67 last 132.09) - open/close/unlink 50000 (time 1781226034.49 total 578.45 last 105.37) - open/close/unlink 51161 (time 1781226044.50 total 588.45 last 116.00) - open/close/unlink 52624 (time 1781226054.50 total 598.46 last 146.27) - open/close/unlink 53763 (time 1781226064.51 total 608.47 last 113.79) - open/close/unlink 54911 (time 1781226074.52 total 618.47 last 114.75) - open/close/unlink 55992 (time 1781226084.53 total 628.48 last 108.01) - open/close/unlink 56929 (time 1781226094.53 total 638.48 last 93.68) - open/close/unlink 58054 (time 1781226104.53 total 648.48 last 112.47) - open/close/unlink 59150 (time 1781226114.53 total 658.49 last 109.57) - open/close/unlink 60000 (time 1781226121.82 total 665.77 last 116.73) - open/close/unlink 61127 (time 1781226131.82 total 675.78 last 112.60) - open/close/unlink 62108 (time 1781226141.83 total 685.78 last 98.08) - open/close/unlink 63049 (time 1781226151.83 total 695.78 last 94.04) - open/close/unlink 64072 (time 1781226161.84 total 705.79 last 102.26) total: 64768 open/close/unlink in 713.36 seconds: 90.79 ops/second lose/unlink 47731 (time 1781226015.46 total 559.36 last 130.63) - open/close/unlink 49052 (time 1781226025.47 total 569.37 last 132.01) - open/close/unlink 50000 (time 1781226034.35 total 578.25 last 106.76) - open/close/unlink 51151 (time 1781226044.35 total 588.25 last 115.05) - open/close/unlink 52604 (time 1781226054.36 total 598.26 last 145.24) - open/close/unlink 53747 (time 1781226064.36 total 608.26 last 114.30) - open/close/unlink 54883 (time 1781226074.36 total 618.26 last 113.55) - open/close/unlink 55974 (time 1781226084.37 total 628.27 last 109.03) - open/close/unlink 56917 (time 1781226094.37 total 638.27 last 94.28) - open/close/unlink 58038 (time 1781226104.38 total 648.28 last 112.01) - open/close/unlink 59135 (time 1781226114.39 total 658.29 last 109.63) - open/close/unlink 60000 (time 1781226121.78 total 665.68 last 116.99) - open/close/unlink 61122 (time 1781226131.79 total 675.69 last 112.13) - open/close/unlink 62106 (time 1781226141.79 total 685.69 last 98.40) - open/close/unlink 63037 (time 1781226151.79 total 695.69 last 93.09) - open/close/unlink 64054 (time 1781226161.79 total 705.69 last 101.66) total: 64768 open/close/unlink in 713.80 seconds: 90.74 ops/second lose/unlink 47711 (time 1781226015.80 total 559.86 last 131.10) - open/close/unlink 49028 (time 1781226025.80 total 569.86 last 131.64) - open/close/unlink 50000 (time 1781226034.99 total 579.05 last 105.81) - open/close/unlink 51170 (time 1781226045.00 total 589.05 last 116.94) - open/close/unlink 52642 (time 1781226055.00 total 599.05 last 147.17) - open/close/unlink 53753 (time 1781226065.00 total 609.06 last 111.07) - open/close/unlink 54911 (time 1781226075.01 total 619.07 last 115.68) - open/close/unlink 55975 (time 1781226085.02 total 629.07 last 106.33) - open/close/unlink 56922 (time 1781226095.02 total 639.07 last 94.69) - open/close/unlink 58053 (time 1781226105.02 total 649.08 last 113.10) - open/close/unlink 59147 (time 1781226115.02 total 659.08 last 109.34) - open/close/unlink 60000 (time 1781226122.24 total 666.30 last 118.22) - open/close/unlink 61127 (time 1781226132.24 total 676.30 last 112.67) - open/close/unlink 62081 (time 1781226142.25 total 686.30 last 95.36) - open/close/unlink 63028 (time 1781226152.25 total 696.31 last 94.67) - open/close/unlink 64045 (time 1781226162.25 total 706.31 last 101.70) total: 64768 open/close/unlink in 715.21 seconds: 90.56 ops/second Waiting for MDT destroys to complete oleg603-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg603-client: oleg603-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg603-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg603-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg603-server stop mds service on oleg603-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg603-server stop mds service on oleg603-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg603-server unloading modules via unload_modules_local on: 'oleg603-server' oleg603-server: oleg603-server.virtnet: executing unload_modules_local oleg603-server: modules unloaded. pdsh@oleg603-client: oleg603-client: ssh exited with exit code 2 pdsh@oleg603-client: oleg603-server: ssh exited with exit code 2 pdsh@oleg603-client: oleg603-server: ssh exited with exit code 2 pdsh@oleg603-client: oleg603-client: ssh exited with exit code 2 PASS 106 (791s) Stopping clients: oleg603-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg603-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg603-client: oleg603-server: ssh exited with exit code 2 oleg603-server: oleg603-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg603-server' oleg603-server: oleg603-server.virtnet: executing load_modules_local oleg603-server: Loading modules from /home/green/git/lustre-release/lustre oleg603-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg603-server: detected 4 online CPUs by sysfs oleg603-server: MODOPTS_LIBCFS= oleg603-server: Force libcfs to create 2 CPU partitions oleg603-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg603-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg603-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 966 sec =========== 21:03:57 (1781226237) === conf-sanity: start cleanup 21:03:58 (1781226238) === === conf-sanity: finish cleanup 21:04:00 (1781226240) ===