-----============= acceptance-small: conf-sanity ============----- Fri Apr 24 11:12:26 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg247-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg247-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg247-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg247-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg247-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg247-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg247-server oleg247-server: oleg247-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg247-server' oleg247-server: oleg247-server.virtnet: executing load_modules_local oleg247-server: Loading modules from /home/green/git/lustre-release/lustre oleg247-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg247-server: detected 4 online CPUs by sysfs oleg247-server: MODOPTS_LIBCFS= oleg247-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg247-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg247-server: oleg247-server.virtnet: executing set_default_debug -1 all pdsh@oleg247-client: oleg247-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg247-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg247-server: oleg247-server.virtnet: executing set_default_debug -1 all pdsh@oleg247-client: oleg247-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg247-server: oleg247-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg247-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg247-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg247-server stop mds service on oleg247-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg247-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 11:14:11 (1777043651) start mds service on oleg247-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg247-server: oleg247-server.virtnet: executing set_default_debug -1 all pdsh@oleg247-client: oleg247-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg247-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg247-server: oleg247-server.virtnet: executing set_default_debug -1 all pdsh@oleg247-client: oleg247-server: ssh exited with exit code 1 Started lustre-OST0000 oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg247-client.virtnet: -o user_xattr,flock 192.168.202.147@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12328 424 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 495 (time 1777043688.10 total 10.01 last 49.46) - open/close/unlink 1017 (time 1777043698.11 total 20.02 last 52.13) - open/close/unlink 1547 (time 1777043708.13 total 30.04 last 52.90) - open/close/unlink 2070 (time 1777043718.14 total 40.05 last 52.25) - open/close/unlink 2618 (time 1777043728.15 total 50.06 last 54.76) - open/close/unlink 3157 (time 1777043738.15 total 60.06 last 53.89) - open/close/unlink 3685 (time 1777043748.15 total 70.06 last 52.79) - open/close/unlink 4291 (time 1777043758.16 total 80.07 last 60.53) - open/close/unlink 4769 (time 1777043768.18 total 90.08 last 47.74) - open/close/unlink 5224 (time 1777043778.18 total 100.09 last 45.47) - open/close/unlink 5614 (time 1777043788.20 total 110.11 last 38.94) - open/close/unlink 6143 (time 1777043798.21 total 120.12 last 52.84) - open/close/unlink 6682 (time 1777043808.24 total 130.14 last 53.76) - open/close/unlink 7269 (time 1777043818.24 total 140.15 last 58.66) - open/close/unlink 7803 (time 1777043828.26 total 150.17 last 53.32) - open/close/unlink 8389 (time 1777043838.27 total 160.18 last 58.55) - open/close/unlink 8897 (time 1777043848.27 total 170.18 last 50.80) - open/close/unlink 9438 (time 1777043858.27 total 180.18 last 54.08) - open/close/unlink 9902 (time 1777043868.28 total 190.19 last 46.38) - open/close/unlink 10000 (time 1777043870.28 total 192.19 last 48.94) - open/close/unlink 10502 (time 1777043880.31 total 202.21 last 50.07) - open/close/unlink 10997 (time 1777043890.32 total 212.23 last 49.42) - open/close/unlink 11485 (time 1777043900.33 total 222.24 last 48.75) - open/close/unlink 12010 (time 1777043910.35 total 232.25 last 52.43) - open/close/unlink 12469 (time 1777043920.35 total 242.25 last 45.90) - open/close/unlink 12960 (time 1777043930.35 total 252.26 last 49.08) - open/close/unlink 13427 (time 1777043940.36 total 262.27 last 46.64) - open/close/unlink 13891 (time 1777043950.37 total 272.28 last 46.36) - open/close/unlink 14376 (time 1777043960.39 total 282.30 last 48.41) - open/close/unlink 14858 (time 1777043970.40 total 292.31 last 48.13) - open/close/unlink 15355 (time 1777043980.42 total 302.32 last 49.64) - open/close/unlink 15930 (time 1777043990.42 total 312.33 last 57.45) - open/close/unlink 16565 (time 1777044000.42 total 322.33 last 63.50) - open/close/unlink 17163 (time 1777044010.43 total 332.34 last 59.76) - open/close/unlink 17732 (time 1777044020.44 total 342.35 last 56.84) - open/close/unlink 18367 (time 1777044030.45 total 352.36 last 63.45) - open/close/unlink 19055 (time 1777044040.45 total 362.36 last 68.79) - open/close/unlink 19683 (time 1777044050.45 total 372.36 last 62.80) - open/close/unlink 20000 (time 1777044054.91 total 376.82 last 71.12) - open/close/unlink 20749 (time 1777044064.92 total 386.83 last 74.81) - open/close/unlink 21372 (time 1777044074.93 total 396.84 last 62.26) - open/close/unlink 21947 (time 1777044084.93 total 406.84 last 57.48) - open/close/unlink 22616 (time 1777044094.94 total 416.85 last 66.82) - open/close/unlink 23303 (time 1777044104.95 total 426.86 last 68.66) - open/close/unlink 24093 (time 1777044114.95 total 436.86 last 78.97) - open/close/unlink 24833 (time 1777044124.95 total 446.86 last 73.99) - open/close/unlink 25519 (time 1777044134.96 total 456.86 last 68.58) - open/close/unlink 26366 (time 1777044144.96 total 466.87 last 84.66) - open/close/unlink 27180 (time 1777044154.97 total 476.88 last 81.34) - open/close/unlink 28060 (time 1777044164.97 total 486.88 last 87.98) - open/close/unlink 29169 (time 1777044174.97 total 496.88 last 110.88) - open/close/unlink 30000 (time 1777044183.78 total 505.68 last 94.40) - open/close/unlink 30961 (time 1777044193.78 total 515.68 last 96.08) - open/close/unlink 31962 (time 1777044203.78 total 525.69 last 100.07) - open/close/unlink 33057 (time 1777044213.80 total 535.70 last 109.34) - open/close/unlink 33890 (time 1777044223.80 total 545.71 last 83.27) - open/close/unlink 34699 (time 1777044233.80 total 555.71 last 80.86) - open/close/unli - open/close/unlink 495 (time 1777043688.20 total 10.02 last 49.39) - open/close/unlink 1017 (time 1777043698.23 total 20.05 last 52.04) - open/close/unlink 1544 (time 1777043708.24 total 30.06 last 52.65) - open/close/unlink 2067 (time 1777043718.25 total 40.08 last 52.23) - open/close/unlink 2616 (time 1777043728.26 total 50.09 last 54.83) - open/close/unlink 3163 (time 1777043738.27 total 60.09 last 54.68) - open/close/unlink 3688 (time 1777043748.27 total 70.10 last 52.49) - open/close/unlink 4294 (time 1777043758.27 total 80.10 last 60.58) - open/close/unlink 4760 (time 1777043768.28 total 90.11 last 46.55) - open/close/unlink 5212 (time 1777043778.29 total 100.11 last 45.18) - open/close/unlink 5600 (time 1777043788.30 total 110.12 last 38.76) - open/close/unlink 6131 (time 1777043798.31 total 120.13 last 53.04) - open/close/unlink 6669 (time 1777043808.34 total 130.16 last 53.65) - open/close/unlink 7254 (time 1777043818.34 total 140.17 last 58.48) - open/close/unlink 7783 (time 1777043828.36 total 150.18 last 52.82) - open/close/unlink 8378 (time 1777043838.37 total 160.19 last 59.43) - open/close/unlink 8883 (time 1777043848.37 total 170.19 last 50.49) - open/close/unlink 9421 (time 1777043858.38 total 180.21 last 53.74) - open/close/unlink 9885 (time 1777043868.38 total 190.21 last 46.38) - open/close/unlink 10000 (time 1777043870.75 total 192.57 last 48.66) - open/close/unlink 10491 (time 1777043880.76 total 202.58 last 49.05) - open/close/unlink 10988 (time 1777043890.77 total 212.59 last 49.66) - open/close/unlink 11476 (time 1777043900.78 total 222.60 last 48.74) - open/close/unlink 11996 (time 1777043910.79 total 232.61 last 51.96) - open/close/unlink 12454 (time 1777043920.82 total 242.65 last 45.65) - open/close/unlink 12943 (time 1777043930.83 total 252.65 last 48.87) - open/close/unlink 13408 (time 1777043940.84 total 262.67 last 46.42) - open/close/unlink 13866 (time 1777043950.85 total 272.67 last 45.79) - open/close/unlink 14352 (time 1777043960.86 total 282.68 last 48.54) - open/close/unlink 14834 (time 1777043970.87 total 292.69 last 48.16) - open/close/unlink 15342 (time 1777043980.87 total 302.70 last 50.77) - open/close/unlink 15913 (time 1777043990.88 total 312.71 last 57.05) - open/close/unlink 16552 (time 1777044000.89 total 322.71 last 63.87) - open/close/unlink 17135 (time 1777044010.89 total 332.71 last 58.29) - open/close/unlink 17704 (time 1777044020.90 total 342.73 last 56.80) - open/close/unlink 18365 (time 1777044030.91 total 352.74 last 66.06) - open/close/unlink 19037 (time 1777044040.92 total 362.74 last 67.16) - open/close/unlink 19672 (time 1777044050.93 total 372.75 last 63.43) - open/close/unlink 20000 (time 1777044055.47 total 377.30 last 72.17) - open/close/unlink 20749 (time 1777044065.48 total 387.31 last 74.83) - open/close/unlink 21349 (time 1777044075.49 total 397.32 last 59.92) - open/close/unlink 21937 (time 1777044085.50 total 407.32 last 58.78) - open/close/unlink 22601 (time 1777044095.50 total 417.33 last 66.37) - open/close/unlink 23286 (time 1777044105.50 total 427.33 last 68.49) - open/close/unlink 24064 (time 1777044115.51 total 437.34 last 77.74) - open/close/unlink 24828 (time 1777044125.52 total 447.34 last 76.37) - open/close/unlink 25511 (time 1777044135.52 total 457.34 last 68.29) - open/close/unlink 26363 (time 1777044145.52 total 467.35 last 85.14) - open/close/unlink 27207 (time 1777044155.53 total 477.36 last 84.34) - open/close/unlink 28076 (time 1777044165.53 total 487.36 last 86.88) - open/close/unlink 29184 (time 1777044175.54 total 497.36 last 110.74) - open/close/unlink 30000 (time 1777044184.02 total 505.84 last 96.26) - open/close/unlink 30947 (time 1777044194.02 total 515.85 last 94.63) - open/close/unlink 31959 (time 1777044204.03 total 525.86 last 101.14) - open/close/unlink 33032 (time 1777044214.03 total 535.86 last 107.28) - open/close/unlink 33859 (time 1777044224.04 total 545.87 last 82.60) - open/close/unlink 34670 (time 1777044234.05 total 555.88 last 81.06) - open/close/unli - open/close/unlink 497 (time 1777043688.29 total 10.01 last 49.64) - open/close/unlink 1019 (time 1777043698.31 total 20.03 last 52.11) - open/close/unlink 1542 (time 1777043708.33 total 30.05 last 52.19) - open/close/unlink 2065 (time 1777043718.34 total 40.06 last 52.27) - open/close/unlink 2620 (time 1777043728.35 total 50.06 last 55.46) - open/close/unlink 3162 (time 1777043738.35 total 60.07 last 54.18) - open/close/unlink 3670 (time 1777043748.36 total 70.08 last 50.76) - open/close/unlink 4279 (time 1777043758.37 total 80.08 last 60.86) - open/close/unlink 4743 (time 1777043768.38 total 90.10 last 46.33) - open/close/unlink 5200 (time 1777043778.40 total 100.12 last 45.61) - open/close/unlink 5592 (time 1777043788.41 total 110.13 last 39.17) - open/close/unlink 6126 (time 1777043798.41 total 120.13 last 53.40) - open/close/unlink 6668 (time 1777043808.41 total 130.13 last 54.19) - open/close/unlink 7256 (time 1777043818.42 total 140.14 last 58.76) - open/close/unlink 7788 (time 1777043828.43 total 150.15 last 53.13) - open/close/unlink 8389 (time 1777043838.44 total 160.16 last 60.05) - open/close/unlink 8900 (time 1777043848.44 total 170.16 last 51.10) - open/close/unlink 9433 (time 1777043858.45 total 180.16 last 53.26) - open/close/unlink 9897 (time 1777043868.45 total 190.17 last 46.39) - open/close/unlink 10000 (time 1777043870.50 total 192.22 last 50.27) - open/close/unlink 10499 (time 1777043880.52 total 202.24 last 49.80) - open/close/unlink 10991 (time 1777043890.52 total 212.24 last 49.19) - open/close/unlink 11468 (time 1777043900.53 total 222.24 last 47.68) - open/close/unlink 11984 (time 1777043910.53 total 232.25 last 51.59) - open/close/unlink 12438 (time 1777043920.53 total 242.25 last 45.37) - open/close/unlink 12928 (time 1777043930.55 total 252.27 last 48.90) - open/close/unlink 13389 (time 1777043940.56 total 262.28 last 46.07) - open/close/unlink 13849 (time 1777043950.57 total 272.29 last 45.97) - open/close/unlink 14337 (time 1777043960.58 total 282.30 last 48.72) - open/close/unlink 14822 (time 1777043970.60 total 292.32 last 48.43) - open/close/unlink 15324 (time 1777043980.61 total 302.32 last 50.16) - open/close/unlink 15887 (time 1777043990.62 total 312.33 last 56.25) - open/close/unlink 16537 (time 1777044000.62 total 322.34 last 64.98) - open/close/unlink 17127 (time 1777044010.63 total 332.35 last 58.94) - open/close/unlink 17698 (time 1777044020.63 total 342.35 last 57.07) - open/close/unlink 18348 (time 1777044030.64 total 352.35 last 64.98) - open/close/unlink 19027 (time 1777044040.64 total 362.36 last 67.84) - open/close/unlink 19653 (time 1777044050.66 total 372.37 last 62.53) - open/close/unlink 20000 (time 1777044055.41 total 377.12 last 73.04) - open/close/unlink 20740 (time 1777044065.41 total 387.13 last 73.99) - open/close/unlink 21341 (time 1777044075.42 total 397.14 last 60.00) - open/close/unlink 21940 (time 1777044085.43 total 407.14 last 59.89) - open/close/unlink 22597 (time 1777044095.44 total 417.16 last 65.63) - open/close/unlink 23291 (time 1777044105.45 total 427.17 last 69.28) - open/close/unlink 24066 (time 1777044115.46 total 437.18 last 77.46) - open/close/unlink 24813 (time 1777044125.46 total 447.18 last 74.68) - open/close/unlink 25486 (time 1777044135.47 total 457.19 last 67.23) - open/close/unlink 26330 (time 1777044145.48 total 467.20 last 84.30) - open/close/unlink 27171 (time 1777044155.49 total 477.21 last 84.07) - open/close/unlink 28039 (time 1777044165.49 total 487.21 last 86.74) - open/close/unlink 29152 (time 1777044175.50 total 497.22 last 111.20) - open/close/unlink 30000 (time 1777044184.20 total 505.92 last 97.47) - open/close/unlink 30931 (time 1777044194.21 total 515.93 last 93.05) - open/close/unlink 31949 (time 1777044204.21 total 525.93 last 101.76) - open/close/unlink 33015 (time 1777044214.22 total 535.94 last 106.54) - open/close/unlink 33846 (time 1777044224.23 total 545.94 last 83.03) - open/close/unlink 34674 (time 1777044234.23 total 555.95 last 82.78) - open/close/unli - open/close/unlink 497 (time 1777043688.16 total 10.01 last 49.67) - open/close/unlink 1020 (time 1777043698.17 total 20.02 last 52.21) - open/close/unlink 1554 (time 1777043708.18 total 30.03 last 53.34) - open/close/unlink 2080 (time 1777043718.20 total 40.05 last 52.49) - open/close/unlink 2630 (time 1777043728.22 total 50.07 last 54.92) - open/close/unlink 3171 (time 1777043738.23 total 60.08 last 54.06) - open/close/unlink 3693 (time 1777043748.23 total 70.09 last 52.16) - open/close/unlink 4295 (time 1777043758.25 total 80.10 last 60.13) - open/close/unlink 4765 (time 1777043768.25 total 90.11 last 46.96) - open/close/unlink 5220 (time 1777043778.27 total 100.12 last 45.45) - open/close/unlink 5610 (time 1777043788.28 total 110.13 last 38.96) - open/close/unlink 6139 (time 1777043798.28 total 120.13 last 52.88) - open/close/unlink 6685 (time 1777043808.30 total 130.15 last 54.48) - open/close/unlink 7278 (time 1777043818.31 total 140.16 last 59.24) - open/close/unlink 7813 (time 1777043828.33 total 150.18 last 53.43) - open/close/unlink 8407 (time 1777043838.33 total 160.18 last 59.36) - open/close/unlink 8915 (time 1777043848.34 total 170.19 last 50.74) - open/close/unlink 9448 (time 1777043858.35 total 180.20 last 53.27) - open/close/unlink 9915 (time 1777043868.36 total 190.21 last 46.67) - open/close/unlink 10431 (time 1777043878.38 total 200.23 last 51.49) - open/close/unlink 10909 (time 1777043888.38 total 210.23 last 47.78) - open/close/unlink 11389 (time 1777043898.39 total 220.24 last 47.95) - open/close/unlink 11913 (time 1777043908.40 total 230.25 last 52.36) - open/close/unlink 12388 (time 1777043918.42 total 240.27 last 47.41) - open/close/unlink 12866 (time 1777043928.42 total 250.27 last 47.80) - open/close/unlink 13339 (time 1777043938.42 total 260.27 last 47.29) - open/close/unlink 13783 (time 1777043948.44 total 270.29 last 44.32) - open/close/unlink 14275 (time 1777043958.44 total 280.30 last 49.17) - open/close/unlink 14769 (time 1777043968.45 total 290.30 last 49.38) - open/close/unlink 15258 (time 1777043978.47 total 300.32 last 48.82) - open/close/unlink 15817 (time 1777043988.47 total 310.32 last 55.89) - open/close/unlink 16409 (time 1777043998.48 total 320.33 last 59.12) - open/close/unlink 17061 (time 1777044008.49 total 330.34 last 65.12) - open/close/unlink 17613 (time 1777044018.49 total 340.35 last 55.19) - open/close/unlink 18195 (time 1777044028.50 total 350.35 last 58.15) - open/close/unlink 18933 (time 1777044038.51 total 360.36 last 73.76) - open/close/unlink 19546 (time 1777044048.52 total 370.37 last 61.25) - open/close/unlink 20000 (time 1777044054.95 total 376.80 last 70.57) - open/close/unlink 20745 (time 1777044064.96 total 386.81 last 74.46) - open/close/unlink 21358 (time 1777044074.96 total 396.81 last 61.28) - open/close/unlink 21944 (time 1777044084.97 total 406.82 last 58.56) - open/close/unlink 22604 (time 1777044094.97 total 416.83 last 65.95) - open/close/unlink 23297 (time 1777044104.98 total 426.83 last 69.25) - open/close/unlink 24087 (time 1777044114.98 total 436.83 last 79.00) - open/close/unlink 24823 (time 1777044124.99 total 446.84 last 73.54) - open/close/unlink 25509 (time 1777044134.99 total 456.84 last 68.58) - open/close/unlink 26364 (time 1777044145.00 total 466.85 last 85.43) - open/close/unlink 27179 (time 1777044155.00 total 476.85 last 81.48) - open/close/unlink 28060 (time 1777044165.01 total 486.86 last 88.05) - open/close/unlink 29166 (time 1777044175.01 total 496.86 last 110.58) - open/close/unlink 30000 (time 1777044183.79 total 505.65 last 94.94) - open/close/unlink 30962 (time 1777044193.80 total 515.65 last 96.14) - open/close/unlink 31960 (time 1777044203.80 total 525.66 last 99.76) - open/close/unlink 33052 (time 1777044213.82 total 535.68 last 108.98) - open/close/unlink 33882 (time 1777044223.83 total 545.68 last 82.93) - open/close/unlink 34692 (time 1777044233.84 total 555.69 last 80.98) - open/close/unlink 35864 (time 1777044243.84 total 565.69 last 117.18) - open/close/unli - open/close/unlink 499 (time 1777043688.01 total 10.02 last 49.82) - open/close/unlink 1015 (time 1777043698.02 total 20.02 last 51.59) - open/close/unlink 1546 (time 1777043708.02 total 30.02 last 53.07) - open/close/unlink 2078 (time 1777043718.04 total 40.04 last 53.11) - open/close/unlink 2627 (time 1777043728.05 total 50.05 last 54.84) - open/close/unlink 3165 (time 1777043738.05 total 60.05 last 53.80) - open/close/unlink 3693 (time 1777043748.07 total 70.07 last 52.70) - open/close/unlink 4297 (time 1777043758.07 total 80.07 last 60.38) - open/close/unlink 4769 (time 1777043768.08 total 90.08 last 47.17) - open/close/unlink 5228 (time 1777043778.09 total 100.09 last 45.86) - open/close/unlink 5622 (time 1777043788.09 total 110.09 last 39.38) - open/close/unlink 6141 (time 1777043798.11 total 120.11 last 51.83) - open/close/unlink 6682 (time 1777043808.12 total 130.12 last 54.02) - open/close/unlink 7268 (time 1777043818.12 total 140.13 last 58.58) - open/close/unlink 7799 (time 1777043828.13 total 150.13 last 53.06) - open/close/unlink 8401 (time 1777043838.13 total 160.14 last 60.19) - open/close/unlink 8905 (time 1777043848.14 total 170.14 last 50.38) - open/close/unlink 9438 (time 1777043858.15 total 180.15 last 53.24) - open/close/unlink 9904 (time 1777043868.16 total 190.16 last 46.55) - open/close/unlink 10428 (time 1777043878.17 total 200.17 last 52.36) - open/close/unlink 10902 (time 1777043888.17 total 210.17 last 47.40) - open/close/unlink 11378 (time 1777043898.18 total 220.18 last 47.57) - open/close/unlink 11899 (time 1777043908.18 total 230.18 last 52.08) - open/close/unlink 12371 (time 1777043918.19 total 240.20 last 47.13) - open/close/unlink 12843 (time 1777043928.20 total 250.21 last 47.15) - open/close/unlink 13323 (time 1777043938.22 total 260.23 last 47.91) - open/close/unlink 13763 (time 1777043948.24 total 270.25 last 43.91) - open/close/unlink 14251 (time 1777043958.27 total 280.27 last 48.70) - open/close/unlink 14751 (time 1777043968.28 total 290.28 last 49.94) - open/close/unlink 15226 (time 1777043978.28 total 300.28 last 47.48) - open/close/unlink 15781 (time 1777043988.29 total 310.29 last 55.47) - open/close/unlink 16385 (time 1777043998.30 total 320.30 last 60.35) - open/close/unlink 17041 (time 1777044008.31 total 330.31 last 65.51) - open/close/unlink 17596 (time 1777044018.32 total 340.32 last 55.44) - open/close/unlink 18173 (time 1777044028.33 total 350.33 last 57.67) - open/close/unlink 18899 (time 1777044038.33 total 360.33 last 72.59) - open/close/unlink 19520 (time 1777044048.33 total 370.33 last 62.08) - open/close/unlink 20000 (time 1777044055.11 total 377.11 last 70.82) - open/close/unlink 20750 (time 1777044065.11 total 387.11 last 74.99) - open/close/unlink 21355 (time 1777044075.11 total 397.11 last 60.49) - open/close/unlink 21940 (time 1777044085.11 total 407.11 last 58.50) - open/close/unlink 22604 (time 1777044095.12 total 417.13 last 66.33) - open/close/unlink 23291 (time 1777044105.13 total 427.14 last 68.63) - open/close/unlink 24077 (time 1777044115.15 total 437.15 last 78.51) - open/close/unlink 24817 (time 1777044125.16 total 447.16 last 73.93) - open/close/unlink 25505 (time 1777044135.16 total 457.16 last 68.76) - open/close/unlink 26359 (time 1777044145.16 total 467.17 last 85.36) - open/close/unlink 27183 (time 1777044155.17 total 477.17 last 82.39) - open/close/unlink 28062 (time 1777044165.17 total 487.17 last 87.89) - open/close/unlink 29173 (time 1777044175.17 total 497.18 last 111.01) - open/close/unlink 30000 (time 1777044183.90 total 505.90 last 94.77) - open/close/unlink 30954 (time 1777044193.91 total 515.91 last 95.35) - open/close/unlink 31963 (time 1777044203.91 total 525.91 last 100.89) - open/close/unlink 33040 (time 1777044213.91 total 535.91 last 107.64) - open/close/unlink 33870 (time 1777044223.91 total 545.91 last 83.00) - open/close/unlink 34685 (time 1777044233.92 total 555.92 last 81.44) - open/close/unlink 35858 (time 1777044243.93 total 565.93 last 117.20) - open/close/unlink 36679 (time 1777044253.93 total 575.93 last 82.10) - open/close/unlink 37514 (time 1777044263.94 total 585.94 last 83.41) - open/close/unlink 38487 (time 1777044273.95 total 595.95 last 97.23) - open/close/unlink 39328 (time 1777044283.95 total 605.95 last 84.09) - open/close/unlink 40000 (time 1777044293.79 total 615.79 last 68.27) - open/close/unlink 40869 (time 1777044303.79 total 625.79 last 86.90) - open/close/unlink 41754 (time 1777044313.81 total 635.81 last 88.34) - open/close/unlink 42643 (time 1777044323.81 total 645.82 last 88.87) - open/close/unlink 43435 (time 1777044333.83 total 655.83 last 79.12) - open/close/unlink 44170 (time 1777044343.85 total 665.85 last 73.35) - open/close/unlink 45166 (time 1777044353.86 total 675.86 last 99.49) - open/close/unlink 46019 (time 1777044363.87 total 685.87 last 85.22) - open/close/unlink 46802 (time 1777044373.87 total 695.87 last 78.27) - open/close/unlink 47782 (time 1777044383.88 total 705.88 last 97.93) - open/close/unlink 48719 (time 1777044393.88 total 715.88 last 93.67) - open/close/unlink 49648 (time 1777044403.88 total 725.88 last 92.87) - open/close/unlink 50000 (time 1777044407.96 total 729.96 last 86.35) - open/close/unlink 51096 (time 1777044417.96 total 739.97 last 109.54) - open/close/unlink 52215 (time 1777044427.97 total 749.97 last 111.89) - open/close/unlink 53523 (time 1777044437.98 total 759.98 last 130.66) - open/close/unlink 54726 (time 1777044447.98 total 769.98 last 120.28) - open/close/unlink 56013 (time 1777044457.99 total 779.99 last 128.59) - open/close/unlink 57198 (time 1777044467.99 total 789.99 last 118.49) - open/close/unlink 58219 (time 1777044477.99 total 799.99 last 102.08) - open/close/unlink 59286 (time 1777044487.99 total 810.00 last 106.64) - open/close/unlink 60000 (time 1777044495.50 total 817.50 last 95.12) - open/close/unlink 60785 (time 1777044505.51 total 827.51 last 78.46) - open/close/unlink 61858 (time 1777044515.51 total 837.51 last 107.25) - open/close/unlink 62892 (time 1777044525.51 total 847.52 last 103.37) - open/close/unlink 64095 (time 1777044535.52 total 857.52 last 120.25) total: 64768 open/close/unlink in 862.76 seconds: 75.07 ops/second nk 36688 (time 1777044253.85 total 575.70 last 82.32) - open/close/unlink 37519 (time 1777044263.85 total 585.70 last 83.09) - open/close/unlink 38489 (time 1777044273.85 total 595.70 last 96.94) - open/close/unlink 39338 (time 1777044283.86 total 605.71 last 84.86) - open/close/unlink 40000 (time 1777044293.53 total 615.38 last 68.43) - open/close/unlink 40864 (time 1777044303.54 total 625.39 last 86.36) - open/close/unlink 41762 (time 1777044313.54 total 635.40 last 89.73) - open/close/unlink 42655 (time 1777044323.55 total 645.40 last 89.26) - open/close/unlink 43441 (time 1777044333.55 total 655.40 last 78.58) - open/close/unlink 44185 (time 1777044343.57 total 665.42 last 74.25) - open/close/unlink 45167 (time 1777044353.60 total 675.45 last 97.94) - open/close/unlink 46016 (time 1777044363.61 total 685.46 last 84.81) - open/close/unlink 46808 (time 1777044373.61 total 695.46 last 79.17) - open/close/unlink 47777 (time 1777044383.62 total 705.47 last 96.82) - open/close/unlink 48720 (time 1777044393.63 total 715.48 last 94.20) - open/close/unlink 49645 (time 1777044403.64 total 725.49 last 92.44) - open/close/unlink 50000 (time 1777044407.79 total 729.64 last 85.56) - open/close/unlink 51096 (time 1777044417.79 total 739.64 last 109.55) - open/close/unlink 52217 (time 1777044427.80 total 749.65 last 111.98) - open/close/unlink 53517 (time 1777044437.81 total 759.67 last 129.85) - open/close/unlink 54711 (time 1777044447.82 total 769.67 last 119.38) - open/close/unlink 56004 (time 1777044457.82 total 779.67 last 129.26) - open/close/unlink 57191 (time 1777044467.82 total 789.67 last 118.66) - open/close/unlink 58218 (time 1777044477.83 total 799.68 last 102.59) - open/close/unlink 59270 (time 1777044487.84 total 809.69 last 105.13) - open/close/unlink 60000 (time 1777044495.45 total 817.30 last 95.96) - open/close/unlink 60792 (time 1777044505.45 total 827.30 last 79.16) - open/close/unlink 61865 (time 1777044515.46 total 837.31 last 107.25) - open/close/unlink 62879 (time 1777044525.46 total 847.31 last 101.37) - open/close/unlink 64081 (time 1777044535.46 total 857.31 last 120.20) total: 64768 open/close/unlink in 862.74 seconds: 75.07 ops/second nk 35877 (time 1777044243.81 total 565.71 last 117.78) - open/close/unlink 36703 (time 1777044253.81 total 575.72 last 82.56) - open/close/unlink 37548 (time 1777044263.82 total 585.73 last 84.40) - open/close/unlink 38507 (time 1777044273.82 total 595.73 last 95.88) - open/close/unlink 39354 (time 1777044283.84 total 605.74 last 84.59) - open/close/unlink 40000 (time 1777044293.43 total 615.33 last 67.37) - open/close/unlink 40858 (time 1777044303.43 total 625.34 last 85.77) - open/close/unlink 41766 (time 1777044313.44 total 635.34 last 90.74) - open/close/unlink 42661 (time 1777044323.44 total 645.34 last 89.49) - open/close/unlink 43450 (time 1777044333.44 total 655.35 last 78.87) - open/close/unlink 44192 (time 1777044343.45 total 665.36 last 74.11) - open/close/unlink 45182 (time 1777044353.46 total 675.36 last 98.95) - open/close/unlink 46017 (time 1777044363.46 total 685.37 last 83.44) - open/close/unlink 46806 (time 1777044373.47 total 695.38 last 78.82) - open/close/unlink 47754 (time 1777044383.48 total 705.39 last 94.74) - open/close/unlink 48719 (time 1777044393.50 total 715.40 last 96.34) - open/close/unlink 49625 (time 1777044403.50 total 725.41 last 90.59) - open/close/unlink 50000 (time 1777044407.75 total 729.66 last 88.11) - open/close/unlink 51081 (time 1777044417.76 total 739.67 last 108.02) - open/close/unlink 52202 (time 1777044427.76 total 749.67 last 112.09) - open/close/unlink 53512 (time 1777044437.77 total 759.68 last 130.88) - open/close/unlink 54700 (time 1777044447.77 total 769.68 last 118.78) - open/close/unlink 56002 (time 1777044457.78 total 779.69 last 130.12) - open/close/unlink 57190 (time 1777044467.78 total 789.69 last 118.77) - open/close/unlink 58211 (time 1777044477.79 total 799.69 last 102.07) - open/close/unlink 59256 (time 1777044487.79 total 809.70 last 104.47) - open/close/unlink 60000 (time 1777044495.54 total 817.45 last 95.93) - open/close/unlink 60775 (time 1777044505.56 total 827.47 last 77.38) - open/close/unlink 61846 (time 1777044515.56 total 837.47 last 107.08) - open/close/unlink 62883 (time 1777044525.56 total 847.47 last 103.68) - open/close/unlink 64086 (time 1777044535.56 total 857.47 last 120.28) total: 64768 open/close/unlink in 862.91 seconds: 75.06 ops/second nk 35844 (time 1777044244.23 total 565.95 last 117.00) - open/close/unlink 36658 (time 1777044254.24 total 575.96 last 81.33) - open/close/unlink 37491 (time 1777044264.25 total 585.97 last 83.17) - open/close/unlink 38489 (time 1777044274.26 total 595.98 last 99.75) - open/close/unlink 39311 (time 1777044284.27 total 605.99 last 82.10) - open/close/unlink 40000 (time 1777044294.07 total 615.79 last 70.27) - open/close/unlink 40858 (time 1777044304.08 total 625.80 last 85.77) - open/close/unlink 41732 (time 1777044314.08 total 635.80 last 87.36) - open/close/unlink 42632 (time 1777044324.11 total 645.83 last 89.74) - open/close/unlink 43433 (time 1777044334.11 total 655.83 last 80.08) - open/close/unlink 44162 (time 1777044344.12 total 665.83 last 72.89) - open/close/unlink 45161 (time 1777044354.12 total 675.84 last 99.84) - open/close/unlink 46011 (time 1777044364.13 total 685.85 last 84.91) - open/close/unlink 46789 (time 1777044374.14 total 695.86 last 77.73) - open/close/unlink 47770 (time 1777044384.15 total 705.86 last 98.07) - open/close/unlink 48686 (time 1777044394.15 total 715.87 last 91.57) - open/close/unlink 49634 (time 1777044404.15 total 725.87 last 94.78) - open/close/unlink 50000 (time 1777044408.40 total 730.12 last 86.13) - open/close/unlink 51095 (time 1777044418.40 total 740.12 last 109.45) - open/close/unlink 52218 (time 1777044428.41 total 750.13 last 112.21) - open/close/unlink 53509 (time 1777044438.42 total 760.14 last 128.97) - open/close/unlink 54716 (time 1777044448.43 total 770.15 last 120.62) - open/close/unlink 55998 (time 1777044458.43 total 780.15 last 128.19) - open/close/unlink 57187 (time 1777044468.44 total 790.15 last 118.82) - open/close/unlink 58194 (time 1777044478.44 total 800.16 last 100.63) - open/close/unlink 59257 (time 1777044488.44 total 810.16 last 106.29) - open/close/unlink 60000 (time 1777044496.18 total 817.90 last 96.09) - open/close/unlink 60758 (time 1777044506.18 total 827.90 last 75.75) - open/close/unlink 61855 (time 1777044516.18 total 837.90 last 109.70) - open/close/unlink 62911 (time 1777044526.19 total 847.91 last 105.54) - open/close/unlink 64076 (time 1777044536.20 total 857.92 last 116.41) total: 64768 open/close/unlink in 864.09 seconds: 74.96 ops/second nk 35830 (time 1777044244.05 total 565.88 last 115.97) - open/close/unlink 36646 (time 1777044254.06 total 575.88 last 81.57) - open/close/unlink 37478 (time 1777044264.06 total 585.89 last 83.16) - open/close/unlink 38461 (time 1777044274.06 total 595.89 last 98.28) - open/close/unlink 39287 (time 1777044284.07 total 605.89 last 82.57) - open/close/unlink 39976 (time 1777044294.07 total 615.89 last 68.88) - open/close/unlink 40833 (time 1777044304.07 total 625.90 last 85.66) - open/close/unlink 41715 (time 1777044314.08 total 635.91 last 88.14) - open/close/unlink 42606 (time 1777044324.08 total 645.91 last 89.08) - open/close/unlink 43412 (time 1777044334.09 total 655.92 last 80.53) - open/close/unlink 44150 (time 1777044344.09 total 665.92 last 73.78) - open/close/unlink 45150 (time 1777044354.11 total 675.94 last 99.85) - open/close/unlink 45998 (time 1777044364.12 total 685.94 last 84.72) - open/close/unlink 46770 (time 1777044374.14 total 695.96 last 77.06) - open/close/unlink 47750 (time 1777044384.14 total 705.97 last 97.98) - open/close/unlink 48671 (time 1777044394.15 total 715.98 last 91.99) - open/close/unlink 49620 (time 1777044404.16 total 725.98 last 94.84) - open/close/unlink 50000 (time 1777044408.59 total 730.42 last 85.75) - open/close/unlink 51095 (time 1777044418.59 total 740.42 last 109.45) - open/close/unlink 52223 (time 1777044428.59 total 750.42 last 112.79) - open/close/unlink 53505 (time 1777044438.60 total 760.42 last 128.16) - open/close/unlink 54731 (time 1777044448.60 total 770.43 last 122.53) - open/close/unlink 56005 (time 1777044458.61 total 780.44 last 127.32) - open/close/unlink 57193 (time 1777044468.62 total 790.45 last 118.64) - open/close/unlink 58199 (time 1777044478.63 total 800.46 last 100.51) - open/close/unlink 59275 (time 1777044488.64 total 810.47 last 107.53) - open/close/unlink 60000 (time 1777044496.31 total 818.13 last 94.57) - open/close/unlink 60764 (time 1777044506.31 total 828.13 last 76.39) - open/close/unlink 61877 (time 1777044516.31 total 838.14 last 111.25) - open/close/unlink 62936 (time 1777044526.32 total 848.14 last 105.86) - open/close/unlink 64094 (time 1777044536.32 total 858.14 last 115.76) total: 64768 open/close/unlink in 864.21 seconds: 74.94 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg247-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg247-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg247-server stop mds service on oleg247-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg247-server unloading modules via unload_modules_local on: 'oleg247-server' oleg247-server: oleg247-server.virtnet: executing unload_modules_local oleg247-server: modules unloaded. pdsh@oleg247-client: oleg247-client: ssh exited with exit code 2 pdsh@oleg247-client: oleg247-server: ssh exited with exit code 2 pdsh@oleg247-client: oleg247-server: ssh exited with exit code 2 pdsh@oleg247-client: oleg247-client: ssh exited with exit code 2 PASS 106 (929s) Stopping clients: oleg247-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg247-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg247-client: oleg247-server: ssh exited with exit code 2 oleg247-server: oleg247-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg247-server' oleg247-server: oleg247-server.virtnet: executing load_modules_local oleg247-server: Loading modules from /home/green/git/lustre-release/lustre oleg247-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg247-server: detected 4 online CPUs by sysfs oleg247-server: MODOPTS_LIBCFS= oleg247-server: Force libcfs to create 2 CPU partitions oleg247-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg247-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg247-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 1062 sec ========== 11:30:09 (1777044609) === conf-sanity: start cleanup 11:30:10 (1777044610) === === conf-sanity: finish cleanup 11:30:11 (1777044611) ===