-----============= acceptance-small: conf-sanity ============----- Mon May 4 11:55:40 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg317-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg317-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg317-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg317-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg317-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg317-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg317-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg317-server oleg317-server: oleg317-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg317-server' oleg317-server: oleg317-server.virtnet: executing load_modules_local oleg317-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg317-server: Loading modules from /home/green/git/lustre-release/lustre oleg317-server: detected 4 online CPUs by sysfs oleg317-server: MODOPTS_LIBCFS= oleg317-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg317-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg317-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg317-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg317-server: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg317-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg317-server: oleg317-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg317-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg317-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg317-server stop mds service on oleg317-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg317-server stop mds service on oleg317-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg317-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 11:58:05 (1777910285) start mds service on oleg317-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg317-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg317-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Started lustre-OST0000 oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg317-client.virtnet: -o user_xattr,flock 192.168.203.117@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 432 49568 1% /mnt/lustre[OST:0] filesystem_summary: 50097 529 49568 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 434 (time 1777910341.37 total 10.02 last 43.31) - open/close/unlink 848 (time 1777910351.39 total 20.04 last 41.33) - open/close/unlink 1203 (time 1777910361.40 total 30.04 last 35.48) - open/close/unlink 1660 (time 1777910371.40 total 40.05 last 45.67) - open/close/unlink 2129 (time 1777910381.40 total 50.05 last 46.89) - open/close/unlink 2579 (time 1777910391.41 total 60.06 last 44.95) - open/close/unlink 2978 (time 1777910401.43 total 70.08 last 39.82) - open/close/unlink 3339 (time 1777910411.44 total 80.08 last 36.09) - open/close/unlink 3743 (time 1777910421.44 total 90.09 last 40.40) - open/close/unlink 4159 (time 1777910431.45 total 100.09 last 41.56) - open/close/unlink 4606 (time 1777910441.45 total 110.10 last 44.69) - open/close/unlink 5024 (time 1777910451.45 total 120.10 last 41.78) - open/close/unlink 5613 (time 1777910461.47 total 130.11 last 58.83) - open/close/unlink 6191 (time 1777910471.48 total 140.12 last 57.74) - open/close/unlink 6853 (time 1777910481.49 total 150.13 last 66.13) - open/close/unlink 7606 (time 1777910491.49 total 160.14 last 75.30) - open/close/unlink 8431 (time 1777910501.51 total 170.16 last 82.34) - open/close/unlink 9346 (time 1777910511.51 total 180.16 last 91.49) - open/close/unlink 10000 (time 1777910517.46 total 186.11 last 109.89) - open/close/unlink 10832 (time 1777910527.47 total 196.12 last 83.12) - open/close/unlink 11596 (time 1777910537.47 total 206.12 last 76.40) - open/close/unlink 12536 (time 1777910547.47 total 216.12 last 93.98) - open/close/unlink 13399 (time 1777910557.47 total 226.12 last 86.27) - open/close/unlink 13992 (time 1777910567.47 total 236.12 last 59.30) - open/close/unlink 14679 (time 1777910577.48 total 246.13 last 68.65) - open/close/unlink 15346 (time 1777910587.48 total 256.13 last 66.70) - open/close/unlink 15969 (time 1777910597.48 total 266.13 last 62.29) - open/close/unlink 16678 (time 1777910607.49 total 276.14 last 70.87) - open/close/unlink 17359 (time 1777910617.49 total 286.14 last 68.09) - open/close/unlink 18091 (time 1777910627.50 total 296.15 last 73.14) - open/close/unlink 18790 (time 1777910637.50 total 306.15 last 69.89) - open/close/unlink 19440 (time 1777910647.51 total 316.16 last 64.92) - open/close/unlink 20000 (time 1777910655.52 total 324.16 last 69.95) - open/close/unlink 20626 (time 1777910665.52 total 334.16 last 62.60) - open/close/unlink 21302 (time 1777910675.52 total 344.17 last 67.59) - open/close/unlink 22022 (time 1777910685.52 total 354.17 last 71.97) - open/close/unlink 22710 (time 1777910695.53 total 364.18 last 68.75) - open/close/unlink 23547 (time 1777910705.53 total 374.18 last 83.67) - open/close/unlink 24293 (time 1777910715.54 total 384.18 last 74.57) - open/close/unlink 25175 (time 1777910725.54 total 394.19 last 88.15) - open/close/unlink 26037 (time 1777910735.54 total 404.19 last 86.20) - open/close/unlink 26751 (time 1777910745.55 total 414.20 last 71.35) - open/close/unlink 27505 (time 1777910755.56 total 424.21 last 75.35) - open/close/unlink 28344 (time 1777910765.56 total 434.21 last 83.87) - open/close/unlink 29170 (time 1777910775.56 total 444.21 last 82.58) - open/close/unlink 29990 (time 1777910785.57 total 454.22 last 81.90) - open/close/unlink 30691 (time 1777910795.58 total 464.22 last 70.09) - open/close/unlink 31449 (time 1777910805.59 total 474.24 last 75.68) - open/close/unlink 32195 (time 1777910815.59 total 484.24 last 74.59) - open/close/unlink 33162 (time 1777910825.61 total 494.26 last 96.56) - open/close/unlink 34026 (time 1777910835.61 total 504.26 last 86.37) - open/close/unlink 35117 (time 1777910845.62 total 514.27 last 108.99) - open/close/unlink 36071 (time 1777910855.63 total 524.27 last 95.34) - open/close/unlink 37144 (time 1777910865.63 total 534.27 last 107.30) - open/close/unlink 38104 (time 1777910875.63 total 544.28 last 95.96) - open/close/unlink 38919 (time 1777910885.64 total 554.28 last 81.45) - open/close/unlink 39786 (time 1777910895.64 total 564.29 last 86.68) - open/close/unli - open/close/unlink 430 (time 1777910341.39 total 10.01 last 42.94) - open/close/unlink 846 (time 1777910351.42 total 20.04 last 41.50) - open/close/unlink 1205 (time 1777910361.43 total 30.05 last 35.88) - open/close/unlink 1662 (time 1777910371.44 total 40.06 last 45.64) - open/close/unlink 2132 (time 1777910381.45 total 50.07 last 46.93) - open/close/unlink 2579 (time 1777910391.47 total 60.09 last 44.64) - open/close/unlink 2979 (time 1777910401.49 total 70.11 last 39.93) - open/close/unlink 3335 (time 1777910411.50 total 80.12 last 35.56) - open/close/unlink 3743 (time 1777910421.51 total 90.13 last 40.75) - open/close/unlink 4167 (time 1777910431.53 total 100.15 last 42.33) - open/close/unlink 4613 (time 1777910441.54 total 110.16 last 44.56) - open/close/unlink 5027 (time 1777910451.56 total 120.18 last 41.30) - open/close/unlink 5613 (time 1777910461.57 total 130.19 last 58.53) - open/close/unlink 6190 (time 1777910471.58 total 140.20 last 57.63) - open/close/unlink 6851 (time 1777910481.59 total 150.21 last 66.04) - open/close/unlink 7609 (time 1777910491.59 total 160.22 last 75.78) - open/close/unlink 8424 (time 1777910501.60 total 170.22 last 81.44) - open/close/unlink 9343 (time 1777910511.61 total 180.23 last 91.85) - open/close/unlink 10000 (time 1777910517.65 total 186.27 last 108.83) - open/close/unlink 10826 (time 1777910527.66 total 196.28 last 82.52) - open/close/unlink 11592 (time 1777910537.66 total 206.29 last 76.53) - open/close/unlink 12531 (time 1777910547.67 total 216.29 last 93.81) - open/close/unlink 13383 (time 1777910557.68 total 226.30 last 85.17) - open/close/unlink 13978 (time 1777910567.69 total 236.31 last 59.44) - open/close/unlink 14677 (time 1777910577.70 total 246.32 last 69.82) - open/close/unlink 15339 (time 1777910587.70 total 256.32 last 66.19) - open/close/unlink 15967 (time 1777910597.70 total 266.32 last 62.80) - open/close/unlink 16676 (time 1777910607.72 total 276.34 last 70.75) - open/close/unlink 17356 (time 1777910617.73 total 286.35 last 67.95) - open/close/unlink 18080 (time 1777910627.73 total 296.35 last 72.38) - open/close/unlink 18760 (time 1777910637.75 total 306.37 last 67.91) - open/close/unlink 19411 (time 1777910647.75 total 316.37 last 65.08) - open/close/unlink 20000 (time 1777910656.12 total 324.74 last 70.35) - open/close/unlink 20624 (time 1777910666.12 total 334.74 last 62.40) - open/close/unlink 21300 (time 1777910676.13 total 344.75 last 67.54) - open/close/unlink 22028 (time 1777910686.15 total 354.77 last 72.65) - open/close/unlink 22708 (time 1777910696.16 total 364.78 last 67.95) - open/close/unlink 23548 (time 1777910706.16 total 374.78 last 83.98) - open/close/unlink 24309 (time 1777910716.17 total 384.79 last 76.05) - open/close/unlink 25194 (time 1777910726.18 total 394.80 last 88.40) - open/close/unlink 26043 (time 1777910736.19 total 404.81 last 84.87) - open/close/unlink 26753 (time 1777910746.20 total 414.82 last 70.92) - open/close/unlink 27540 (time 1777910756.20 total 424.82 last 78.67) - open/close/unlink 28368 (time 1777910766.21 total 434.83 last 82.69) - open/close/unlink 29199 (time 1777910776.22 total 444.84 last 83.08) - open/close/unlink 30000 (time 1777910786.02 total 454.64 last 81.71) - open/close/unlink 30698 (time 1777910796.02 total 464.64 last 69.79) - open/close/unlink 31455 (time 1777910806.03 total 474.65 last 75.66) - open/close/unlink 32214 (time 1777910816.03 total 484.65 last 75.84) - open/close/unlink 33171 (time 1777910826.06 total 494.68 last 95.43) - open/close/unlink 34060 (time 1777910836.07 total 504.69 last 88.86) - open/close/unlink 35147 (time 1777910846.07 total 514.69 last 108.65) - open/close/unlink 36103 (time 1777910856.08 total 524.70 last 95.56) - open/close/unlink 37181 (time 1777910866.08 total 534.70 last 107.71) - open/close/unlink 38130 (time 1777910876.10 total 544.72 last 94.78) - open/close/unlink 38955 (time 1777910886.11 total 554.73 last 82.39) - open/close/unlink 39829 (time 1777910896.11 total 564.73 last 87.36) - open/close/unli - open/close/unlink 430 (time 1777910341.66 total 10.03 last 42.85) - open/close/unlink 845 (time 1777910351.68 total 20.05 last 41.42) - open/close/unlink 1203 (time 1777910361.71 total 30.08 last 35.69) - open/close/unlink 1663 (time 1777910371.74 total 40.11 last 45.90) - open/close/unlink 2131 (time 1777910381.74 total 50.11 last 46.78) - open/close/unlink 2591 (time 1777910391.74 total 60.11 last 45.99) - open/close/unlink 2983 (time 1777910401.75 total 70.13 last 39.15) - open/close/unlink 3340 (time 1777910411.76 total 80.13 last 35.69) - open/close/unlink 3747 (time 1777910421.77 total 90.14 last 40.65) - open/close/unlink 4166 (time 1777910431.79 total 100.16 last 41.82) - open/close/unlink 4617 (time 1777910441.81 total 110.19 last 44.98) - open/close/unlink 5038 (time 1777910451.82 total 120.19 last 42.06) - open/close/unlink 5615 (time 1777910461.84 total 130.21 last 57.62) - open/close/unlink 6205 (time 1777910471.86 total 140.23 last 58.88) - open/close/unlink 6863 (time 1777910481.87 total 150.24 last 65.71) - open/close/unlink 7625 (time 1777910491.88 total 160.25 last 76.15) - open/close/unlink 8435 (time 1777910501.89 total 170.26 last 80.88) - open/close/unlink 9379 (time 1777910511.90 total 180.27 last 94.36) - open/close/unlink 10000 (time 1777910517.81 total 186.18 last 105.07) - open/close/unlink 10820 (time 1777910527.82 total 196.19 last 81.91) - open/close/unlink 11585 (time 1777910537.83 total 206.20 last 76.39) - open/close/unlink 12531 (time 1777910547.84 total 216.21 last 94.55) - open/close/unlink 13373 (time 1777910557.85 total 226.22 last 84.12) - open/close/unlink 13968 (time 1777910567.85 total 236.23 last 59.46) - open/close/unlink 14665 (time 1777910577.86 total 246.23 last 69.66) - open/close/unlink 15323 (time 1777910587.86 total 256.24 last 65.78) - open/close/unlink 15945 (time 1777910597.87 total 266.25 last 62.14) - open/close/unlink 16641 (time 1777910607.88 total 276.25 last 69.57) - open/close/unlink 17323 (time 1777910617.88 total 286.25 last 68.17) - open/close/unlink 18050 (time 1777910627.89 total 296.26 last 72.65) - open/close/unlink 18730 (time 1777910637.90 total 306.27 last 67.94) - open/close/unlink 19388 (time 1777910647.91 total 316.28 last 65.72) - open/close/unlink 20000 (time 1777910656.82 total 325.19 last 68.69) - open/close/unlink 20635 (time 1777910666.83 total 335.20 last 63.47) - open/close/unlink 21312 (time 1777910676.83 total 345.20 last 67.69) - open/close/unlink 22047 (time 1777910686.83 total 355.20 last 73.45) - open/close/unlink 22759 (time 1777910696.84 total 365.21 last 71.15) - open/close/unlink 23579 (time 1777910706.86 total 375.23 last 81.83) - open/close/unlink 24356 (time 1777910716.87 total 385.24 last 77.65) - open/close/unlink 25255 (time 1777910726.87 total 395.24 last 89.88) - open/close/unlink 26081 (time 1777910736.88 total 405.25 last 82.55) - open/close/unlink 26791 (time 1777910746.89 total 415.26 last 70.89) - open/close/unlink 27598 (time 1777910756.90 total 425.27 last 80.66) - open/close/unlink 28410 (time 1777910766.90 total 435.27 last 81.14) - open/close/unlink 29232 (time 1777910776.91 total 445.28 last 82.14) - open/close/unlink 30000 (time 1777910786.26 total 454.63 last 82.13) - open/close/unlink 30696 (time 1777910796.27 total 464.64 last 69.54) - open/close/unlink 31444 (time 1777910806.28 total 474.65 last 74.73) - open/close/unlink 32220 (time 1777910816.29 total 484.66 last 77.53) - open/close/unlink 33156 (time 1777910826.29 total 494.66 last 93.56) - open/close/unlink 34048 (time 1777910836.30 total 504.67 last 89.15) - open/close/unlink 35144 (time 1777910846.30 total 514.67 last 109.57) - open/close/unlink 36086 (time 1777910856.30 total 524.67 last 94.19) - open/close/unlink 37175 (time 1777910866.31 total 534.68 last 108.85) - open/close/unlink 38103 (time 1777910876.32 total 544.69 last 92.70) - open/close/unlink 38938 (time 1777910886.33 total 554.70 last 83.40) - open/close/unlink 39813 (time 1777910896.33 total 564.71 last 87.46) - open/close/unli - open/close/unlink 435 (time 1777910341.63 total 10.02 last 43.42) - open/close/unlink 851 (time 1777910351.63 total 20.02 last 41.58) - open/close/unlink 1214 (time 1777910361.64 total 30.03 last 36.27) - open/close/unlink 1675 (time 1777910371.65 total 40.04 last 46.05) - open/close/unlink 2144 (time 1777910381.67 total 50.06 last 46.81) - open/close/unlink 2598 (time 1777910391.67 total 60.06 last 45.40) - open/close/unlink 2992 (time 1777910401.68 total 70.07 last 39.35) - open/close/unlink 3348 (time 1777910411.70 total 80.09 last 35.56) - open/close/unlink 3754 (time 1777910421.71 total 90.10 last 40.54) - open/close/unlink 4172 (time 1777910431.73 total 100.12 last 41.73) - open/close/unlink 4619 (time 1777910441.73 total 110.12 last 44.70) - open/close/unlink 5043 (time 1777910451.73 total 120.12 last 42.40) - open/close/unlink 5629 (time 1777910461.76 total 130.15 last 58.42) - open/close/unlink 6208 (time 1777910471.77 total 140.16 last 57.86) - open/close/unlink 6868 (time 1777910481.77 total 150.16 last 66.00) - open/close/unlink 7629 (time 1777910491.77 total 160.16 last 76.10) - open/close/unlink 8439 (time 1777910501.78 total 170.17 last 80.93) - open/close/unlink 9371 (time 1777910511.78 total 180.17 last 93.19) - open/close/unlink 10000 (time 1777910517.76 total 186.15 last 105.18) - open/close/unlink 10830 (time 1777910527.77 total 196.16 last 82.90) - open/close/unlink 11598 (time 1777910537.78 total 206.17 last 76.77) - open/close/unlink 12543 (time 1777910547.78 total 216.17 last 94.50) - open/close/unlink 13388 (time 1777910557.78 total 226.17 last 84.45) - open/close/unlink 13981 (time 1777910567.79 total 236.18 last 59.27) - open/close/unlink 14675 (time 1777910577.80 total 246.19 last 69.34) - open/close/unlink 15336 (time 1777910587.81 total 256.20 last 66.04) - open/close/unlink 15965 (time 1777910597.81 total 266.20 last 62.87) - open/close/unlink 16668 (time 1777910607.82 total 276.21 last 70.26) - open/close/unlink 17355 (time 1777910617.82 total 286.21 last 68.68) - open/close/unlink 18077 (time 1777910627.82 total 296.21 last 72.18) - open/close/unlink 18753 (time 1777910637.83 total 306.22 last 67.57) - open/close/unlink 19405 (time 1777910647.83 total 316.22 last 65.18) - open/close/unlink 20000 (time 1777910656.35 total 324.74 last 69.86) - open/close/unlink 20631 (time 1777910666.35 total 334.74 last 63.05) - open/close/unlink 21300 (time 1777910676.36 total 344.75 last 66.84) - open/close/unlink 22026 (time 1777910686.36 total 354.75 last 72.59) - open/close/unlink 22718 (time 1777910696.37 total 364.76 last 69.18) - open/close/unlink 23546 (time 1777910706.37 total 374.76 last 82.78) - open/close/unlink 24307 (time 1777910716.38 total 384.77 last 76.03) - open/close/unlink 25189 (time 1777910726.38 total 394.77 last 88.18) - open/close/unlink 26020 (time 1777910736.38 total 404.77 last 83.10) - open/close/unlink 26735 (time 1777910746.39 total 414.78 last 71.43) - open/close/unlink 27526 (time 1777910756.40 total 424.79 last 79.04) - open/close/unlink 28344 (time 1777910766.41 total 434.80 last 81.74) - open/close/unlink 29168 (time 1777910776.41 total 444.80 last 82.38) - open/close/unlink 29989 (time 1777910786.41 total 454.80 last 82.07) - open/close/unlink 30677 (time 1777910796.41 total 464.80 last 68.80) - open/close/unlink 31414 (time 1777910806.43 total 474.82 last 73.59) - open/close/unlink 32199 (time 1777910816.43 total 484.82 last 78.47) - open/close/unlink 33136 (time 1777910826.45 total 494.84 last 93.57) - open/close/unlink 34032 (time 1777910836.45 total 504.84 last 89.56) - open/close/unlink 35130 (time 1777910846.46 total 514.85 last 109.69) - open/close/unlink 36084 (time 1777910856.46 total 524.85 last 95.36) - open/close/unlink 37194 (time 1777910866.47 total 534.86 last 110.90) - open/close/unlink 38126 (time 1777910876.48 total 544.87 last 93.14) - open/close/unlink 38948 (time 1777910886.49 total 554.88 last 82.14) - open/close/unlink 39819 (time 1777910896.49 total 564.88 last 87.08) - open/close/unli - open/close/unlink 436 (time 1777910341.63 total 10.02 last 43.52) - open/close/unlink 850 (time 1777910351.64 total 20.03 last 41.33) - open/close/unlink 1205 (time 1777910361.66 total 30.05 last 35.46) - open/close/unlink 1664 (time 1777910371.67 total 40.06 last 45.84) - open/close/unlink 2133 (time 1777910381.67 total 50.06 last 46.89) - open/close/unlink 2589 (time 1777910391.67 total 60.06 last 45.59) - open/close/unlink 2982 (time 1777910401.68 total 70.07 last 39.28) - open/close/unlink 3342 (time 1777910411.70 total 80.09 last 35.94) - open/close/unlink 3745 (time 1777910421.70 total 90.09 last 40.28) - open/close/unlink 4168 (time 1777910431.74 total 100.13 last 42.14) - open/close/unlink 4610 (time 1777910441.76 total 110.15 last 44.10) - open/close/unlink 5031 (time 1777910451.77 total 120.16 last 42.07) - open/close/unlink 5610 (time 1777910461.82 total 130.21 last 57.61) - open/close/unlink 6193 (time 1777910471.83 total 140.22 last 58.23) - open/close/unlink 6854 (time 1777910481.84 total 150.23 last 66.03) - open/close/unlink 7617 (time 1777910491.85 total 160.24 last 76.26) - open/close/unlink 8428 (time 1777910501.86 total 170.25 last 81.02) - open/close/unlink 9364 (time 1777910511.86 total 180.25 last 93.53) - open/close/unlink 10000 (time 1777910517.94 total 186.33 last 104.65) - open/close/unlink 10815 (time 1777910527.95 total 196.33 last 81.46) - open/close/unlink 11585 (time 1777910537.95 total 206.34 last 76.93) - open/close/unlink 12537 (time 1777910547.96 total 216.35 last 95.16) - open/close/unlink 13377 (time 1777910557.96 total 226.35 last 84.00) - open/close/unlink 13968 (time 1777910567.97 total 236.36 last 59.04) - open/close/unlink 14665 (time 1777910577.97 total 246.36 last 69.67) - open/close/unlink 15324 (time 1777910587.97 total 256.36 last 65.89) - open/close/unlink 15957 (time 1777910597.98 total 266.37 last 63.28) - open/close/unlink 16660 (time 1777910607.99 total 276.38 last 70.19) - open/close/unlink 17339 (time 1777910618.01 total 286.40 last 67.78) - open/close/unlink 18078 (time 1777910628.01 total 296.40 last 73.88) - open/close/unlink 18762 (time 1777910638.02 total 306.41 last 68.34) - open/close/unlink 19421 (time 1777910648.02 total 316.41 last 65.88) - open/close/unlink 20000 (time 1777910656.29 total 324.68 last 70.06) - open/close/unlink 20625 (time 1777910666.29 total 334.68 last 62.47) - open/close/unlink 21309 (time 1777910676.30 total 344.69 last 68.38) - open/close/unlink 22040 (time 1777910686.31 total 354.70 last 73.02) - open/close/unlink 22720 (time 1777910696.31 total 364.70 last 67.98) - open/close/unlink 23568 (time 1777910706.32 total 374.71 last 84.73) - open/close/unlink 24326 (time 1777910716.32 total 384.71 last 75.78) - open/close/unlink 25211 (time 1777910726.33 total 394.72 last 88.46) - open/close/unlink 26049 (time 1777910736.33 total 404.72 last 83.77) - open/close/unlink 26759 (time 1777910746.34 total 414.73 last 70.91) - open/close/unlink 27542 (time 1777910756.35 total 424.73 last 78.28) - open/close/unlink 28366 (time 1777910766.36 total 434.75 last 82.28) - open/close/unlink 29193 (time 1777910776.37 total 444.76 last 82.62) - open/close/unlink 30000 (time 1777910786.16 total 454.55 last 82.46) - open/close/unlink 30706 (time 1777910796.17 total 464.55 last 70.54) - open/close/unlink 31450 (time 1777910806.18 total 474.57 last 74.31) - open/close/unlink 32216 (time 1777910816.19 total 484.58 last 76.51) - open/close/unlink 33160 (time 1777910826.20 total 494.58 last 94.34) - open/close/unlink 34052 (time 1777910836.21 total 504.59 last 89.11) - open/close/unlink 35149 (time 1777910846.21 total 514.60 last 109.68) - open/close/unlink 36100 (time 1777910856.21 total 524.60 last 95.10) - open/close/unlink 37193 (time 1777910866.21 total 534.60 last 109.27) - open/close/unlink 38141 (time 1777910876.21 total 544.60 last 94.76) - open/close/unlink 38972 (time 1777910886.22 total 554.61 last 83.04) - open/close/unlink 39852 (time 1777910896.23 total 564.62 last 87.93) - open/close/unlink 40000 (time 1777910898.14 total 566.76 last 84.51) - open/close/unlink 40846 (time 1777910908.15 total 576.77 last 84.46) - open/close/unlink 41869 (time 1777910918.16 total 586.78 last 102.26) - open/close/unlink 42672 (time 1777910928.16 total 596.78 last 80.27) - open/close/unlink 43540 (time 1777910938.18 total 606.80 last 86.64) - open/close/unlink 44503 (time 1777910948.19 total 616.81 last 96.25) - open/close/unlink 45595 (time 1777910958.19 total 626.81 last 109.16) - open/close/unlink 46645 (time 1777910968.20 total 636.82 last 104.84) - open/close/unlink 47677 (time 1777910978.21 total 646.83 last 103.17) - open/close/unlink 48733 (time 1777910988.21 total 656.83 last 105.55) - open/close/unlink 49732 (time 1777910998.22 total 666.84 last 99.81) - open/close/unlink 50000 (time 1777911000.72 total 669.35 last 107.01) - open/close/unlink 51143 (time 1777911010.73 total 679.35 last 114.28) - open/close/unlink 52267 (time 1777911020.74 total 689.36 last 112.30) - open/close/unlink 53521 (time 1777911030.74 total 699.36 last 125.37) - open/close/unlink 54647 (time 1777911040.75 total 709.37 last 112.52) - open/close/unlink 55531 (time 1777911050.75 total 719.37 last 88.37) - open/close/unlink 56402 (time 1777911060.76 total 729.38 last 86.97) - open/close/unlink 57109 (time 1777911070.78 total 739.40 last 70.61) - open/close/unlink 57994 (time 1777911080.79 total 749.41 last 88.40) - open/close/unlink 58777 (time 1777911090.79 total 759.41 last 78.25) - open/close/unlink 59615 (time 1777911100.81 total 769.43 last 83.69) - open/close/unlink 60000 (time 1777911105.10 total 773.72 last 89.68) - open/close/unlink 60859 (time 1777911115.10 total 783.72 last 85.87) - open/close/unlink 61564 (time 1777911125.11 total 793.73 last 70.42) - open/close/unlink 62185 (time 1777911135.13 total 803.75 last 62.01) - open/close/unlink 62765 (time 1777911145.14 total 813.76 last 57.93) - open/close/unlink 63493 (time 1777911155.14 total 823.76 last 72.78) - open/close/unlink 64463 (time 1777911165.15 total 833.77 last 96.97) total: 64768 open/close/unlink in 837.03 seconds: 77.38 ops/second nk 40680 (time 1777910906.24 total 574.63 last 82.73) - open/close/unlink 41728 (time 1777910916.24 total 584.63 last 104.80) - open/close/unlink 42546 (time 1777910926.25 total 594.64 last 81.69) - open/close/unlink 43372 (time 1777910936.26 total 604.65 last 82.55) - open/close/unlink 44335 (time 1777910946.27 total 614.66 last 96.21) - open/close/unlink 45414 (time 1777910956.27 total 624.66 last 107.84) - open/close/unlink 46520 (time 1777910966.28 total 634.67 last 110.52) - open/close/unlink 47538 (time 1777910976.29 total 644.68 last 101.74) - open/close/unlink 48563 (time 1777910986.29 total 654.68 last 102.42) - open/close/unlink 49571 (time 1777910996.30 total 664.69 last 100.79) - open/close/unlink 50000 (time 1777911000.50 total 668.89 last 102.13) - open/close/unlink 51141 (time 1777911010.50 total 678.89 last 114.07) - open/close/unlink 52244 (time 1777911020.50 total 688.89 last 110.29) - open/close/unlink 53492 (time 1777911030.50 total 698.89 last 124.74) - open/close/unlink 54622 (time 1777911040.51 total 708.90 last 112.94) - open/close/unlink 55513 (time 1777911050.52 total 718.91 last 89.00) - open/close/unlink 56377 (time 1777911060.52 total 728.91 last 86.37) - open/close/unlink 57072 (time 1777911070.52 total 738.91 last 69.50) - open/close/unlink 57964 (time 1777911080.53 total 748.91 last 89.20) - open/close/unlink 58752 (time 1777911090.54 total 758.93 last 78.72) - open/close/unlink 59580 (time 1777911100.55 total 768.94 last 82.68) - open/close/unlink 60000 (time 1777911105.20 total 773.59 last 90.33) - open/close/unlink 60861 (time 1777911115.21 total 783.60 last 86.02) - open/close/unlink 61573 (time 1777911125.21 total 793.60 last 71.18) - open/close/unlink 62190 (time 1777911135.22 total 803.61 last 61.65) - open/close/unlink 62769 (time 1777911145.24 total 813.63 last 57.79) - open/close/unlink 63496 (time 1777911155.24 total 823.63 last 72.67) - open/close/unlink 64473 (time 1777911165.25 total 833.64 last 97.68) total: 64768 open/close/unlink in 836.88 seconds: 77.39 ops/second nk 40000 (time 1777910898.10 total 566.75 last 86.82) - open/close/unlink 40845 (time 1777910908.13 total 576.78 last 84.30) - open/close/unlink 41863 (time 1777910918.15 total 586.79 last 101.61) - open/close/unlink 42663 (time 1777910928.15 total 596.80 last 79.99) - open/close/unlink 43534 (time 1777910938.15 total 606.80 last 87.07) - open/close/unlink 44484 (time 1777910948.16 total 616.81 last 94.92) - open/close/unlink 45583 (time 1777910958.16 total 626.81 last 109.88) - open/close/unlink 46651 (time 1777910968.17 total 636.82 last 106.71) - open/close/unlink 47690 (time 1777910978.17 total 646.82 last 103.85) - open/close/unlink 48728 (time 1777910988.17 total 656.82 last 103.79) - open/close/unlink 49726 (time 1777910998.18 total 666.83 last 99.77) - open/close/unlink 50000 (time 1777911000.71 total 669.36 last 108.03) - open/close/unlink 51143 (time 1777911010.72 total 679.36 last 114.28) - open/close/unlink 52262 (time 1777911020.72 total 689.37 last 111.89) - open/close/unlink 53503 (time 1777911030.73 total 699.38 last 123.98) - open/close/unlink 54624 (time 1777911040.73 total 709.38 last 112.06) - open/close/unlink 55506 (time 1777911050.75 total 719.39 last 88.07) - open/close/unlink 56380 (time 1777911060.76 total 729.41 last 87.23) - open/close/unlink 57084 (time 1777911070.78 total 739.43 last 70.31) - open/close/unlink 57972 (time 1777911080.78 total 749.43 last 88.76) - open/close/unlink 58755 (time 1777911090.79 total 759.44 last 78.26) - open/close/unlink 59590 (time 1777911100.80 total 769.44 last 83.43) - open/close/unlink 60000 (time 1777911105.35 total 774.00 last 89.95) - open/close/unlink 60845 (time 1777911115.36 total 784.01 last 84.46) - open/close/unlink 61558 (time 1777911125.38 total 794.02 last 71.17) - open/close/unlink 62167 (time 1777911135.39 total 804.04 last 60.81) - open/close/unlink 62754 (time 1777911145.42 total 814.06 last 58.55) - open/close/unlink 63494 (time 1777911155.43 total 824.08 last 73.91) - open/close/unlink 64477 (time 1777911165.43 total 834.08 last 98.28) total: 64768 open/close/unlink in 837.29 seconds: 77.35 ops/second nk 40000 (time 1777910898.59 total 566.96 last 83.04) - open/close/unlink 40854 (time 1777910908.59 total 576.96 last 85.36) - open/close/unlink 41885 (time 1777910918.59 total 586.96 last 103.07) - open/close/unlink 42674 (time 1777910928.60 total 596.97 last 78.85) - open/close/unlink 43558 (time 1777910938.61 total 606.98 last 88.32) - open/close/unlink 44514 (time 1777910948.61 total 616.98 last 95.60) - open/close/unlink 45614 (time 1777910958.61 total 626.98 last 109.97) - open/close/unlink 46670 (time 1777910968.62 total 636.99 last 105.54) - open/close/unlink 47707 (time 1777910978.62 total 646.99 last 103.68) - open/close/unlink 48766 (time 1777910988.63 total 657.00 last 105.83) - open/close/unlink 49766 (time 1777910998.63 total 667.00 last 99.99) - open/close/unlink 50000 (time 1777911000.76 total 669.14 last 109.49) - open/close/unlink 51132 (time 1777911010.77 total 679.15 last 113.08) - open/close/unlink 52254 (time 1777911020.78 total 689.15 last 112.16) - open/close/unlink 53502 (time 1777911030.79 total 699.16 last 124.69) - open/close/unlink 54629 (time 1777911040.79 total 709.17 last 112.62) - open/close/unlink 55510 (time 1777911050.80 total 719.17 last 88.03) - open/close/unlink 56375 (time 1777911060.81 total 729.18 last 86.43) - open/close/unlink 57074 (time 1777911070.81 total 739.18 last 69.90) - open/close/unlink 57960 (time 1777911080.82 total 749.19 last 88.54) - open/close/unlink 58737 (time 1777911090.83 total 759.20 last 77.64) - open/close/unlink 59572 (time 1777911100.83 total 769.20 last 83.49) - open/close/unlink 60000 (time 1777911105.60 total 773.97 last 89.62) - open/close/unlink 60845 (time 1777911115.61 total 783.98 last 84.42) - open/close/unlink 61552 (time 1777911125.62 total 793.99 last 70.66) - open/close/unlink 62163 (time 1777911135.63 total 804.00 last 61.04) - open/close/unlink 62743 (time 1777911145.64 total 814.01 last 57.94) - open/close/unlink 63490 (time 1777911155.64 total 824.01 last 74.69) - open/close/unlink 64475 (time 1777911165.65 total 834.02 last 98.43) total: 64768 open/close/unlink in 837.51 seconds: 77.33 ops/second nk 40000 (time 1777910898.70 total 567.09 last 81.83) - open/close/unlink 40862 (time 1777910908.71 total 577.10 last 86.16) - open/close/unlink 41880 (time 1777910918.71 total 587.10 last 101.80) - open/close/unlink 42656 (time 1777910928.71 total 597.10 last 77.55) - open/close/unlink 43544 (time 1777910938.72 total 607.11 last 88.78) - open/close/unlink 44497 (time 1777910948.72 total 617.11 last 95.29) - open/close/unlink 45603 (time 1777910958.73 total 627.12 last 110.46) - open/close/unlink 46660 (time 1777910968.73 total 637.12 last 105.67) - open/close/unlink 47687 (time 1777910978.75 total 647.14 last 102.56) - open/close/unlink 48747 (time 1777910988.75 total 657.14 last 105.99) - open/close/unlink 49742 (time 1777910998.75 total 667.14 last 99.50) - open/close/unlink 50000 (time 1777911001.02 total 669.41 last 113.29) - open/close/unlink 51132 (time 1777911011.03 total 679.42 last 113.15) - open/close/unlink 52263 (time 1777911021.03 total 689.42 last 113.06) - open/close/unlink 53510 (time 1777911031.04 total 699.43 last 124.64) - open/close/unlink 54621 (time 1777911041.04 total 709.43 last 111.06) - open/close/unlink 55494 (time 1777911051.04 total 719.43 last 87.29) - open/close/unlink 56369 (time 1777911061.05 total 729.44 last 87.42) - open/close/unlink 57068 (time 1777911071.05 total 739.44 last 69.89) - open/close/unlink 57961 (time 1777911081.06 total 749.45 last 89.26) - open/close/unlink 58742 (time 1777911091.07 total 759.46 last 77.99) - open/close/unlink 59578 (time 1777911101.08 total 769.47 last 83.51) - open/close/unlink 60000 (time 1777911105.80 total 774.19 last 89.51) - open/close/unlink 60832 (time 1777911115.80 total 784.19 last 83.15) - open/close/unlink 61542 (time 1777911125.82 total 794.21 last 70.87) - open/close/unlink 62165 (time 1777911135.83 total 804.22 last 62.23) - open/close/unlink 62746 (time 1777911145.84 total 814.23 last 58.07) - open/close/unlink 63497 (time 1777911155.85 total 824.24 last 75.03) - open/close/unlink 64479 (time 1777911165.85 total 834.24 last 98.18) total: 64768 open/close/unlink in 837.67 seconds: 77.32 ops/second Waiting for MDT destroys to complete oleg317-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg317-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg317-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg317-server stop mds service on oleg317-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg317-server stop mds service on oleg317-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg317-server unloading modules via unload_modules_local on: 'oleg317-server' oleg317-server: oleg317-server.virtnet: executing unload_modules_local oleg317-server: modules unloaded. pdsh@oleg317-client: oleg317-client: ssh exited with exit code 2 pdsh@oleg317-client: oleg317-server: ssh exited with exit code 2 pdsh@oleg317-client: oleg317-client: ssh exited with exit code 2 pdsh@oleg317-client: oleg317-server: ssh exited with exit code 2 PASS 106 (917s) Stopping clients: oleg317-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg317-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg317-client: oleg317-server: ssh exited with exit code 2 oleg317-server: oleg317-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg317-server' oleg317-server: oleg317-server.virtnet: executing load_modules_local oleg317-server: Loading modules from /home/green/git/lustre-release/lustre oleg317-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg317-server: detected 4 online CPUs by sysfs oleg317-server: MODOPTS_LIBCFS= oleg317-server: Force libcfs to create 2 CPU partitions oleg317-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg317-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg317-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 1094 sec ========== 12:13:55 (1777911235) === conf-sanity: start cleanup 12:13:56 (1777911236) === === conf-sanity: finish cleanup 12:13:58 (1777911238) ===