-----============= acceptance-small: conf-sanity ============----- Thu Jun 11 19:27:56 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg635-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg635-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg635-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server oleg635-server: oleg635-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg635-server' oleg635-server: oleg635-server.virtnet: executing load_modules_local oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg635-server: Loading modules from /home/green/git/lustre-release/lustre oleg635-server: detected 4 online CPUs by sysfs oleg635-server: MODOPTS_LIBCFS= oleg635-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg635-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg635-server: oleg635-server.virtnet: executing set_default_debug -1 all pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg635-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg635-server: oleg635-server.virtnet: executing set_default_debug -1 all pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg635-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg635-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg635-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg635-server: oleg635-server.virtnet: executing set_default_debug -1 all pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg635-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg635-server: oleg635-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg635-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg635-server: oleg635-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg635-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg635-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server stop mds service on oleg635-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server stop mds service on oleg635-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg635-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 19:30:03 (1781220603) start mds service on oleg635-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg635-server: oleg635-server.virtnet: executing set_default_debug -1 all pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg635-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg635-server: oleg635-server.virtnet: executing set_default_debug -1 all pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg635-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg635-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg635-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg635-server: oleg635-server.virtnet: executing set_default_debug -1 all pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1 Started lustre-OST0000 oleg635-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg635-client.virtnet: -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50096 529 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 924 (time 1781220652.81 total 10.01 last 92.30) - open/close/unlink 1518 (time 1781220662.81 total 20.02 last 59.36) - open/close/unlink 2268 (time 1781220672.83 total 30.03 last 74.90) - open/close/unlink 2969 (time 1781220682.84 total 40.04 last 70.03) - open/close/unlink 3546 (time 1781220692.84 total 50.05 last 57.66) - open/close/unlink 4249 (time 1781220702.84 total 60.05 last 70.29) - open/close/unlink 4783 (time 1781220712.85 total 70.06 last 53.36) - open/close/unlink 5278 (time 1781220722.85 total 80.06 last 49.49) - open/close/unlink 5802 (time 1781220732.86 total 90.07 last 52.34) - open/close/unlink 6323 (time 1781220742.89 total 100.09 last 51.99) - open/close/unlink 6844 (time 1781220752.90 total 110.10 last 52.05) - open/close/unlink 7525 (time 1781220762.92 total 120.13 last 67.92) - open/close/unlink 8209 (time 1781220772.96 total 130.16 last 68.16) - open/close/unlink 8908 (time 1781220782.97 total 140.17 last 69.81) - open/close/unlink 9540 (time 1781220792.98 total 150.18 last 63.16) - open/close/unlink 10000 (time 1781220798.65 total 155.85 last 81.11) - open/close/unlink 10744 (time 1781220808.66 total 165.86 last 74.34) - open/close/unlink 11556 (time 1781220818.66 total 175.86 last 81.18) - open/close/unlink 12182 (time 1781220828.66 total 185.87 last 62.56) - open/close/unlink 12913 (time 1781220838.67 total 195.88 last 73.05) - open/close/unlink 13693 (time 1781220848.68 total 205.89 last 77.93) - open/close/unlink 14542 (time 1781220858.69 total 215.90 last 84.79) - open/close/unlink 15344 (time 1781220868.70 total 225.90 last 80.16) - open/close/unlink 16298 (time 1781220878.70 total 235.91 last 95.34) - open/close/unlink 17038 (time 1781220888.71 total 245.91 last 73.97) - open/close/unlink 17749 (time 1781220898.72 total 255.93 last 71.01) - open/close/unlink 18366 (time 1781220908.73 total 265.94 last 61.63) - open/close/unlink 19098 (time 1781220918.74 total 275.94 last 73.16) - open/close/unlink 19897 (time 1781220928.74 total 285.95 last 79.87) - open/close/unlink 20906 (time 1781220938.74 total 295.95 last 100.90) - open/close/unlink 22041 (time 1781220948.75 total 305.96 last 113.37) - open/close/unlink 23066 (time 1781220958.75 total 315.96 last 102.49) - open/close/unlink 23957 (time 1781220968.76 total 325.97 last 89.05) - open/close/unlink 24858 (time 1781220978.76 total 335.97 last 90.06) - open/close/unlink 25544 (time 1781220988.78 total 345.99 last 68.47) - open/close/unlink 26231 (time 1781220998.79 total 356.00 last 68.64) - open/close/unlink 26947 (time 1781221008.81 total 366.01 last 71.50) - open/close/unlink 27642 (time 1781221018.82 total 376.02 last 69.41) - open/close/unlink 28804 (time 1781221028.83 total 386.03 last 116.10) - open/close/unlink 29722 (time 1781221038.83 total 396.04 last 91.76) - open/close/unlink 30000 (time 1781221042.27 total 399.47 last 80.97) - open/close/unlink 30729 (time 1781221052.28 total 409.48 last 72.82) - open/close/unlink 31440 (time 1781221062.29 total 419.49 last 71.02) - open/close/unlink 32182 (time 1781221072.29 total 429.50 last 74.17) - open/close/unlink 32814 (time 1781221082.30 total 439.50 last 63.16) - open/close/unlink 33653 (time 1781221092.30 total 449.51 last 83.88) - open/close/unlink 34469 (time 1781221102.32 total 459.52 last 81.46) - open/close/unlink 35229 (time 1781221112.32 total 469.53 last 75.97) - open/close/unlink 36095 (time 1781221122.32 total 479.53 last 86.59) - open/close/unlink 37013 (time 1781221132.33 total 489.53 last 91.76) - open/close/unlink 38016 (time 1781221142.34 total 499.54 last 100.18) - open/close/unlink 38817 (time 1781221152.34 total 509.55 last 80.06) - open/close/unlink 39627 (time 1781221162.36 total 519.56 last 80.90) - open/close/unlink 40000 (time 1781221167.21 total 524.41 last 76.86) - open/close/unlink 40796 (time 1781221177.22 total 534.43 last 79.48) - open/close/unlink 41616 (time 1781221187.23 total 544.43 last 81.96) - open/close/unlink 42389 (time 1781221197.23 total 554.44 last 77.28) - open/clos - open/close/unlink 928 (time 1781220652.39 total 10.01 last 92.68) - open/close/unlink 1523 (time 1781220662.40 total 20.03 last 59.40) - open/close/unlink 2252 (time 1781220672.41 total 30.03 last 72.88) - open/close/unlink 2972 (time 1781220682.42 total 40.05 last 71.90) - open/close/unlink 3546 (time 1781220692.42 total 50.05 last 57.39) - open/close/unlink 4248 (time 1781220702.43 total 60.06 last 70.14) - open/close/unlink 4790 (time 1781220712.44 total 70.06 last 54.16) - open/close/unlink 5295 (time 1781220722.44 total 80.07 last 50.49) - open/close/unlink 5812 (time 1781220732.44 total 90.07 last 51.68) - open/close/unlink 6321 (time 1781220742.45 total 100.08 last 50.85) - open/close/unlink 6850 (time 1781220752.46 total 110.09 last 52.85) - open/close/unlink 7521 (time 1781220762.46 total 120.09 last 67.10) - open/close/unlink 8210 (time 1781220772.47 total 130.10 last 68.85) - open/close/unlink 8910 (time 1781220782.49 total 140.11 last 69.89) - open/close/unlink 9545 (time 1781220792.49 total 150.11 last 63.50) - open/close/unlink 10000 (time 1781220798.33 total 155.95 last 77.93) - open/close/unlink 10744 (time 1781220808.33 total 165.96 last 74.35) - open/close/unlink 11552 (time 1781220818.34 total 175.97 last 80.74) - open/close/unlink 12177 (time 1781220828.35 total 185.98 last 62.43) - open/close/unlink 12898 (time 1781220838.35 total 195.98 last 72.10) - open/close/unlink 13676 (time 1781220848.37 total 205.99 last 77.68) - open/close/unlink 14528 (time 1781220858.39 total 216.01 last 85.05) - open/close/unlink 15326 (time 1781220868.40 total 226.03 last 79.68) - open/close/unlink 16270 (time 1781220878.41 total 236.03 last 94.35) - open/close/unlink 17025 (time 1781220888.41 total 246.04 last 75.44) - open/close/unlink 17730 (time 1781220898.43 total 256.05 last 70.41) - open/close/unlink 18336 (time 1781220908.43 total 266.06 last 60.58) - open/close/unlink 19073 (time 1781220918.44 total 276.07 last 73.62) - open/close/unlink 19864 (time 1781220928.45 total 286.07 last 79.06) - open/close/unlink 20848 (time 1781220938.45 total 296.08 last 98.36) - open/close/unlink 21987 (time 1781220948.46 total 306.08 last 113.84) - open/close/unlink 23009 (time 1781220958.46 total 316.09 last 102.17) - open/close/unlink 23896 (time 1781220968.46 total 326.09 last 88.68) - open/close/unlink 24813 (time 1781220978.47 total 336.10 last 91.64) - open/close/unlink 25503 (time 1781220988.48 total 346.10 last 68.96) - open/close/unlink 26188 (time 1781220998.48 total 356.10 last 68.49) - open/close/unlink 26902 (time 1781221008.50 total 366.13 last 71.21) - open/close/unlink 27597 (time 1781221018.52 total 376.14 last 69.41) - open/close/unlink 28751 (time 1781221028.52 total 386.15 last 115.37) - open/close/unlink 29679 (time 1781221038.52 total 396.15 last 92.79) - open/close/unlink 30000 (time 1781221042.40 total 400.02 last 82.78) - open/close/unlink 30725 (time 1781221052.41 total 410.04 last 72.41) - open/close/unlink 31435 (time 1781221062.42 total 420.04 last 70.95) - open/close/unlink 32172 (time 1781221072.42 total 430.05 last 73.68) - open/close/unlink 32808 (time 1781221082.42 total 440.05 last 63.57) - open/close/unlink 33645 (time 1781221092.43 total 450.05 last 83.67) - open/close/unlink 34459 (time 1781221102.43 total 460.06 last 81.36) - open/close/unlink 35216 (time 1781221112.44 total 470.06 last 75.65) - open/close/unlink 36086 (time 1781221122.44 total 480.07 last 86.95) - open/close/unlink 37006 (time 1781221132.45 total 490.08 last 91.95) - open/close/unlink 38002 (time 1781221142.46 total 500.08 last 99.53) - open/close/unlink 38806 (time 1781221152.46 total 510.09 last 80.38) - open/close/unlink 39617 (time 1781221162.47 total 520.09 last 81.03) - open/close/unlink 40000 (time 1781221167.42 total 525.04 last 77.38) - open/close/unlink 40782 (time 1781221177.42 total 535.05 last 78.16) - open/close/unlink 41600 (time 1781221187.43 total 545.05 last 81.78) - open/close/unlink 42395 (time 1781221197.44 total 555.07 last 79.37) - open/close/ - open/close/unlink 921 (time 1781220652.81 total 10.00 last 92.07) - open/close/unlink 1514 (time 1781220662.82 total 20.01 last 59.26) - open/close/unlink 2262 (time 1781220672.83 total 30.02 last 74.74) - open/close/unlink 2957 (time 1781220682.84 total 40.03 last 69.42) - open/close/unlink 3534 (time 1781220692.84 total 50.04 last 57.65) - open/close/unlink 4234 (time 1781220702.86 total 60.05 last 69.90) - open/close/unlink 4774 (time 1781220712.88 total 70.07 last 53.91) - open/close/unlink 5276 (time 1781220722.90 total 80.09 last 50.07) - open/close/unlink 5797 (time 1781220732.92 total 90.11 last 52.02) - open/close/unlink 6313 (time 1781220742.93 total 100.12 last 51.53) - open/close/unlink 6850 (time 1781220752.95 total 110.14 last 53.61) - open/close/unlink 7526 (time 1781220762.95 total 120.14 last 67.60) - open/close/unlink 8220 (time 1781220772.95 total 130.15 last 69.36) - open/close/unlink 8920 (time 1781220782.96 total 140.15 last 69.95) - open/close/unlink 9542 (time 1781220792.98 total 150.17 last 62.10) - open/close/unlink 10000 (time 1781220798.70 total 155.90 last 79.96) - open/close/unlink 10745 (time 1781220808.71 total 165.90 last 74.45) - open/close/unlink 11549 (time 1781220818.72 total 175.91 last 80.34) - open/close/unlink 12171 (time 1781220828.72 total 185.92 last 62.16) - open/close/unlink 12899 (time 1781220838.74 total 195.93 last 72.71) - open/close/unlink 13681 (time 1781220848.74 total 205.93 last 78.19) - open/close/unlink 14527 (time 1781220858.75 total 215.95 last 84.48) - open/close/unlink 15336 (time 1781220868.76 total 225.95 last 80.87) - open/close/unlink 16279 (time 1781220878.76 total 235.95 last 94.27) - open/close/unlink 17028 (time 1781220888.77 total 245.96 last 74.81) - open/close/unlink 17738 (time 1781220898.78 total 255.97 last 70.97) - open/close/unlink 18359 (time 1781220908.79 total 265.98 last 62.01) - open/close/unlink 19094 (time 1781220918.80 total 276.00 last 73.41) - open/close/unlink 19887 (time 1781220928.81 total 286.01 last 79.21) - open/close/unlink 20901 (time 1781220938.82 total 296.01 last 101.37) - open/close/unlink 22019 (time 1781220948.82 total 306.01 last 111.78) - open/close/unlink 23047 (time 1781220958.83 total 316.02 last 102.69) - open/close/unlink 23941 (time 1781220968.83 total 326.02 last 89.38) - open/close/unlink 24844 (time 1781220978.84 total 336.03 last 90.21) - open/close/unlink 25526 (time 1781220988.84 total 346.04 last 68.19) - open/close/unlink 26217 (time 1781220998.85 total 356.04 last 69.08) - open/close/unlink 26923 (time 1781221008.85 total 366.04 last 70.60) - open/close/unlink 27626 (time 1781221018.85 total 376.04 last 70.28) - open/close/unlink 28787 (time 1781221028.85 total 386.05 last 116.06) - open/close/unlink 29701 (time 1781221038.86 total 396.05 last 91.35) - open/close/unlink 30000 (time 1781221042.54 total 399.74 last 81.15) - open/close/unlink 30723 (time 1781221052.56 total 409.75 last 72.20) - open/close/unlink 31445 (time 1781221062.56 total 419.75 last 72.16) - open/close/unlink 32173 (time 1781221072.57 total 429.76 last 72.74) - open/close/unlink 32803 (time 1781221082.57 total 439.77 last 62.98) - open/close/unlink 33634 (time 1781221092.58 total 449.77 last 83.08) - open/close/unlink 34451 (time 1781221102.59 total 459.78 last 81.61) - open/close/unlink 35217 (time 1781221112.60 total 469.79 last 76.51) - open/close/unlink 36080 (time 1781221122.60 total 479.79 last 86.29) - open/close/unlink 37000 (time 1781221132.60 total 489.80 last 91.97) - open/close/unlink 37997 (time 1781221142.62 total 499.81 last 99.56) - open/close/unlink 38801 (time 1781221152.62 total 509.82 last 80.37) - open/close/unlink 39606 (time 1781221162.64 total 519.83 last 80.39) - open/close/unlink 40000 (time 1781221167.84 total 525.03 last 75.70) - open/close/unlink 40784 (time 1781221177.84 total 535.04 last 78.37) - open/close/unlink 41597 (time 1781221187.85 total 545.04 last 81.27) - open/close/unlink 42385 (time 1781221197.85 total 555.04 last 78.79) - open/close - open/close/unlink 925 (time 1781220652.72 total 10.02 last 92.29) - open/close/unlink 1515 (time 1781220662.75 total 20.05 last 58.85) - open/close/unlink 2250 (time 1781220672.76 total 30.06 last 73.45) - open/close/unlink 2955 (time 1781220682.77 total 40.06 last 70.43) - open/close/unlink 3530 (time 1781220692.77 total 50.07 last 57.48) - open/close/unlink 4230 (time 1781220702.78 total 60.08 last 69.92) - open/close/unlink 4774 (time 1781220712.80 total 70.10 last 54.30) - open/close/unlink 5276 (time 1781220722.81 total 80.11 last 50.13) - open/close/unlink 5798 (time 1781220732.83 total 90.13 last 52.09) - open/close/unlink 6314 (time 1781220742.83 total 100.13 last 51.60) - open/close/unlink 6846 (time 1781220752.85 total 110.15 last 53.12) - open/close/unlink 7522 (time 1781220762.86 total 120.16 last 67.53) - open/close/unlink 8210 (time 1781220772.86 total 130.16 last 68.77) - open/close/unlink 8893 (time 1781220782.87 total 140.17 last 68.28) - open/close/unlink 9527 (time 1781220792.87 total 150.17 last 63.37) - open/close/unlink 10000 (time 1781220798.83 total 156.13 last 79.36) - open/close/unlink 10742 (time 1781220808.84 total 166.14 last 74.17) - open/close/unlink 11547 (time 1781220818.84 total 176.14 last 80.46) - open/close/unlink 12164 (time 1781220828.85 total 186.15 last 61.65) - open/close/unlink 12887 (time 1781220838.87 total 196.16 last 72.20) - open/close/unlink 13661 (time 1781220848.87 total 206.17 last 77.36) - open/close/unlink 14515 (time 1781220858.88 total 216.18 last 85.33) - open/close/unlink 15320 (time 1781220868.89 total 226.19 last 80.44) - open/close/unlink 16257 (time 1781220878.89 total 236.19 last 93.69) - open/close/unlink 16998 (time 1781220888.90 total 246.20 last 74.03) - open/close/unlink 17709 (time 1781220898.90 total 256.20 last 71.06) - open/close/unlink 18319 (time 1781220908.91 total 266.21 last 60.94) - open/close/unlink 19055 (time 1781220918.92 total 276.21 last 73.58) - open/close/unlink 19848 (time 1781220928.93 total 286.22 last 79.22) - open/close/unlink 20867 (time 1781220938.93 total 296.23 last 101.85) - open/close/unlink 21989 (time 1781220948.94 total 306.23 last 112.14) - open/close/unlink 23011 (time 1781220958.94 total 316.24 last 102.15) - open/close/unlink 23898 (time 1781220968.95 total 326.24 last 88.66) - open/close/unlink 24779 (time 1781220978.95 total 336.25 last 88.05) - open/close/unlink 25461 (time 1781220988.96 total 346.26 last 68.13) - open/close/unlink 26152 (time 1781220998.97 total 356.27 last 69.06) - open/close/unlink 26854 (time 1781221008.98 total 366.28 last 70.12) - open/close/unlink 27564 (time 1781221018.98 total 376.28 last 70.99) - open/close/unlink 28738 (time 1781221028.98 total 386.28 last 117.35) - open/close/unlink 29657 (time 1781221038.99 total 396.29 last 91.85) - open/close/unlink 30000 (time 1781221043.21 total 400.51 last 81.20) - open/close/unlink 30720 (time 1781221053.23 total 410.53 last 71.90) - open/close/unlink 31451 (time 1781221063.24 total 420.54 last 73.03) - open/close/unlink 32161 (time 1781221073.24 total 430.54 last 70.99) - open/close/unlink 32807 (time 1781221083.24 total 440.54 last 64.58) - open/close/unlink 33651 (time 1781221093.24 total 450.54 last 84.38) - open/close/unlink 34467 (time 1781221103.25 total 460.55 last 81.54) - open/close/unlink 35234 (time 1781221113.25 total 470.55 last 76.69) - open/close/unlink 36110 (time 1781221123.26 total 480.56 last 87.53) - open/close/unlink 37029 (time 1781221133.27 total 490.57 last 91.78) - open/close/unlink 38005 (time 1781221143.27 total 500.57 last 97.59) - open/close/unlink 38827 (time 1781221153.28 total 510.58 last 82.14) - open/close/unlink 39619 (time 1781221163.29 total 520.59 last 79.10) - open/close/unlink 40000 (time 1781221168.17 total 525.47 last 78.18) - open/close/unlink 40782 (time 1781221178.18 total 535.48 last 78.12) - open/close/unlink 41599 (time 1781221188.18 total 545.48 last 81.64) - open/close/unlink 42394 (time 1781221198.20 total 555.49 last 79.41) - open/close - open/close/unlink 918 (time 1781220652.78 total 10.02 last 91.64) - open/close/unlink 1510 (time 1781220662.78 total 20.02 last 59.18) - open/close/unlink 2250 (time 1781220672.79 total 30.02 last 73.97) - open/close/unlink 2948 (time 1781220682.79 total 40.03 last 69.76) - open/close/unlink 3527 (time 1781220692.80 total 50.03 last 57.89) - open/close/unlink 4220 (time 1781220702.81 total 60.04 last 69.23) - open/close/unlink 4760 (time 1781220712.82 total 70.05 last 53.94) - open/close/unlink 5257 (time 1781220722.82 total 80.06 last 49.69) - open/close/unlink 5781 (time 1781220732.85 total 90.09 last 52.23) - open/close/unlink 6299 (time 1781220742.86 total 100.09 last 51.79) - open/close/unlink 6826 (time 1781220752.86 total 110.10 last 52.67) - open/close/unlink 7501 (time 1781220762.87 total 120.11 last 67.45) - open/close/unlink 8195 (time 1781220772.87 total 130.11 last 69.37) - open/close/unlink 8885 (time 1781220782.88 total 140.12 last 68.95) - open/close/unlink 9516 (time 1781220792.89 total 150.12 last 63.06) - open/close/unlink 10000 (time 1781220798.92 total 156.16 last 80.18) - open/close/unlink 10746 (time 1781220808.92 total 166.16 last 74.58) - open/close/unlink 11548 (time 1781220818.93 total 176.16 last 80.19) - open/close/unlink 12167 (time 1781220828.94 total 186.17 last 61.82) - open/close/unlink 12896 (time 1781220838.94 total 196.18 last 72.87) - open/close/unlink 13663 (time 1781220848.95 total 206.19 last 76.63) - open/close/unlink 14513 (time 1781220858.95 total 216.19 last 84.99) - open/close/unlink 15316 (time 1781220868.95 total 226.19 last 80.29) - open/close/unlink 16260 (time 1781220878.97 total 236.20 last 94.27) - open/close/unlink 17005 (time 1781220888.98 total 246.21 last 74.43) - open/close/unlink 17715 (time 1781220898.98 total 256.22 last 70.95) - open/close/unlink 18315 (time 1781220909.00 total 266.23 last 59.93) - open/close/unlink 19052 (time 1781220919.00 total 276.24 last 73.67) - open/close/unlink 19855 (time 1781220929.00 total 286.24 last 80.28) - open/close/unlink 20860 (time 1781220939.01 total 296.24 last 100.46) - open/close/unlink 21971 (time 1781220949.02 total 306.25 last 111.02) - open/close/unlink 22994 (time 1781220959.02 total 316.26 last 102.26) - open/close/unlink 23896 (time 1781220969.02 total 326.26 last 90.17) - open/close/unlink 24778 (time 1781220979.04 total 336.27 last 88.10) - open/close/unlink 25459 (time 1781220989.04 total 346.27 last 68.09) - open/close/unlink 26153 (time 1781220999.05 total 356.29 last 69.32) - open/close/unlink 26859 (time 1781221009.07 total 366.30 last 70.46) - open/close/unlink 27565 (time 1781221019.08 total 376.32 last 70.52) - open/close/unlink 28748 (time 1781221029.08 total 386.32 last 118.24) - open/close/unlink 29652 (time 1781221039.09 total 396.33 last 90.34) - open/close/unlink 30000 (time 1781221043.47 total 400.71 last 79.44) - open/close/unlink 30719 (time 1781221053.48 total 410.72 last 71.85) - open/close/unlink 31451 (time 1781221063.48 total 420.72 last 73.19) - open/close/unlink 32173 (time 1781221073.48 total 430.72 last 72.19) - open/close/unlink 32816 (time 1781221083.48 total 440.72 last 64.28) - open/close/unlink 33664 (time 1781221093.49 total 450.72 last 84.78) - open/close/unlink 34479 (time 1781221103.49 total 460.73 last 81.47) - open/close/unlink 35238 (time 1781221113.51 total 470.74 last 75.79) - open/close/unlink 36119 (time 1781221123.51 total 480.75 last 88.05) - open/close/unlink 37042 (time 1781221133.52 total 490.76 last 92.22) - open/close/unlink 38019 (time 1781221143.52 total 500.76 last 97.67) - open/close/unlink 38855 (time 1781221153.53 total 510.77 last 83.55) - open/close/unlink 39636 (time 1781221163.53 total 520.77 last 78.07) - open/close/unlink 40000 (time 1781221168.24 total 525.48 last 77.28) - open/close/unlink 40783 (time 1781221178.25 total 535.49 last 78.24) - open/close/unlink 41595 (time 1781221188.27 total 545.51 last 81.03) - open/close/unlink 42384 (time 1781221198.28 total 555.51 last 78.86) - open/closee/unlink 43280 (time 1781221207.24 total 564.44 last 89.05) - open/close/unlink 44351 (time 1781221217.24 total 574.44 last 107.09) - open/close/unlink 45546 (time 1781221227.24 total 584.45 last 119.45) - open/close/unlink 46591 (time 1781221237.25 total 594.45 last 104.44) - open/close/unlink 47478 (time 1781221247.26 total 604.47 last 88.58) - open/close/unlink 48254 (time 1781221257.27 total 614.47 last 77.56) - open/close/unlink 48939 (time 1781221267.27 total 624.48 last 68.46) - open/close/unlink 49877 (time 1781221277.28 total 634.48 last 93.77) - open/close/unlink 50885 (time 1781221287.28 total 644.49 last 100.73) - open/close/unlink 51844 (time 1781221297.29 total 654.50 last 95.81) - open/close/unlink 52683 (time 1781221307.30 total 664.50 last 83.87) - open/close/unlink 53488 (time 1781221317.31 total 674.52 last 80.37) - open/close/unlink 54248 (time 1781221327.32 total 684.52 last 75.97) - open/close/unlink 55140 (time 1781221337.34 total 694.54 last 89.03) - open/close/unlink 56096 (time 1781221347.34 total 704.55 last 95.54) - open/close/unlink 57077 (time 1781221357.36 total 714.57 last 97.89) - open/close/unlink 58190 (time 1781221367.38 total 724.58 last 111.16) - open/close/unlink 59252 (time 1781221377.38 total 734.59 last 106.16) - open/close/unlink 60000 (time 1781221385.16 total 742.37 last 96.10) - open/close/unlink 61344 (time 1781221395.17 total 752.38 last 134.32) - open/close/unlink 62452 (time 1781221405.17 total 762.38 last 110.79) - open/close/unlink 63432 (time 1781221415.17 total 772.38 last 97.98) - open/close/unlink 64473 (time 1781221425.18 total 782.39 last 104.02) total: 64768 open/close/unlink in 785.32 seconds: 82.47 ops/second unlink 43293 (time 1781221207.45 total 565.07 last 89.79) - open/close/unlink 44389 (time 1781221217.45 total 575.07 last 109.59) - open/close/unlink 45582 (time 1781221227.45 total 585.07 last 119.27) - open/close/unlink 46613 (time 1781221237.45 total 595.08 last 103.04) - open/close/unlink 47510 (time 1781221247.46 total 605.09 last 89.65) - open/close/unlink 48285 (time 1781221257.47 total 615.10 last 77.42) - open/close/unlink 48973 (time 1781221267.47 total 625.10 last 68.79) - open/close/unlink 49911 (time 1781221277.48 total 635.10 last 93.75) - open/close/unlink 50915 (time 1781221287.48 total 645.10 last 100.39) - open/close/unlink 51880 (time 1781221297.48 total 655.10 last 96.50) - open/close/unlink 52716 (time 1781221307.49 total 665.11 last 83.53) - open/close/unlink 53514 (time 1781221317.50 total 675.13 last 79.69) - open/close/unlink 54271 (time 1781221327.50 total 685.13 last 75.67) - open/close/unlink 55160 (time 1781221337.51 total 695.14 last 88.83) - open/close/unlink 56122 (time 1781221347.52 total 705.14 last 96.13) - open/close/unlink 57099 (time 1781221357.53 total 715.15 last 97.60) - open/close/unlink 58210 (time 1781221367.53 total 725.16 last 111.03) - open/close/unlink 59268 (time 1781221377.54 total 735.16 last 105.76) - open/close/unlink 60000 (time 1781221385.28 total 742.90 last 94.57) - open/close/unlink 61334 (time 1781221395.28 total 752.91 last 133.33) - open/close/unlink 62454 (time 1781221405.29 total 762.91 last 111.98) - open/close/unlink 63441 (time 1781221415.29 total 772.91 last 98.69) - open/close/unlink 64468 (time 1781221425.29 total 782.92 last 102.68) total: 64768 open/close/unlink in 785.95 seconds: 82.41 ops/second /unlink 43288 (time 1781221207.85 total 565.05 last 90.27) - open/close/unlink 44397 (time 1781221217.86 total 575.05 last 110.87) - open/close/unlink 45586 (time 1781221227.86 total 585.05 last 118.83) - open/close/unlink 46633 (time 1781221237.87 total 595.06 last 104.65) - open/close/unlink 47512 (time 1781221247.87 total 605.06 last 87.89) - open/close/unlink 48281 (time 1781221257.87 total 615.07 last 76.85) - open/close/unlink 48966 (time 1781221267.87 total 625.07 last 68.49) - open/close/unlink 49898 (time 1781221277.89 total 635.08 last 93.09) - open/close/unlink 50902 (time 1781221287.90 total 645.09 last 100.30) - open/close/unlink 51877 (time 1781221297.90 total 655.10 last 97.45) - open/close/unlink 52711 (time 1781221307.90 total 665.10 last 83.38) - open/close/unlink 53509 (time 1781221317.91 total 675.11 last 79.73) - open/close/unlink 54265 (time 1781221327.92 total 685.11 last 75.55) - open/close/unlink 55148 (time 1781221337.93 total 695.12 last 88.24) - open/close/unlink 56129 (time 1781221347.93 total 705.12 last 98.07) - open/close/unlink 57089 (time 1781221357.93 total 715.13 last 95.96) - open/close/unlink 58202 (time 1781221367.94 total 725.13 last 111.27) - open/close/unlink 59268 (time 1781221377.95 total 735.14 last 106.49) - open/close/unlink 60000 (time 1781221385.49 total 742.69 last 96.98) - open/close/unlink 61336 (time 1781221395.50 total 752.69 last 133.52) - open/close/unlink 62450 (time 1781221405.50 total 762.70 last 111.38) - open/close/unlink 63452 (time 1781221415.51 total 772.70 last 100.15) - open/close/unlink 64464 (time 1781221425.52 total 782.71 last 101.09) total: 64768 open/close/unlink in 786.05 seconds: 82.40 ops/second /unlink 43295 (time 1781221208.21 total 565.50 last 90.00) - open/close/unlink 44407 (time 1781221218.21 total 575.51 last 111.13) - open/close/unlink 45599 (time 1781221228.22 total 585.52 last 119.15) - open/close/unlink 46635 (time 1781221238.22 total 595.52 last 103.54) - open/close/unlink 47503 (time 1781221248.24 total 605.53 last 86.69) - open/close/unlink 48266 (time 1781221258.24 total 615.54 last 76.26) - open/close/unlink 48950 (time 1781221268.25 total 625.55 last 68.35) - open/close/unlink 49877 (time 1781221278.25 total 635.55 last 92.67) - open/close/unlink 50887 (time 1781221288.25 total 645.55 last 100.97) - open/close/unlink 51871 (time 1781221298.26 total 655.55 last 98.38) - open/close/unlink 52701 (time 1781221308.27 total 665.57 last 82.90) - open/close/unlink 53500 (time 1781221318.29 total 675.59 last 79.71) - open/close/unlink 54260 (time 1781221328.30 total 685.59 last 75.97) - open/close/unlink 55153 (time 1781221338.30 total 695.60 last 89.23) - open/close/unlink 56147 (time 1781221348.31 total 705.61 last 99.30) - open/close/unlink 57097 (time 1781221358.33 total 715.63 last 94.84) - open/close/unlink 58224 (time 1781221368.33 total 725.63 last 112.66) - open/close/unlink 59280 (time 1781221378.34 total 735.64 last 105.53) - open/close/unlink 60000 (time 1781221385.85 total 743.15 last 95.92) - open/close/unlink 61337 (time 1781221395.85 total 753.15 last 133.64) - open/close/unlink 62442 (time 1781221405.86 total 763.16 last 110.40) - open/close/unlink 63479 (time 1781221415.86 total 773.16 last 103.69) - open/close/unlink 64470 (time 1781221425.87 total 783.17 last 99.02) total: 64768 open/close/unlink in 786.65 seconds: 82.33 ops/second /unlink 43289 (time 1781221208.28 total 565.52 last 90.45) - open/close/unlink 44394 (time 1781221218.29 total 575.53 last 110.40) - open/close/unlink 45592 (time 1781221228.30 total 585.53 last 119.77) - open/close/unlink 46617 (time 1781221238.30 total 595.53 last 102.49) - open/close/unlink 47492 (time 1781221248.30 total 605.53 last 87.48) - open/close/unlink 48264 (time 1781221258.30 total 615.54 last 77.17) - open/close/unlink 48951 (time 1781221268.32 total 625.55 last 68.61) - open/close/unlink 49895 (time 1781221278.32 total 635.56 last 94.36) - open/close/unlink 50905 (time 1781221288.33 total 645.57 last 100.90) - open/close/unlink 51869 (time 1781221298.34 total 655.58 last 96.29) - open/close/unlink 52689 (time 1781221308.34 total 665.58 last 81.97) - open/close/unlink 53481 (time 1781221318.35 total 675.59 last 79.16) - open/close/unlink 54244 (time 1781221328.36 total 685.60 last 76.19) - open/close/unlink 55132 (time 1781221338.37 total 695.60 last 88.77) - open/close/unlink 56125 (time 1781221348.37 total 705.61 last 99.26) - open/close/unlink 57088 (time 1781221358.38 total 715.62 last 96.24) - open/close/unlink 58222 (time 1781221368.38 total 725.62 last 113.35) - open/close/unlink 59267 (time 1781221378.39 total 735.63 last 104.44) - open/close/unlink 60000 (time 1781221385.96 total 743.20 last 96.78) - open/close/unlink 61343 (time 1781221395.97 total 753.20 last 134.24) - open/close/unlink 62437 (time 1781221405.97 total 763.21 last 109.35) - open/close/unlink 63482 (time 1781221415.98 total 773.21 last 104.47) - open/close/unlink 64473 (time 1781221425.98 total 783.22 last 99.02) total: 64768 open/close/unlink in 786.88 seconds: 82.31 ops/second Waiting for MDT destroys to complete oleg635-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg635-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg635-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server stop mds service on oleg635-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server stop mds service on oleg635-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg635-server unloading modules via unload_modules_local on: 'oleg635-server' oleg635-server: oleg635-server.virtnet: executing unload_modules_local oleg635-server: modules unloaded. pdsh@oleg635-client: oleg635-server: ssh exited with exit code 2 pdsh@oleg635-client: oleg635-client: ssh exited with exit code 2 pdsh@oleg635-client: oleg635-client: ssh exited with exit code 2 pdsh@oleg635-client: oleg635-server: ssh exited with exit code 2 PASS 106 (860s) Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg635-client: oleg635-server: ssh exited with exit code 2 oleg635-server: oleg635-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg635-server' oleg635-server: oleg635-server.virtnet: executing load_modules_local oleg635-server: Loading modules from /home/green/git/lustre-release/lustre oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg635-server: detected 4 online CPUs by sysfs oleg635-server: MODOPTS_LIBCFS= oleg635-server: Force libcfs to create 2 CPU partitions oleg635-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg635-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg635-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 1020 sec ========== 19:44:57 (1781221497) === conf-sanity: start cleanup 19:44:58 (1781221498) === === conf-sanity: finish cleanup 19:45:00 (1781221500) ===