-----============= acceptance-small: conf-sanity ============----- Mon Feb 9 19:58:32 EST 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg222-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg222-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg222-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg222-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg222-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg222-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg222-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg222-server oleg222-server: oleg222-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg222-server' oleg222-server: oleg222-server.virtnet: executing load_modules_local oleg222-server: Loading modules from /home/green/git/lustre-release/lustre oleg222-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg222-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg222-server: detected 4 online CPUs by sysfs oleg222-server: MODOPTS_LIBCFS= oleg222-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg222-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg222-server: oleg222-server.virtnet: executing set_default_debug -1 all pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg222-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg222-server: oleg222-server.virtnet: executing set_default_debug -1 all pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg222-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg222-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg222-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg222-server: oleg222-server.virtnet: executing set_default_debug -1 all pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg222-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg222-server: oleg222-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg222-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg222-server: oleg222-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg222-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg222-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg222-server stop mds service on oleg222-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg222-server stop mds service on oleg222-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg222-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 20:02:43 (1770685363) Stopping clients: oleg222-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg222-client.virtnet /mnt/lustre2 (opts:-f) oleg222-server: oleg222-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg222-server' oleg222-server: oleg222-server.virtnet: executing load_modules_local oleg222-server: Loading modules from /home/green/git/lustre-release/lustre oleg222-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg222-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg222-server: detected 4 online CPUs by sysfs oleg222-server: MODOPTS_LIBCFS= oleg222-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg222-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg222-server: oleg222-server.virtnet: executing set_default_debug -1 all pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg222-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg222-server: oleg222-server.virtnet: executing set_default_debug -1 all pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg222-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg222-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg222-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg222-server: oleg222-server.virtnet: executing set_default_debug -1 all pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg222-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg222-client.virtnet: -o user_xattr,flock 192.168.202.122@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 65808 369 65439 1% /mnt/lustre[OST:0] filesystem_summary: 65968 529 65439 1% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 661 (time 1770685523.47 total 10.01 last 66.02) - open/close 1315 (time 1770685533.48 total 20.02 last 65.36) - open/close 1940 (time 1770685543.49 total 30.03 last 62.45) - open/close 2534 (time 1770685553.49 total 40.03 last 59.39) - open/close 3245 (time 1770685563.49 total 50.03 last 71.10) - open/close 3975 (time 1770685573.50 total 60.04 last 72.89) - open/close 4633 (time 1770685583.51 total 70.05 last 65.73) - open/close 5354 (time 1770685593.51 total 80.05 last 72.10) - open/close 6031 (time 1770685603.52 total 90.06 last 67.69) - open/close 6659 (time 1770685613.52 total 100.06 last 62.77) - open/close 7316 (time 1770685623.53 total 110.07 last 65.61) - open/close 7983 (time 1770685633.54 total 120.08 last 66.69) - open/close 8711 (time 1770685643.55 total 130.09 last 72.69) - open/close 9423 (time 1770685653.56 total 140.10 last 71.16) - open/close 10000 (time 1770685662.32 total 148.86 last 65.81) - open/close 10701 (time 1770685672.34 total 158.88 last 70.02) - open/close 11521 (time 1770685682.34 total 168.88 last 81.94) - open/close 12296 (time 1770685692.35 total 178.89 last 77.45) - open/close 12973 (time 1770685702.36 total 188.90 last 67.63) - open/close 13689 (time 1770685712.37 total 198.91 last 71.53) - open/close 14342 (time 1770685722.38 total 208.92 last 65.23) - open/close 15043 (time 1770685732.39 total 218.93 last 70.01) - open/close 15719 (time 1770685742.40 total 228.94 last 67.54) - open/close 16496 (time 1770685752.41 total 238.95 last 77.63) - open/close 17271 (time 1770685762.42 total 248.96 last 77.45) - open/close 18017 (time 1770685772.43 total 258.97 last 74.52) - open/close 18775 (time 1770685782.45 total 268.98 last 75.67) - open/close 19491 (time 1770685792.45 total 278.99 last 71.56) - open/close 20000 (time 1770685799.22 total 285.76 last 75.16) - open/close 20784 (time 1770685809.23 total 295.77 last 78.31) - open/close 21589 (time 1770685819.24 total 305.78 last 80.46) - open/close 22328 (time 1770685829.26 total 315.80 last 73.77) - open/close 23124 (time 1770685839.27 total 325.81 last 79.45) - open/close 23933 (time 1770685849.28 total 335.82 last 80.84) - open/close 24607 (time 1770685859.30 total 345.84 last 67.28) - open/close 25396 (time 1770685869.30 total 355.84 last 78.88) - open/close 26182 (time 1770685879.31 total 365.85 last 78.58) - open/close 27042 (time 1770685889.31 total 375.85 last 85.96) - open/close 27708 (time 1770685899.34 total 385.88 last 66.42) - open/close 28389 (time 1770685909.36 total 395.90 last 67.94) - open/close 29090 (time 1770685919.37 total 405.91 last 70.02) - open/close 29824 (time 1770685929.39 total 415.93 last 73.29) - open/close 30000 (time 1770685931.92 total 418.46 last 69.51) - open/close 30748 (time 1770685941.93 total 428.47 last 74.76) - open/close 31506 (time 1770685951.94 total 438.48 last 75.71) - open/close 32248 (time 1770685961.95 total 448.49 last 74.12) - open/close 33043 (time 1770685971.96 total 458.49 last 79.45) - open/close 33824 (time 1770685981.96 total 468.50 last 78.10) - open/close 34612 (time 1770685991.96 total 478.50 last 78.79) - open/close 35411 (time 1770686001.96 total 488.50 last 79.85) - open/close 36225 (time 1770686011.97 total 498.51 last 81.34) - open/close 36991 (time 1770686021.98 total 508.51 last 76.57) - open/close 37741 (time 1770686031.98 total 518.52 last 74.97) - open/close 38507 (time 1770686041.98 total 528.52 last 76.56) - open/close 39187 (time 1770686051.98 total 538.52 last 68.00) - open/close 39957 (time 1770686061.99 total 548.53 last 76.95) - open/close 40770 (time 1770686072.00 total 558.54 last 81.23) - open/close 41529 (time 1770686082.00 total 568.54 last 75.88) - open/close 42297 (time 1770686092.02 total 578.56 last 76.66) - open/close 43066 (time 1770686102.03 total 588.57 last 76.85) - open/close 43940 (time 1770686112.05 total 598.59 last 87.22) - open/close 44812 (time 1770686122.06 total 608.60 last 87.13) - open/close 45614 (time 1770686132.07 total 618.61 last 80.07) - open/close 46404 (time 1770686142.07 total 628.61 last 78.99) - open/close 47270 (time 1770686152.09 total 638.63 last 86.49) - open/close 48073 (time 1770686162.09 total 648.63 last 80.27) - open/close 48937 (time 1770686172.09 total 658.63 last 86.38) - open/close 49828 (time 1770686182.10 total 668.64 last 89.03) - open/close 50000 (time 1770686184.51 total 671.05 last 71.55) - open/close 50803 (time 1770686194.51 total 681.05 last 80.28) - open/close 51679 (time 1770686204.52 total 691.06 last 87.49) - open/close 52585 (time 1770686214.53 total 701.07 last 90.53) - open/close 53449 (time 1770686224.54 total 711.08 last 86.32) - open/close 54435 (time 1770686234.55 total 721.09 last 98.52) - open/close 55321 (time 1770686244.55 total 731.09 last 88.56) - open/close 56254 (time 1770686254.56 total 741.09 last 93.27) - open/close 57156 (time 1770686264.56 total 751.10 last 90.16) - open/close 57973 (time 1770686274.57 total 761.11 last 81.63) - open/close 58764 (time 1770686284.59 total 771.13 last 78.96) - open/close 59538 (time 1770686294.59 total 781.13 last 77.36) - open/close 60000 (time 1770686299.20 total 785.74 last 100.23) - open/close 60767 (time 1770686309.21 total 795.75 last 76.63) - open/close 61515 (time 1770686319.22 total 805.76 last 74.73) - open/close 62325 (time 1770686329.23 total 815.77 last 80.93) - open/close 63172 (time 1770686339.23 total 825.77 last 84.68) - open/close 64034 (time 1770686349.23 total 835.77 last 86.18) total: 64768 open/close in 844.72 seconds: 76.67 ops/second - /unlink 805 (time 1770686371.86 total 10.00 last 80.46) - /unlink 1640 (time 1770686381.87 total 20.01 last 83.44) - /unlink 2468 (time 1770686391.88 total 30.02 last 82.74) - /unlink 3294 (time 1770686401.88 total 40.02 last 82.58) - /unlink 4155 (time 1770686411.89 total 50.04 last 85.98) - /unlink 4977 (time 1770686421.89 total 60.04 last 82.20) - /unlink 5719 (time 1770686431.90 total 70.04 last 74.14) - /unlink 6403 (time 1770686441.90 total 80.04 last 68.40) - /unlink 7121 (time 1770686451.91 total 90.05 last 71.74) - /unlink 7979 (time 1770686461.91 total 100.05 last 85.79) - /unlink 8783 (time 1770686471.92 total 110.06 last 80.34) - /unlink 9624 (time 1770686481.92 total 120.07 last 84.06) - /unlink 10000 (time 1770686486.36 total 124.50 last 84.81) - /unlink 10798 (time 1770686496.36 total 134.50 last 79.78) - /unlink 11604 (time 1770686506.36 total 144.51 last 80.56) - /unlink 12438 (time 1770686516.37 total 154.51 last 83.38) - /unlink 13185 (time 1770686526.38 total 164.52 last 74.62) - /unlink 13987 (time 1770686536.38 total 174.52 last 80.18) - /unlink 14827 (time 1770686546.39 total 184.53 last 83.91) - /unlink 15572 (time 1770686556.40 total 194.55 last 74.41) - /unlink 16331 (time 1770686566.40 total 204.55 last 75.89) - /unlink 17176 (time 1770686576.40 total 214.55 last 84.49) - /unlink 17962 (time 1770686586.41 total 224.55 last 78.59) - /unlink 18757 (time 1770686596.41 total 234.55 last 79.45) - /unlink 19575 (time 1770686606.41 total 244.55 last 81.80) - /unlink 20000 (time 1770686611.46 total 249.60 last 84.17) - /unlink 20818 (time 1770686621.47 total 259.61 last 81.72) - /unlink 21631 (time 1770686631.48 total 269.63 last 81.21) - /unlink 22447 (time 1770686641.48 total 279.63 last 81.58) - /unlink 23307 (time 1770686651.50 total 289.64 last 85.88) - /unlink 24129 (time 1770686661.50 total 299.65 last 82.15) - /unlink 25041 (time 1770686671.51 total 309.65 last 91.18) - /unlink 25889 (time 1770686681.51 total 319.66 last 84.75) - /unlink 26671 (time 1770686691.51 total 329.66 last 78.19) - /unlink 27419 (time 1770686701.52 total 339.66 last 74.79) - /unlink 28215 (time 1770686711.52 total 349.66 last 79.58) - /unlink 29090 (time 1770686721.52 total 359.66 last 87.49) - /unlink 29895 (time 1770686731.52 total 369.67 last 80.47) - /unlink 30764 (time 1770686741.53 total 379.67 last 86.85) - /unlink 31529 (time 1770686751.53 total 389.68 last 76.46) - /unlink 32385 (time 1770686761.54 total 399.68 last 85.58) - /unlink 33245 (time 1770686771.55 total 409.69 last 85.89) - /unlink 34135 (time 1770686781.55 total 419.70 last 88.97) - /unlink 35151 (time 1770686791.56 total 429.70 last 101.57) - /unlink 36008 (time 1770686801.56 total 439.70 last 85.64) - /unlink 36931 (time 1770686811.57 total 449.72 last 92.19) - /unlink 37726 (time 1770686821.58 total 459.72 last 79.44) - /unlink 38558 (time 1770686831.58 total 469.73 last 83.19) - /unlink 39377 (time 1770686841.59 total 479.74 last 81.81) - /unlink 40000 (time 1770686849.38 total 487.52 last 80.03) - /unlink 40795 (time 1770686859.38 total 497.52 last 79.48) - /unlink 41602 (time 1770686869.40 total 507.54 last 80.58) - /unlink 42443 (time 1770686879.41 total 517.56 last 83.95) - /unlink 43271 (time 1770686889.41 total 527.56 last 82.80) - /unlink 44154 (time 1770686899.42 total 537.56 last 88.29) - /unlink 45107 (time 1770686909.42 total 547.56 last 95.24) - /unlink 45879 (time 1770686919.42 total 557.57 last 77.19) - /unlink 46719 (time 1770686929.43 total 567.57 last 83.96) - /unlink 47552 (time 1770686939.43 total 577.57 last 83.28) - /unlink 48427 (time 1770686949.43 total 587.58 last 87.49) - /unlink 49265 (time 1770686959.45 total 597.59 last 83.68) - /unlink 50000 (time 1770686967.72 total 605.86 last 88.90) - /unlink 50922 (time 1770686977.72 total 615.86 last 92.15) - /unlink 51785 (time 1770686987.72 total 625.87 last 86.26) - /unlink 52735 (time 1770686997.73 total 635.87 last 94.95) - /unlink 53568 (time 1770687007.73 total 645.88 last 83.27) - /unlink 54421 (time 1770687017.74 total 655.88 last 85.28) - /unlink 55375 (time 1770687027.75 total 665.89 last 95.32) - /unlink 56297 (time 1770687037.75 total 675.89 last 92.15) - /unlink 57222 (time 1770687047.76 total 685.91 last 92.38) - /unlink 58097 (time 1770687057.77 total 695.91 last 87.45) - /unlink 58947 (time 1770687067.77 total 705.91 last 84.97) - /unlink 59823 (time 1770687077.78 total 715.92 last 87.55) - /unlink 60809 (time 1770687087.79 total 725.93 last 98.49) - /unlink 61836 (time 1770687097.79 total 735.93 last 102.68) - /unlink 62805 (time 1770687107.80 total 745.94 last 96.86) - /unlink 63734 (time 1770687117.80 total 755.94 last 92.89) - /unlink 64616 (time 1770687127.80 total 765.94 last 88.18) total: 64768 /unlink in 767.32 seconds: 84.41 ops/second Waiting for MDT destroys to complete oleg222-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 - open/close 1014 (time 1770687153.66 total 10.01 last 101.28) - open/close 1888 (time 1770687163.67 total 20.02 last 87.36) - open/close 2839 (time 1770687173.68 total 30.03 last 95.00) - open/close 3748 (time 1770687183.68 total 40.03 last 90.90) - open/close 4751 (time 1770687193.68 total 50.03 last 100.24) - open/close 5788 (time 1770687203.69 total 60.04 last 103.59) - open/close 6841 (time 1770687213.70 total 70.05 last 105.27) - open/close 7858 (time 1770687223.70 total 80.05 last 101.66) - open/close 8846 (time 1770687233.70 total 90.06 last 98.74) - open/close 9855 (time 1770687243.71 total 100.06 last 100.87) - open/close 10824 (time 1770687253.71 total 110.06 last 96.85) - open/close 11776 (time 1770687263.72 total 120.07 last 95.10) - open/close 12759 (time 1770687273.73 total 130.08 last 98.27) - open/close 13661 (time 1770687283.73 total 140.08 last 90.20) - open/close 14603 (time 1770687293.73 total 150.08 last 94.18) - open/close 15562 (time 1770687303.73 total 160.08 last 95.88) - open/close 16568 (time 1770687313.74 total 170.09 last 100.53) - open/close 17701 (time 1770687323.74 total 180.09 last 113.29) - open/close 18771 (time 1770687333.74 total 190.09 last 106.99) - open/close 19829 (time 1770687343.74 total 200.09 last 105.76) - open/close 20822 (time 1770687353.75 total 210.10 last 99.26) - open/close 21879 (time 1770687363.75 total 220.11 last 105.63) - open/close 22946 (time 1770687373.76 total 230.11 last 106.66) - open/close 23870 (time 1770687383.76 total 240.12 last 92.35) - open/close 24778 (time 1770687393.77 total 250.12 last 90.73) - open/close 25742 (time 1770687403.77 total 260.13 last 96.37) - open/close 26778 (time 1770687413.78 total 270.13 last 103.59) - open/close 27830 (time 1770687423.78 total 280.13 last 105.15) - open/close 28958 (time 1770687433.78 total 290.13 last 112.78) - open/close 30000 (time 1770687443.08 total 299.43 last 112.13) - open/close 31090 (time 1770687453.08 total 309.43 last 108.93) - open/close 32124 (time 1770687463.08 total 319.43 last 103.39) - open/close 33118 (time 1770687473.09 total 329.44 last 99.36) - open/close 34220 (time 1770687483.10 total 339.45 last 110.10) - open/close 35276 (time 1770687493.10 total 349.45 last 105.57) - open/close 36319 (time 1770687503.11 total 359.46 last 104.15) - open/close 37399 (time 1770687513.11 total 369.46 last 107.99) - open/close 38518 (time 1770687523.11 total 379.47 last 111.88) - open/close 39728 (time 1770687533.12 total 389.47 last 120.97) - open/close 40000 (time 1770687535.36 total 391.71 last 121.15) - open/close 41093 (time 1770687545.37 total 401.72 last 109.24) - open/close 42296 (time 1770687555.38 total 411.73 last 120.18) - open/close 43392 (time 1770687565.38 total 421.73 last 109.60) - open/close 44513 (time 1770687575.38 total 431.73 last 112.05) - open/close 45772 (time 1770687585.39 total 441.74 last 125.76) - open/close 46918 (time 1770687595.40 total 451.75 last 114.51) - open/close 47950 (time 1770687605.40 total 461.76 last 103.16) - open/close 48959 (time 1770687615.41 total 471.77 last 100.80) - open/close 49987 (time 1770687625.43 total 481.78 last 102.68) - open/close 51089 (time 1770687635.43 total 491.79 last 110.11) - open/close 52189 (time 1770687645.43 total 501.79 last 110.00) - open/close 53329 (time 1770687655.44 total 511.79 last 113.90) - open/close 54511 (time 1770687665.44 total 521.80 last 118.20) - open/close 55628 (time 1770687675.44 total 531.80 last 111.70) - open/close 56794 (time 1770687685.45 total 541.80 last 116.54) - open/close 58023 (time 1770687695.46 total 551.81 last 122.82) - open/close 59349 (time 1770687705.46 total 561.81 last 132.53) - open/close 60000 (time 1770687710.00 total 566.36 last 143.29) - open/close 61378 (time 1770687720.01 total 576.36 last 137.70) - open/close 62592 (time 1770687730.01 total 586.37 last 121.36) - open/close 63766 (time 1770687740.02 total 596.37 last 117.34) total: 64768 open/close in 605.49 seconds: 106.97 ops/second - /unlink 1408 (time 1770687761.35 total 10.01 last 140.70) - /unlink 3518 (time 1770687771.35 total 20.01 last 210.96) - /unlink 5888 (time 1770687781.36 total 30.01 last 236.96) - /unlink 8290 (time 1770687791.36 total 40.01 last 240.13) - /unlink 10000 (time 1770687798.03 total 46.69 last 256.29) - /unlink 12802 (time 1770687808.03 total 56.69 last 280.10) - /unlink 15032 (time 1770687818.04 total 66.69 last 222.93) - /unlink 17193 (time 1770687828.04 total 76.70 last 216.01) - /unlink 19606 (time 1770687838.04 total 86.70 last 241.28) - /unlink 22633 (time 1770687848.04 total 96.70 last 302.69) - /unlink 25459 (time 1770687858.05 total 106.70 last 282.47) - /unlink 28032 (time 1770687868.05 total 116.71 last 257.22) - /unlink 30000 (time 1770687875.10 total 123.75 last 279.23) - /unlink 32685 (time 1770687885.10 total 133.75 last 268.49) - /unlink 35616 (time 1770687895.10 total 143.75 last 293.09) - /unlink 38286 (time 1770687905.10 total 153.76 last 266.90) - /unlink 40000 (time 1770687911.90 total 160.55 last 252.21) - /unlink 43154 (time 1770687921.90 total 170.56 last 315.33) - /unlink 47006 (time 1770687931.90 total 180.56 last 385.13) - /unlink 50000 (time 1770687939.23 total 187.88 last 408.65) - /unlink 53539 (time 1770687949.23 total 197.88 last 353.88) - /unlink 56939 (time 1770687959.23 total 207.89 last 339.97) - /unlink 60000 (time 1770687968.91 total 217.56 last 316.39) - /unlink 63054 (time 1770687978.91 total 227.56 last 305.33) total: 64768 /unlink in 234.00 seconds: 276.79 ops/second Waiting for MDT destroys to complete oleg222-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 - open/close 1571 (time 1770688006.89 total 10.00 last 157.06) - open/close 3323 (time 1770688016.90 total 20.01 last 175.08) - open/close 5541 (time 1770688026.90 total 30.01 last 221.69) - open/close 8013 (time 1770688036.90 total 40.01 last 247.20) - open/close 9703 (time 1770688046.91 total 50.02 last 168.97) - open/close 11337 (time 1770688056.91 total 60.02 last 163.37) - open/close 13329 (time 1770688066.91 total 70.02 last 199.15) - open/close 14791 (time 1770688076.92 total 80.02 last 146.14) - open/close 16526 (time 1770688086.92 total 90.03 last 173.45) - open/close 17979 (time 1770688096.92 total 100.03 last 145.22) - open/close 19579 (time 1770688106.92 total 110.03 last 159.99) - open/close 20000 (time 1770688110.05 total 113.16 last 134.65) - open/close 21629 (time 1770688120.05 total 123.16 last 162.86) - open/close 23815 (time 1770688130.05 total 133.16 last 218.59) - open/close 25736 (time 1770688140.06 total 143.17 last 192.02) - open/close 27533 (time 1770688150.06 total 153.17 last 179.69) - open/close 29244 (time 1770688160.06 total 163.17 last 171.08) - open/close 30000 (time 1770688163.75 total 166.86 last 204.95) - open/close 31621 (time 1770688173.76 total 176.87 last 161.95) - open/close 32920 (time 1770688183.76 total 186.87 last 129.85) - open/close 34450 (time 1770688193.76 total 196.87 last 152.99) - open/close 36111 (time 1770688203.77 total 206.87 last 166.03) - open/close 37684 (time 1770688213.77 total 216.88 last 157.26) - open/close 39576 (time 1770688223.77 total 226.88 last 189.20) - open/close 41583 (time 1770688233.77 total 236.88 last 200.62) - open/close 43561 (time 1770688243.77 total 246.88 last 197.75) - open/close 45695 (time 1770688253.78 total 256.89 last 213.37) - open/close 47352 (time 1770688263.78 total 266.89 last 165.70) - open/close 49080 (time 1770688273.78 total 276.89 last 172.68) - open/close 50000 (time 1770688279.13 total 282.24 last 172.16) - open/close 51809 (time 1770688289.13 total 292.24 last 180.87) - open/close 53708 (time 1770688299.13 total 302.24 last 189.89) - open/close 55807 (time 1770688309.13 total 312.24 last 209.89) - open/close 57647 (time 1770688319.13 total 322.24 last 183.97) - open/close 59558 (time 1770688329.13 total 332.24 last 191.03) - open/close 60000 (time 1770688331.81 total 334.92 last 165.00) - open/close 62022 (time 1770688341.81 total 344.92 last 202.19) - open/close 64443 (time 1770688351.82 total 354.93 last 242.05) total: 64768 open/close in 356.36 seconds: 181.75 ops/second - /unlink 3504 (time 1770688364.88 total 10.01 last 350.19) - /unlink 6919 (time 1770688374.88 total 20.01 last 341.46) - /unlink 10000 (time 1770688383.15 total 28.28 last 372.41) - /unlink 13664 (time 1770688393.16 total 38.29 last 366.11) - /unlink 17270 (time 1770688403.17 total 48.29 last 360.49) - /unlink 20000 (time 1770688411.51 total 56.64 last 327.13) - /unlink 23515 (time 1770688421.51 total 66.64 last 351.46) - /unlink 26653 (time 1770688431.51 total 76.64 last 313.71) - /unlink 30000 (time 1770688440.76 total 85.88 last 362.14) - /unlink 34283 (time 1770688450.76 total 95.89 last 428.18) - /unlink 38830 (time 1770688460.76 total 105.89 last 454.68) - /unlink 40000 (time 1770688462.88 total 108.01 last 551.77) - /unlink 45801 (time 1770688472.88 total 118.01 last 580.04) - /unlink 50000 (time 1770688481.16 total 126.28 last 507.52) - /unlink 53994 (time 1770688491.16 total 136.28 last 399.38) - /unlink 57427 (time 1770688501.16 total 146.28 last 343.23) - /unlink 60000 (time 1770688508.25 total 153.38 last 362.67) - /unlink 63961 (time 1770688518.25 total 163.38 last 396.08) total: 64768 /unlink in 165.18 seconds: 392.09 ops/second Waiting for MDT destroys to complete oleg222-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 - open/close 2549 (time 1770688538.90 total 10.00 last 254.88) - open/close 4941 (time 1770688548.91 total 20.00 last 239.14) - open/close 8002 (time 1770688558.91 total 30.01 last 306.00) - open/close 10000 (time 1770688565.78 total 36.88 last 290.63) - open/close 12396 (time 1770688575.79 total 46.88 last 239.58) - open/close 15500 (time 1770688585.79 total 56.88 last 310.35) - open/close 19050 (time 1770688595.79 total 66.89 last 354.93) - open/close 20000 (time 1770688598.50 total 69.60 last 349.74) - open/close 22885 (time 1770688608.51 total 79.60 last 288.48) - open/close 24841 (time 1770688618.51 total 89.60 last 195.56) - open/close 26818 (time 1770688628.51 total 99.61 last 197.65) - open/close 29150 (time 1770688638.51 total 109.61 last 233.11) - open/close 30000 (time 1770688641.05 total 112.14 last 335.68) - open/close 32171 (time 1770688651.05 total 122.14 last 217.10) - open/close 34256 (time 1770688661.05 total 132.15 last 208.35) - open/close 36704 (time 1770688671.06 total 142.15 last 244.76) - open/close 39352 (time 1770688681.06 total 152.15 last 264.76) - open/close 40000 (time 1770688683.48 total 154.57 last 267.73) - open/close 42737 (time 1770688693.48 total 164.57 last 273.67) - open/close 45406 (time 1770688703.48 total 174.58 last 266.81) - open/close 48418 (time 1770688713.48 total 184.58 last 301.15) - open/close 50000 (time 1770688718.68 total 189.78 last 304.32) - open/close 52514 (time 1770688728.68 total 199.78 last 251.36) - open/close 54402 (time 1770688738.69 total 209.79 last 188.68) - open/close 56464 (time 1770688748.69 total 219.79 last 206.13) - open/close 58126 (time 1770688758.70 total 229.80 last 166.08) - open/close 59725 (time 1770688768.70 total 239.80 last 159.85) - open/close 61200 (time 1770688778.71 total 249.80 last 147.43) - open/close 63267 (time 1770688788.71 total 259.81 last 206.64) total: 64768 open/close in 265.91 seconds: 243.57 ops/second - /unlink 3456 (time 1770688806.56 total 10.00 last 345.57) - /unlink 7640 (time 1770688816.56 total 20.01 last 418.15) - /unlink 10000 (time 1770688821.32 total 24.76 last 496.17) - /unlink 14791 (time 1770688831.32 total 34.76 last 479.10) - /unlink 19417 (time 1770688841.32 total 44.76 last 462.54) - /unlink 24496 (time 1770688851.32 total 54.76 last 507.89) - /unlink 29096 (time 1770688861.32 total 64.77 last 459.98) - /unlink 30000 (time 1770688864.31 total 67.76 last 302.11) - /unlink 33191 (time 1770688874.32 total 77.76 last 319.07) - /unlink 37343 (time 1770688884.32 total 87.76 last 415.19) - /unlink 40000 (time 1770688890.65 total 94.10 last 419.31) - /unlink 45913 (time 1770688900.65 total 104.10 last 591.28) - /unlink 50000 (time 1770688908.52 total 111.96 last 519.41) - /unlink 55501 (time 1770688918.52 total 121.97 last 549.98) - /unlink 60000 (time 1770688926.62 total 130.06 last 555.67) total: 64768 /unlink in 139.05 seconds: 465.77 ops/second Waiting for MDT destroys to complete oleg222-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 - open/close 2683 (time 1770688958.32 total 10.00 last 268.27) - open/close 5120 (time 1770688968.32 total 20.01 last 243.59) - open/close 7114 (time 1770688978.33 total 30.01 last 199.28) - open/close 9169 (time 1770688988.34 total 40.02 last 205.40) - open/close 10000 (time 1770688992.32 total 44.00 last 208.42) - open/close 12749 (time 1770689002.32 total 54.00 last 274.87) - open/close 16078 (time 1770689012.32 total 64.01 last 332.86) - open/close 19004 (time 1770689022.33 total 74.01 last 292.51) - open/close 20000 (time 1770689026.46 total 78.14 last 240.97) - open/close 22658 (time 1770689036.46 total 88.14 last 265.76) - open/close 25353 (time 1770689046.47 total 98.15 last 269.35) - open/close 27408 (time 1770689056.47 total 108.15 last 205.43) - open/close 29777 (time 1770689066.47 total 118.16 last 236.82) - open/close 32591 (time 1770689076.48 total 128.16 last 281.31) - open/close 35367 (time 1770689086.48 total 138.16 last 277.54) - open/close 38341 (time 1770689096.48 total 148.16 last 297.34) - open/close 40000 (time 1770689101.70 total 153.38 last 318.17) - open/close 42913 (time 1770689111.70 total 163.38 last 291.29) - open/close 46457 (time 1770689121.70 total 173.38 last 354.36) - open/close 50000 (time 1770689130.94 total 182.62 last 383.43) - open/close 54439 (time 1770689140.94 total 192.62 last 443.88) - open/close 58453 (time 1770689150.94 total 202.62 last 401.33) - open/close 60000 (time 1770689154.91 total 206.59 last 389.40) - open/close 63755 (time 1770689164.92 total 216.60 last 375.32) total: 64768 open/close in 219.60 seconds: 294.93 ops/second - /unlink 5720 (time 1770689179.41 total 10.00 last 571.96) - /unlink 10000 (time 1770689187.35 total 17.94 last 539.20) - /unlink 16593 (time 1770689197.35 total 27.94 last 659.24) - /unlink 20000 (time 1770689202.42 total 33.00 last 672.66) - /unlink 26139 (time 1770689212.42 total 43.01 last 613.85) - /unlink 30000 (time 1770689218.57 total 49.16 last 626.94) - /unlink 35924 (time 1770689228.58 total 59.16 last 592.34) - /unlink 40000 (time 1770689236.01 total 66.59 last 548.65) - /unlink 45945 (time 1770689246.01 total 76.59 last 594.49) - /unlink 50000 (time 1770689251.77 total 82.36 last 703.35) - /unlink 56741 (time 1770689261.77 total 92.36 last 674.09) - /unlink 60000 (time 1770689266.11 total 96.69 last 751.79) total: 64768 /unlink in 103.12 seconds: 628.11 ops/second Waiting for MDT destroys to complete oleg222-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg222-client: oleg222-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg222-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg222-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg222-server stop mds service on oleg222-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg222-server stop mds service on oleg222-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg222-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg222-server' oleg222-server: oleg222-server.virtnet: executing unload_modules_local oleg222-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg222-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg222-client: oleg222-client: ssh exited with exit code 2 pdsh@oleg222-client: oleg222-server: ssh exited with exit code 2 pdsh@oleg222-client: oleg222-client: ssh exited with exit code 2 pdsh@oleg222-client: oleg222-server: ssh exited with exit code 2 PASS 106 (3951s) Stopping clients: oleg222-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg222-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg222-client: oleg222-server: ssh exited with exit code 2 oleg222-server: oleg222-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg222-server' oleg222-server: oleg222-server.virtnet: executing load_modules_local oleg222-server: Loading modules from /home/green/git/lustre-release/lustre oleg222-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg222-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg222-server: detected 4 online CPUs by sysfs oleg222-server: MODOPTS_LIBCFS= oleg222-server: Force libcfs to create 2 CPU partitions oleg222-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg222-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg222-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 4224 sec ========== 21:08:58 (1770689338) === conf-sanity: start cleanup 21:08:59 (1770689339) === === conf-sanity: finish cleanup 21:09:00 (1770689340) ===