-----============= acceptance-small: conf-sanity ============----- Sat Feb 28 13:53:32 EST 2026 oleg154-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 110 Stopping clients: oleg154-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg154-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg154-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg154-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg154-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg154-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg154-server oleg154-server: oleg154-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg154-server' oleg154-server: oleg154-server.virtnet: executing load_modules_local oleg154-server: Loading modules from /home/green/git/lustre-release/lustre oleg154-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg154-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg154-server: detected 4 online CPUs by sysfs oleg154-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg154-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg154-server: oleg154-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg154-client: oleg154-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg154-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg154-server: oleg154-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg154-client: oleg154-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg154-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg154-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg154-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg154-server: oleg154-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg154-client: oleg154-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg154-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg154-server: oleg154-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg154-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg154-server: oleg154-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 40 oleg154-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg154-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg154-server stop mds service on oleg154-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg154-server stop mds service on oleg154-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg154-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 13:55:10 (1772304910) Stopping clients: oleg154-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg154-client.virtnet /mnt/lustre2 (opts:-f) oleg154-server: oleg154-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg154-server' oleg154-server: oleg154-server.virtnet: executing load_modules_local oleg154-server: Loading modules from /home/green/git/lustre-release/lustre oleg154-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg154-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg154-server: detected 4 online CPUs by sysfs oleg154-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg154-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg154-server: oleg154-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg154-client: oleg154-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg154-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg154-server: oleg154-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg154-client: oleg154-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg154-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg154-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg154-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg154-server: oleg154-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg154-client: oleg154-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg154-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg154-client.virtnet: -o user_xattr,flock oleg154-server@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 334 32562 2% /mnt/lustre[OST:0] filesystem_summary: 33091 529 32562 2% /mnt/lustre fail_loc=0x1312 fail_val=5 - open/close 4604 (time 1772304959.52 total 10.00 last 460.33) - open/close 9616 (time 1772304969.52 total 20.00 last 501.17) - open/close 14730 (time 1772304979.52 total 30.00 last 511.33) - open/close 20000 (time 1772304989.20 total 39.68 last 544.50) - open/close 25777 (time 1772304999.20 total 49.68 last 577.68) - open/close 30000 (time 1772305006.77 total 57.25 last 557.77) open(/mnt/lustre/d106.conf-sanity/f-32594) error: No space left on device total: 32594 open/close in 61.96 seconds: 526.01 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32869 47123 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33124 33124 0 100% /mnt/lustre - /unlink 9286 (time 1772305022.85 total 10.00 last 928.56) - /unlink 19025 (time 1772305032.85 total 20.00 last 973.86) - /unlink 28818 (time 1772305042.85 total 30.00 last 979.26) unlink(/mnt/lustre/d106.conf-sanity/f-32594) error: No such file or directory total: 32594 /unlink in 33.86 seconds: 962.57 ops/second Waiting for MDT destroys to complete - open/close 5473 (time 1772305100.10 total 10.00 last 547.27) - open/close 10000 (time 1772305108.50 total 18.40 last 539.01) - open/close 15386 (time 1772305118.50 total 28.40 last 538.54) - open/close 20000 (time 1772305127.23 total 37.13 last 528.79) - open/close 24887 (time 1772305137.23 total 47.13 last 488.68) - open/close 29681 (time 1772305147.23 total 57.13 last 479.36) open(/mnt/lustre/d106.conf-sanity/f-32594) error: No space left on device total: 32594 open/close in 63.99 seconds: 509.34 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32869 47123 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33124 33124 0 100% /mnt/lustre - /unlink 8840 (time 1772305165.46 total 10.00 last 883.94) - /unlink 18313 (time 1772305175.46 total 20.00 last 947.24) - /unlink 28440 (time 1772305185.46 total 30.00 last 1012.70) unlink(/mnt/lustre/d106.conf-sanity/f-32594) error: No such file or directory total: 32594 /unlink in 34.66 seconds: 940.29 ops/second Waiting for MDT destroys to complete - open/close 5490 (time 1772305224.18 total 10.00 last 548.91) - open/close 10000 (time 1772305232.04 total 17.85 last 574.34) - open/close 15865 (time 1772305242.04 total 27.85 last 586.47) - open/close 20000 (time 1772305249.65 total 35.47 last 542.81) - open/close 25609 (time 1772305259.65 total 45.47 last 560.88) - open/close 30000 (time 1772305268.51 total 54.33 last 495.63) open(/mnt/lustre/d106.conf-sanity/f-32594) error: No space left on device total: 32594 open/close in 59.68 seconds: 546.17 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32869 47123 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33124 33124 0 100% /mnt/lustre - /unlink 8307 (time 1772305285.25 total 10.00 last 830.68) - /unlink 10000 (time 1772305287.46 total 12.21 last 765.01) - /unlink 18483 (time 1772305297.46 total 22.21 last 848.25) - /unlink 27286 (time 1772305307.46 total 32.21 last 880.28) - /unlink 30000 (time 1772305310.45 total 35.21 last 907.27) unlink(/mnt/lustre/d106.conf-sanity/f-32594) error: No such file or directory total: 32594 /unlink in 38.26 seconds: 852.00 ops/second Waiting for MDT destroys to complete - open/close 4959 (time 1772305352.10 total 10.00 last 495.81) - open/close 10000 (time 1772305361.61 total 19.50 last 530.53) - open/close 15036 (time 1772305371.61 total 29.50 last 503.58) - open/close 20000 (time 1772305381.36 total 39.26 last 508.97) - open/close 24987 (time 1772305391.36 total 49.26 last 498.69) - open/close 29986 (time 1772305401.36 total 59.26 last 499.82) open(/mnt/lustre/d106.conf-sanity/f-32594) error: No space left on device total: 32594 open/close in 64.78 seconds: 503.15 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32869 47123 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33124 33124 0 100% /mnt/lustre - /unlink 8749 (time 1772305418.22 total 10.00 last 874.87) - /unlink 18007 (time 1772305428.22 total 20.00 last 925.74) - /unlink 20000 (time 1772305430.23 total 22.02 last 988.45) - /unlink 29406 (time 1772305440.23 total 32.02 last 940.54) unlink(/mnt/lustre/d106.conf-sanity/f-32594) error: No such file or directory total: 32594 /unlink in 36.07 seconds: 903.53 ops/second Waiting for MDT destroys to complete - open/close 5161 (time 1772305484.79 total 10.00 last 516.05) - open/close 10000 (time 1772305494.26 total 19.47 last 510.85) - open/close 15086 (time 1772305504.27 total 29.48 last 508.51) - open/close 19895 (time 1772305514.27 total 39.48 last 480.70) - open/close 24690 (time 1772305524.27 total 49.48 last 479.47) - open/close 29695 (time 1772305534.27 total 59.48 last 500.44) open(/mnt/lustre/d106.conf-sanity/f-32594) error: No space left on device total: 32594 open/close in 65.13 seconds: 500.41 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32869 47123 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33124 33124 0 100% /mnt/lustre - /unlink 10000 (time 1772305550.63 total 9.50 last 1053.13) - /unlink 18366 (time 1772305560.63 total 19.50 last 836.50) - /unlink 27370 (time 1772305570.64 total 29.50 last 900.37) - /unlink 30000 (time 1772305573.37 total 32.23 last 961.35) unlink(/mnt/lustre/d106.conf-sanity/f-32594) error: No such file or directory total: 32594 /unlink in 34.99 seconds: 931.53 ops/second Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg154-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg154-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg154-server stop mds service on oleg154-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg154-server stop mds service on oleg154-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg154-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy unloading modules on: 'oleg154-server' oleg154-server: oleg154-server.virtnet: executing unload_modules_local oleg154-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy oleg154-server: LNET ready to unload oleg154-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy modules unloaded. pdsh@oleg154-client: oleg154-client: ssh exited with exit code 2 pdsh@oleg154-client: oleg154-server: ssh exited with exit code 2 pdsh@oleg154-client: oleg154-server: ssh exited with exit code 2 pdsh@oleg154-client: oleg154-client: ssh exited with exit code 2 PASS 106 (726s) Stopping clients: oleg154-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg154-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg154-client: oleg154-server: ssh exited with exit code 2 oleg154-server: oleg154-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg154-server' oleg154-server: oleg154-server.virtnet: executing load_modules_local oleg154-server: Loading modules from /home/green/git/lustre-release/lustre oleg154-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg154-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg154-server: detected 4 online CPUs by sysfs oleg154-server: Force libcfs to create 2 CPU partitions oleg154-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg154-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 851 sec =========== 14:07:43 (1772305663)