-----============= acceptance-small: replay-single ============----- Tue Apr 14 11:48:33 EDT 2026 oleg404-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/replay-single.*ex': No such file or directory excepting tests: 59 oleg404-client.virtnet: executing check_config_client /mnt/lustre oleg404-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg404-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9b97c2aea000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9b97c2aea000.idle_timeout=debug disable quota as required oleg404-server: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 Cleaning up AT ... == replay-single test 100c: DNE: create striped dir, abort_recov_mdt mds2 ========================================================== 11:49:08 (1776181748) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1772 1285916 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1688 1286000 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2776 7211264 1% /mnt/lustre Stopping /mnt/lustre-mds2 (opts:) on oleg404-server Failover mds2 to oleg404-server Starting mds2: -o localrecov -o abort_recov_mdt /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg404-server: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-MDT0001 open(/mnt/lustre/d100c.replay-single/striped_dir/f-0) error: No such file or directory total: 0 open/close in 0.01 seconds: 0.00 ops/second Failing mds2 on oleg404-server Stopping /mnt/lustre-mds2 (opts:) on oleg404-server reboot facets: mds2 Failover mds2 to oleg404-server mount facets: mds2 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg404-server: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg404-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec find: '/mnt/lustre/d100c.replay-single/striped_dir': No such file or directory rmdir: failed to remove '/mnt/lustre/d100c.replay-single/striped_dir': No such file or directory PASS 100c (75s) == replay-single test 100d: DNE: cancel update logs upon recovery abort ========================================================== 11:50:24 (1776181824) striped dir -i0 -c2 -H all_char /mnt/lustre/d100d.replay-single total: 100 mkdir in 1.28 seconds: 78.21 ops/second lustre-MDT0001-osd [catalog]: [0x240000bd0:0x1:0x0] [index]: 00001 [logid]: [0x2400013a0:0x1:0x0] lustre-MDT0000-osp-MDT0001 [catalog]: [0x200000403:0x1:0x0] [index]: 00001 [logid]: [0x200000404:0x1:0x0] [index]: 00002 [logid]: [0x200000404:0x2:0x0] Stopping /mnt/lustre-mds2 (opts:) on oleg404-server Failover mds2 to oleg404-server Starting mds2: -o localrecov -o abort_recovery /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg404-server: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-MDT0001 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 PASS 100d (35s) == replay-single test 202: pfl replay should recovery layout generation ========================================================== 11:51:00 (1776181860) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3048 1284640 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2900 1284788 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2776 7211264 1% /mnt/lustre Failing mds1 on oleg404-server Stopping /mnt/lustre-mds1 (opts:) on oleg404-server reboot facets: mds1 Failover mds1 to oleg404-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg404-server: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg404-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 202 (62s) Failing mds1 on oleg404-server Stopping /mnt/lustre-mds1 (opts:) on oleg404-server reboot facets: mds1 Failover mds1 to oleg404-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg404-server: oleg404-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg404-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Stopping clients: oleg404-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg404-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg404-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg404-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg404-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg404-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg404-server oleg404-server: oleg404-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg404-server' oleg404-server: oleg404-server.virtnet: executing load_modules_local oleg404-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg404-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg404-server: Loading modules from /home/green/git/lustre-release/lustre oleg404-server: detected 4 online CPUs by sysfs oleg404-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == replay-single test complete, duration 348 sec ========= 11:54:24 (1776182064)