-----============= acceptance-small: replay-single ============----- Tue Apr 14 11:55:35 EDT 2026 oleg215-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/replay-single.*ex': No such file or directory excepting tests: 59 oleg215-client.virtnet: executing check_config_client /mnt/lustre oleg215-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg215-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8f52c3d1e000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8f52c3d1e000.idle_timeout=debug disable quota as required oleg215-server: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 Cleaning up AT ... == replay-single test 100c: DNE: create striped dir, abort_recov_mdt mds2 ========================================================== 11:56:19 (1776182179) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1848 1285840 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1688 1286000 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2776 7211264 1% /mnt/lustre Stopping /mnt/lustre-mds2 (opts:) on oleg215-server Failover mds2 to oleg215-server Starting mds2: -o localrecov -o abort_recov_mdt /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg215-server: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg215-client: oleg215-server: ssh exited with exit code 1 Started lustre-MDT0001 open(/mnt/lustre/d100c.replay-single/striped_dir/f-0) error: No such file or directory total: 0 open/close in 0.01 seconds: 0.00 ops/second Failing mds2 on oleg215-server Stopping /mnt/lustre-mds2 (opts:) on oleg215-server reboot facets: mds2 Failover mds2 to oleg215-server mount facets: mds2 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg215-server: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg215-client: oleg215-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg215-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec find: '/mnt/lustre/d100c.replay-single/striped_dir': No such file or directory rmdir: failed to remove '/mnt/lustre/d100c.replay-single/striped_dir': No such file or directory PASS 100c (84s) == replay-single test 100d: DNE: cancel update logs upon recovery abort ========================================================== 11:57:43 (1776182263) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d100d.replay-single total: 100 mkdir in 1.47 seconds: 68.00 ops/second lustre-MDT0001-osd [catalog]: [0x240000bd0:0x1:0x0] [index]: 00001 [logid]: [0x2400013a0:0x1:0x0] lustre-MDT0000-osp-MDT0001 [catalog]: [0x200000403:0x1:0x0] [index]: 00001 [logid]: [0x200000404:0x1:0x0] [index]: 00002 [logid]: [0x200000404:0x2:0x0] Stopping /mnt/lustre-mds2 (opts:) on oleg215-server Failover mds2 to oleg215-server Starting mds2: -o localrecov -o abort_recovery /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg215-server: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg215-client: oleg215-server: ssh exited with exit code 1 Started lustre-MDT0001 pdsh@oleg215-client: oleg215-server: ssh exited with exit code 1 PASS 100d (42s) == replay-single test 202: pfl replay should recovery layout generation ========================================================== 11:58:26 (1776182306) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3048 1284640 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2900 1284788 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2776 7211264 1% /mnt/lustre Failing mds1 on oleg215-server Stopping /mnt/lustre-mds1 (opts:) on oleg215-server reboot facets: mds1 Failover mds1 to oleg215-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg215-server: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg215-client: oleg215-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg215-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 202 (61s) Failing mds1 on oleg215-server Stopping /mnt/lustre-mds1 (opts:) on oleg215-server reboot facets: mds1 Failover mds1 to oleg215-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg215-server: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg215-client: oleg215-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg215-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Stopping clients: oleg215-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg215-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg215-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg215-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg215-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg215-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg215-server oleg215-server: oleg215-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg215-server' oleg215-server: oleg215-server.virtnet: executing load_modules_local oleg215-server: Loading modules from /home/green/git/lustre-release/lustre oleg215-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg215-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg215-server: detected 4 online CPUs by sysfs oleg215-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == replay-single test complete, duration 373 sec ========= 12:01:50 (1776182510)