-----============= acceptance-small: replay-single ============----- Tue Apr 14 10:48:53 EDT 2026 oleg253-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/replay-single.*ex': No such file or directory excepting tests: 59 oleg253-client.virtnet: executing check_config_client /mnt/lustre oleg253-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg253-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8d6ac5300000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8d6ac5300000.idle_timeout=debug disable quota as required oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 Cleaning up AT ... == replay-single test 100c: DNE: create striped dir, abort_recov_mdt mds2 ========================================================== 10:49:56 (1776178196) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1848 1285840 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1688 1286000 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2776 7211264 1% /mnt/lustre Stopping /mnt/lustre-mds2 (opts:) on oleg253-server Failover mds2 to oleg253-server Starting mds2: -o localrecov -o abort_recov_mdt /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 Started lustre-MDT0001 open(/mnt/lustre/d100c.replay-single/striped_dir/f-0) error: No such file or directory total: 0 open/close in 0.01 seconds: 0.00 ops/second Failing mds2 on oleg253-server Stopping /mnt/lustre-mds2 (opts:) on oleg253-server reboot facets: mds2 Failover mds2 to oleg253-server mount facets: mds2 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg253-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec find: '/mnt/lustre/d100c.replay-single/striped_dir': No such file or directory rmdir: failed to remove '/mnt/lustre/d100c.replay-single/striped_dir': No such file or directory PASS 100c (106s) == replay-single test 100d: DNE: cancel update logs upon recovery abort ========================================================== 10:51:43 (1776178303) striped dir -i0 -c2 -H crush /mnt/lustre/d100d.replay-single total: 100 mkdir in 1.83 seconds: 54.51 ops/second lustre-MDT0000-osd [catalog]: [0x200000400:0x1:0x0] [index]: 00001 [logid]: [0x200000400:0x3:0x0] lustre-MDT0001-osp-MDT0000 [catalog]: [0x240000401:0x1:0x0] [index]: 00001 [logid]: [0x240000401:0x3:0x0] [index]: 00002 [logid]: [0x240000401:0x4:0x0] Stopping /mnt/lustre-mds1 (opts:) on oleg253-server Failover mds1 to oleg253-server Starting mds1: -o localrecov -o abort_recovery /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 Started lustre-MDT0000 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 PASS 100d (41s) == replay-single test 202: pfl replay should recovery layout generation ========================================================== 10:52:24 (1776178344) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3080 1284608 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2868 1284820 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2776 7211264 1% /mnt/lustre Failing mds1 on oleg253-server Stopping /mnt/lustre-mds1 (opts:) on oleg253-server reboot facets: mds1 Failover mds1 to oleg253-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg253-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 202 (66s) Stopping clients: oleg253-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg253-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg253-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg253-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg253-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg253-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg253-server oleg253-server: oleg253-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg253-server' oleg253-server: oleg253-server.virtnet: executing load_modules_local oleg253-server: Loading modules from /home/green/git/lustre-release/lustre oleg253-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg253-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg253-server: detected 4 online CPUs by sysfs oleg253-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == replay-single test complete, duration 389 sec ========= 10:55:24 (1776178524)