-----============= acceptance-small: replay-single ============----- Tue Apr 14 10:48:19 EDT 2026 oleg331-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/replay-single.*ex': No such file or directory excepting tests: 59 oleg331-client.virtnet: executing check_config_client /mnt/lustre oleg331-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg331-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff994e107e9000.idle_timeout=debug osc.lustre-OST0001-osc-ffff994e107e9000.idle_timeout=debug disable quota as required oleg331-server: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 Cleaning up AT ... == replay-single test 100c: DNE: create striped dir, abort_recov_mdt mds2 ========================================================== 10:49:09 (1776178149) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1848 1285840 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1688 1286000 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2776 7211264 1% /mnt/lustre Stopping /mnt/lustre-mds2 (opts:) on oleg331-server Failover mds2 to oleg331-server Starting mds2: -o localrecov -o abort_recov_mdt /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg331-server: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg331-client: oleg331-server: ssh exited with exit code 1 Started lustre-MDT0001 open(/mnt/lustre/d100c.replay-single/striped_dir/f-0) error: No such file or directory total: 0 open/close in 0.04 seconds: 0.00 ops/second Failing mds2 on oleg331-server Stopping /mnt/lustre-mds2 (opts:) on oleg331-server reboot facets: mds2 Failover mds2 to oleg331-server mount facets: mds2 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg331-server: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg331-client: oleg331-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg331-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec find: '/mnt/lustre/d100c.replay-single/striped_dir': No such file or directory rmdir: failed to remove '/mnt/lustre/d100c.replay-single/striped_dir': No such file or directory PASS 100c (109s) == replay-single test 100d: DNE: cancel update logs upon recovery abort ========================================================== 10:50:58 (1776178258) striped dir -i0 -c2 -H all_char /mnt/lustre/d100d.replay-single total: 100 mkdir in 1.70 seconds: 58.90 ops/second lustre-MDT0001-osd [catalog]: [0x240000bd0:0x1:0x0] [index]: 00001 [logid]: [0x2400013a0:0x1:0x0] lustre-MDT0000-osp-MDT0001 [catalog]: [0x200000403:0x1:0x0] [index]: 00001 [logid]: [0x200000404:0x1:0x0] [index]: 00002 [logid]: [0x200000404:0x2:0x0] Stopping /mnt/lustre-mds2 (opts:) on oleg331-server Failover mds2 to oleg331-server Starting mds2: -o localrecov -o abort_recovery /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg331-server: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg331-client: oleg331-server: ssh exited with exit code 1 Started lustre-MDT0001 pdsh@oleg331-client: oleg331-server: ssh exited with exit code 1 PASS 100d (42s) == replay-single test 202: pfl replay should recovery layout generation ========================================================== 10:51:41 (1776178301) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3048 1284640 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2900 1284788 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1388 3605632 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2776 7211264 1% /mnt/lustre Failing mds1 on oleg331-server Stopping /mnt/lustre-mds1 (opts:) on oleg331-server reboot facets: mds1 Failover mds1 to oleg331-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg331-server: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg331-client: oleg331-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg331-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 202 (71s) Failing mds1 on oleg331-server Stopping /mnt/lustre-mds1 (opts:) on oleg331-server reboot facets: mds1 Failover mds1 to oleg331-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg331-server: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg331-client: oleg331-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg331-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Stopping clients: oleg331-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg331-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg331-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg331-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg331-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg331-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg331-server oleg331-server: oleg331-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg331-server' oleg331-server: oleg331-server.virtnet: executing load_modules_local oleg331-server: Loading modules from /home/green/git/lustre-release/lustre oleg331-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg331-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg331-server: detected 4 online CPUs by sysfs oleg331-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == replay-single test complete, duration 434 sec ========= 10:55:36 (1776178536)