== replay-single test 20b: write, unlink, eviction, replay (test mds_cleanup_orphans) ========================================================== 09:06:06 (1747400766) /mnt/lustre/f20b.replay-single lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 1122 0x462 0 dd: error writing '/mnt/lustre/f20b.replay-single': Cannot send after transport endpoint shutdown oleg423-client: error: invalid path '/mnt/lustre': Input/output error pdsh@oleg423-client: oleg423-client: ssh exited with exit code 5 9767+0 records in 9766+0 records out 40001536 bytes (40 MB) copied, 1.64283 s, 24.3 MB/s Failing mds1 on oleg423-server Stopping /mnt/lustre-mds1 (opts:) on oleg423-server reboot facets: mds1 Failover mds1 to oleg423-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg423-server: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg423-client: oleg423-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg423-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec affected facets: mds1 oleg423-server: oleg423-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg423-server: *.lustre-MDT0000.recovery_status status: COMPLETE Waiting for MDT destroys to complete before 1432, after 2844 before 1432, after 2844 before 1432, after 2844 replay-single test_20b: @@@@@@ FAIL: after 2844 > before 1432 + 64 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/replay-single.sh:516:test_20b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/replay-single.sh:523:main() Dumping lctl log to /tmp/testlogs//replay-single.test_20b.*.1747400804.log rsync: chown "/tmp/testlogs/.replay-single.test_20b.debug_log.oleg423-server.1747400804.log.ub4qH6" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.replay-single.test_20b.dmesg.oleg423-server.1747400804.log.bAhbcV" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]