-----============= acceptance-small: replay-dual ============----- Mon May 20 21:09:41 EDT 2024
mgs: CentOS Linux release 7.9.2009 (Core)
MGS_OS_VERSION_ID=7
MGS_OS_ID=centos
MGS_OS_VERSION_CODE=117440512
MGS_OS_ID_LIKE=rhel fedora centos
mds1: CentOS Linux release 7.9.2009 (Core)
MDS1_OS_ID_LIKE=rhel fedora centos
MDS1_OS_ID=centos
MDS1_OS_VERSION_ID=7
MDS1_OS_VERSION_CODE=117440512
ost1: CentOS Linux release 7.9.2009 (Core)
OST1_OS_VERSION_CODE=117440512
OST1_OS_VERSION_ID=7
OST1_OS_ID_LIKE=rhel fedora centos
OST1_OS_ID=centos
client: CentOS Linux release 7.9.2009 (Core)
CLIENT_OS_ID=centos
CLIENT_OS_ID_LIKE=rhel fedora centos
CLIENT_OS_VERSION_ID=7
CLIENT_OS_VERSION_CODE=117440512
excepting tests: 14b 21b
skipping tests SLOW=no: 21b
=== replay-dual: start setup 21:09:50 (1716253790) ===
Starting client oleg217-client.virtnet:  -o user_xattr,flock oleg217-server@tcp:/lustre /mnt/lustre2
Started clients oleg217-client.virtnet: 
192.168.202.117@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project)
oleg217-client.virtnet: executing check_config_client /mnt/lustre
oleg217-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg217-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8800b479e000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8800b6d0b000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8800b479e000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8800b6d0b000.idle_timeout=debug
disable quota as required
oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all
osd-ldiskfs.track_declares_assert=1
=== replay-dual: finish setup 21:10:07 (1716253807) ===
debug_raw_pointers=Y
debug_raw_pointers=Y

== replay-dual test 1: |X| simple create ================= 21:10:10 (1716253810)
UUID                   1K-blocks        Used   Available Use% Mounted on
lustre-MDT0000_UUID      1414116        1772     1285916   1% /mnt/lustre[MDT:0]
lustre-MDT0001_UUID      1414116        1616     1286072   1% /mnt/lustre[MDT:1]
lustre-OST0000_UUID      3833116        1524     3605496   1% /mnt/lustre[OST:0]
lustre-OST0001_UUID      3833116        1524     3605496   1% /mnt/lustre[OST:1]

filesystem_summary:      7666232        3048     7210992   1% /mnt/lustre

Failing mds1 on oleg217-server
Stopping /mnt/lustre-mds1 (opts:) on oleg217-server
21:10:17 (1716253817) shut down
Failover mds1 to oleg217-server
mount facets: mds1
Starting mds1: -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all
pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1
Started lustre-MDT0000
21:10:34 (1716253834) targets are mounted
21:10:34 (1716253834) facet_failover done
oleg217-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 1 (32s)
debug_raw_pointers=0
debug_raw_pointers=0
== replay-dual test complete, duration 62 sec ============ 21:10:43 (1716253843)
=== replay-dual: start cleanup 21:10:43 (1716253843) ===
Stopping clients: oleg217-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg217-client.virtnet /mnt/lustre2 opts:
=== replay-dual: finish cleanup 21:10:44 (1716253844) ===