-----============= acceptance-small: replay-dual ============----- Sun Mar 10 15:39:23 EDT 2024
excepting tests: 14b 21b
skipping tests SLOW=no: 21b
=== replay-dual: start setup 15:39:29 (1710099569) ===
Starting client oleg414-client.virtnet:  -o user_xattr,flock oleg414-server@tcp:/lustre /mnt/lustre2
Started clients oleg414-client.virtnet: 
192.168.204.114@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project)
oleg414-client.virtnet: executing check_config_client /mnt/lustre
oleg414-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg414-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8800b5cad800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8800b5daa800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8800b5cad800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8800b5daa800.idle_timeout=debug
disable quota as required
oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all
osd-ldiskfs.track_declares_assert=1
=== replay-dual: finish setup 15:39:50 (1710099590) ===
osp.lustre-OST0001-osc-MDT0001.prealloc_force_new_seq=1
osp.lustre-OST0000-osc-MDT0000.prealloc_force_new_seq=1
osp.lustre-OST0000-osc-MDT0001.prealloc_force_new_seq=1
osp.lustre-OST0001-osc-MDT0000.prealloc_force_new_seq=1
Creating to objid 33 on ost lustre-OST0001...
Creating to objid 33 on ost lustre-OST0000...
Creating to objid 33 on ost lustre-OST0001...
Creating to objid 33 on ost lustre-OST0000...
total: 33 open/close in 0.78 seconds: 42.44 ops/second
total: 33 open/close in 0.84 seconds: 39.13 ops/second
total: 33 open/close in 0.78 seconds: 42.49 ops/second
total: 33 open/close in 0.86 seconds: 38.43 ops/second
osp.lustre-OST0000-osc-MDT0000.prealloc_force_new_seq=0
osp.lustre-OST0001-osc-MDT0000.prealloc_force_new_seq=0
osp.lustre-OST0001-osc-MDT0001.prealloc_force_new_seq=0
osp.lustre-OST0000-osc-MDT0001.prealloc_force_new_seq=0
debug_raw_pointers=Y
debug_raw_pointers=Y

== replay-dual test 33: Check for OBD_INCOMPAT_MULTI_RPCS in last_rcvd after abort_recovery ========================================================== 15:40:06 (1710099606)
at_min=60
Stopping /mnt/lustre-mds2 (opts:) on oleg414-server
last_rcvd in /dev/mapper/mds2_flakey: incompat = 0x61c
Starting mds2: -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all
pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1
Started lustre-MDT0001
oleg414-client.virtnet: executing wait_import_state_mount REPLAY_WAIT mdc.lustre-MDT0001-mdc-*.mds_server_uuid
mdc.lustre-MDT0001-mdc-*.mds_server_uuid in REPLAY_WAIT state after 0 sec
oleg414-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec
affected facets: mds2
oleg414-server: oleg414-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475
oleg414-server: *.lustre-MDT0001.recovery_status status: COMPLETE
Stopping /mnt/lustre-mds2 (opts:) on oleg414-server
last_rcvd in /dev/mapper/mds2_flakey: incompat = 0x61c
Starting mds2: -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all
pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1
Started lustre-MDT0001
Starting client: oleg414-client.virtnet:  -o user_xattr,flock oleg414-server@tcp:/lustre /mnt/lustre2
oleg414-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL
DISCONN state after 1 sec
affected facets: mds2
oleg414-server: oleg414-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475
oleg414-server: *.lustre-MDT0001.recovery_status status: COMPLETE
at_min=5
PASS 33 (40s)
debug_raw_pointers=0
debug_raw_pointers=0
== replay-dual test complete, duration 83 sec ============ 15:40:47 (1710099647)
=== replay-dual: start cleanup 15:40:48 (1710099648) ===
Stopping clients: oleg414-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg414-client.virtnet /mnt/lustre2 opts:
=== replay-dual: finish cleanup 15:40:49 (1710099649) ===