== conf-sanity test 65: re-create the lost last_rcvd file when server mount ========================================================== 05:30:23 (1734258623)
stop mds service on oleg448-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server
stop mds service on oleg448-server
Stopping /mnt/lustre-mds2 (opts:-f) on oleg448-server
oleg448-server: debugfs 1.46.2.wc5 (26-Mar-2022)
oleg448-server: /dev/mapper/mds1_flakey: catastrophic mode - not reading inode or group bitmaps
start mds service on oleg448-server
Starting mds1: -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all
pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1
Started lustre-MDT0000
start mds service on oleg448-server
Starting mds2: -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all
pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1
Started lustre-MDT0001
oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
 rpc test_65: @@@@@@ FAIL: can't put import for mdc.lustre-MDT0001-mdc-*.mds_server_uuid into FULL state after 1475 sec, have DISCONN 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7232:error()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:8717:_wait_import_state()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:8739:wait_import_state()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:8749:wait_import_state_mount()
  = /home/green/git/lustre-release/lustre/tests/rpc.sh:20:main()
rsync: chown "/tmp/testlogs/.rpc.test_65.debug_log.oleg448-server.1734260148.log.lz3DeJ" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.rpc.test_65.dmesg.oleg448-server.1734260148.log.bkNRCG" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]
oleg448-client.virtnet: Dumping lctl log to /tmp/testlogs//rpc.test_65.*.1734260148.log
 conf-sanity test_65: @@@@@@ FAIL: import is not in FULL state 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7232:error()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:8983:wait_clients_import_state()
  = /home/green/git/lustre-release/lustre/tests/conf-sanity-framework.sh:90:start_mds()
  = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:2487:test_65()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7605:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7668:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7471:run_test()
  = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:2493:main()
Dumping lctl log to /tmp/testlogs//conf-sanity.test_65.*.1734260150.log
rsync: chown "/tmp/testlogs/.conf-sanity.test_65.debug_log.oleg448-server.1734260150.log.UELYwk" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.conf-sanity.test_65.dmesg.oleg448-server.1734260150.log.1IofKk" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]