== conf-sanity test 140: remove_updatelog script actions ========================================================== 09:31:33 (1688477493) pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 start mds service on oleg267-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg267-server' oleg267-server: oleg267-server.virtnet: executing load_modules_local oleg267-server: Loading modules from /home/green/git/lustre-release/lustre oleg267-server: detected 4 online CPUs by sysfs oleg267-server: Force libcfs to create 2 CPU partitions oleg267-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg267-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg267-server: oleg267-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg267-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg267-server: oleg267-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg267-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg267-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg267-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg267-server: oleg267-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 Started lustre-OST0000 oleg267-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg267-client.virtnet: -o user_xattr,flock oleg267-server@tcp:/lustre /mnt/lustre striped dir -i0 -c2 -H crush /mnt/lustre/d140.conf-sanity stop mds service on oleg267-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg267-server stop mds service on oleg267-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg267-server Dry run was requested, no changes will be applied Scan update_log at '/mnt/lustre-mds2': Selected MDTS: 0 1 Processing MDT0 llog catalog [0x240000401:0x1:0x0] ... rm -f /mnt/lustre-mds2/update_log_dir/[0x240000bd0:0x2:0x0] rm -f /mnt/lustre-mds2/update_log_dir/[0x240000bd0:0x3:0x0] > /mnt/lustre-mds2/update_log_dir/[0x240000401:0x1:0x0] Processing MDT1 llog catalog [0x240000400:0x1:0x0] ... remove_updatelog: /mnt/lustre-mds2/update_log_dir/[0x240000400:0x1:0x0] is too small. > /mnt/lustre-mds2/update_log_dir/[0x240000400:0x1:0x0] Dry run was requested, no changes will be applied Scan update_log at '/mnt/lustre-mds2': Selected MDTS: 1 0 Processing MDT1 llog catalog [0x240000400:0x1:0x0] ... remove_updatelog: /mnt/lustre-mds2/update_log_dir/[0x240000400:0x1:0x0] is too small. > /mnt/lustre-mds2/update_log_dir/[0x240000400:0x1:0x0] Processing MDT0 llog catalog [0x240000401:0x1:0x0] ... rm -f /mnt/lustre-mds2/update_log_dir/[0x240000bd0:0x2:0x0] rm -f /mnt/lustre-mds2/update_log_dir/[0x240000bd0:0x3:0x0] > /mnt/lustre-mds2/update_log_dir/[0x240000401:0x1:0x0] Scan update_log at '/mnt/lustre-mds2': Selected MDTS: 0 Processing MDT0 llog catalog [0x240000401:0x1:0x0] ... rm -f /mnt/lustre-mds2/update_log_dir/[0x240000bd0:0x2:0x0] rm -f /mnt/lustre-mds2/update_log_dir/[0x240000bd0:0x3:0x0] > /mnt/lustre-mds2/update_log_dir/[0x240000401:0x1:0x0] start mds service on oleg267-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg267-server: oleg267-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 Started lustre-MDT0001 start mds service on oleg267-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg267-server: oleg267-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg267-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec oleg267-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 3 sec Stopping clients: oleg267-client.virtnet /mnt/lustre (opts:) Stopping client oleg267-client.virtnet /mnt/lustre opts: Stopping clients: oleg267-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg267-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg267-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg267-server Stopping clients: oleg267-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg267-client.virtnet /mnt/lustre2 (opts:-f) oleg267-server: oleg267-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg267-server' oleg267-server: oleg267-server.virtnet: executing load_modules_local oleg267-server: Loading modules from /home/green/git/lustre-release/lustre oleg267-server: detected 4 online CPUs by sysfs oleg267-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg267-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg267-server: oleg267-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg267-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg267-server: oleg267-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg267-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg267-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg267-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg267-server: oleg267-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg267-client: oleg267-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg267-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg267-server: oleg267-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg267-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg267-server: oleg267-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 40 oleg267-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg267-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg267-server stop mds service on oleg267-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg267-server stop mds service on oleg267-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg267-server