== conf-sanity test 157c: test allow_register timeout functionality ========================================================== 04:42:28 (1789375348) start mds service on oleg317-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x. 1 green green 1931560 Sep 14 04:14 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg317-server' oleg317-server: oleg317-server.virtnet: executing load_modules_local oleg317-server: kmemleak disabled oleg317-server: Loading modules from /home/green/git/lustre-release/lustre oleg317-server: detected 4 online CPUs by sysfs oleg317-server: MODOPTS_LIBCFS= oleg317-server: Force libcfs to create 2 CPU partitions oleg317-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg317-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg317-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg317-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg317-server: params: OBD_IOC_LLOG_PRINT failed: No such file or directory pdsh@oleg317-client: oleg317-server: ssh exited with exit code 2 pdsh@oleg317-client: oleg317-server: ssh exited with exit code 123 allow_register=unlimited oleg317-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg317-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Started lustre-OST0000 oleg317-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg317-client.virtnet: -o user_xattr,flock 192.168.203.117@tcp:/lustre /mnt/lustre allow_register=unlimited Permanent disk data: Device: lustre-ost1_2/ost1_2 Target: fs2466:OST0000 Index: 0 Lustre FS: fs2466 Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.203.117@tcp:192.168.203.117@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1_2 /tmp/lustre-ost1_2 mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1_2/ost1_2 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1_2/ost1_2 properties lustre:mgsnode=192.168.203.117@tcp:192.168.203.117@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=fs2466 lustre:svname=fs2466:OST0000 /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript Start fs2ost: mount -t lustre -o localrecov lustre-ost1_2/ost1_2 /mnt/lustre-fs2ost seq.cli-fs2466-OST0000-super.width=65536 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Commit the device label on lustre-ost1_2/ost1_2 Started fs2466-OST0000 allow_register=60s obdfilter.fs2466-OST0000.recovery_status=status: INACTIVE Waiting for allow_register timeout to expire Waiting 66s for '1' Waiting 56s for '1' Waiting 46s for '1' Waiting 36s for '1' Waiting 26s for '1' Waiting 16s for '1' Updated after 58s: want '1' got '1' Permanent disk data: Device: lustre-ost2_2/ost2_2 Target: fs2466:OST0001 Index: 1 Lustre FS: fs2466 Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.203.117@tcp:192.168.203.117@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost2_2 /tmp/lustre-ost2_2 mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost2_2/ost2_2 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost2_2/ost2_2 properties lustre:mgsnode=192.168.203.117@tcp:192.168.203.117@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=1 lustre:fsname=fs2466 lustre:svname=fs2466:OST0001 /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript Start fs3ost: mount -t lustre -o localrecov lustre-ost2_2/ost2_2 /mnt/lustre-fs3ost oleg317-server: mount.lustre: mount lustre-ost2_2/ost2_2 at /mnt/lustre-fs3ost failed: Permission denied pdsh@oleg317-client: oleg317-server: ssh exited with exit code 13 oleg317-server: error: set_param: param_path 'seq/cli-fs2466:OST0001-super/width': No such file or directory oleg317-server: error: set_param: setting 'seq/cli-fs2466:OST0001-super/width'='65536': No such file or directory pdsh@oleg317-client: oleg317-server: ssh exited with exit code 2 Start of lustre-ost2_2/ost2_2 on fs3ost failed 13 allow_register=unlimited /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript Start fs3ost: mount -t lustre -o localrecov lustre-ost2_2/ost2_2 /mnt/lustre-fs3ost seq.cli-fs2466-OST0001-super.width=65536 oleg317-server: oleg317-server.virtnet: executing set_default_debug -1 all pdsh@oleg317-client: oleg317-server: ssh exited with exit code 1 Commit the device label on lustre-ost2_2/ost2_2 Started fs2466-OST0001 obdfilter.fs2466-OST0000.recovery_status=status: INACTIVE obdfilter.fs2466-OST0001.recovery_status=status: INACTIVE Cleaning up test 157c... Stopping /mnt/lustre-fs2ost (opts:-f) on oleg317-server Stopping /mnt/lustre-fs3ost (opts:-f) on oleg317-server umount lustre on /mnt/lustre..... Stopping client oleg317-client.virtnet /mnt/lustre (opts:) oleg317-server: params: OBD_IOC_LLOG_PRINT failed: No such file or directory pdsh@oleg317-client: oleg317-server: ssh exited with exit code 2 pdsh@oleg317-client: oleg317-server: ssh exited with exit code 123 allow_register=unlimited stop ost1 service on oleg317-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg317-server stop mds service on oleg317-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg317-server unloading modules via unload_modules_local on: 'oleg317-server' oleg317-server: oleg317-server.virtnet: executing unload_modules_local oleg317-server: kmemleak disabled modules unloaded.