== sanity test 115: verify dynamic thread creation============================================================================== 16:34:30 (1776198870) Stopping clients: oleg433-client.virtnet /mnt/lustre (opts:) Stopping client oleg433-client.virtnet /mnt/lustre opts: Stopping clients: oleg433-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg433-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg433-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg433-server Checking servers environments Checking clients oleg433-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg433-server' oleg433-server: oleg433-server.virtnet: executing load_modules_local oleg433-server: Loading modules from /home/green/git/lustre-release/lustre oleg433-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg433-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg433-server: detected 4 online CPUs by sysfs oleg433-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg433-server: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg433-client: oleg433-server: ssh exited with exit code 1 Started lustre-MDT0000 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg433-server: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg433-client: oleg433-server: ssh exited with exit code 1 Started lustre-OST0000 Starting ost2: -o localrecov lustre-ost2/ost2 /mnt/lustre-ost2 oleg433-server: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg433-client: oleg433-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client: oleg433-client.virtnet: -o user_xattr,flock oleg433-server@tcp:/lustre /mnt/lustre Starting client oleg433-client.virtnet: -o user_xattr,flock oleg433-server@tcp:/lustre /mnt/lustre Started clients oleg433-client.virtnet: 192.168.204.133@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9b6107a5b000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9b6107a5b000.idle_timeout=debug disable quota as required Starting with 3 threads osc.lustre-OST0000-osc-ffff9b6107a5b000.max_rpcs_in_flight=12 osc.lustre-OST0001-osc-ffff9b6107a5b000.max_rpcs_in_flight=12 ost.OSS.ost_io.threads_max=6 Waiting for thread_started to reach thread_max ......ll_ost_io thread_started 6, equal/greater than thread_max 6 /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14620 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14626 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14629 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14637 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14639 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14618 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14622 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14624 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14631 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14633 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14635 Killed ( $WTL $file $timeout ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12146: 14641 Killed ( $WTL $file $timeout )