== recovery-small test 10a: finish request on server after client eviction (bug 1521) ========================================================== 18:29:16 (1745620156) ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b43aa000.lru_max_age=3900s ldlm.namespaces.lustre-MDT0001-mdc-ffff8800b43aa000.lru_max_age=3900s console_ratelimit=0 ldlm.namespaces.MGC192.168.201.159@tcp.early_lock_cancel=0 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b43aa000.early_lock_cancel=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff8800b43aa000.early_lock_cancel=0 ldlm.namespaces.lustre-OST0000-osc-ffff8800b43aa000.early_lock_cancel=0 ldlm.namespaces.lustre-OST0001-osc-ffff8800b43aa000.early_lock_cancel=0 fail_loc=0x305 fail_loc=0 fail_val=0 ldlm.namespaces.MGC192.168.201.159@tcp.early_lock_cancel=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b43aa000.early_lock_cancel=1 ldlm.namespaces.lustre-MDT0001-mdc-ffff8800b43aa000.early_lock_cancel=1 ldlm.namespaces.lustre-OST0000-osc-ffff8800b43aa000.early_lock_cancel=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b43aa000.early_lock_cancel=1 /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4137: /mnt/lustre/recon: Input/output error Connected clients: oleg159-client.virtnet /mnt/lustre has perms 0777 OK [ 551.736509] Lustre: ll_ost00_005: service thread pid 19974 was inactive for 40.090 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [ 545.848296] Lustre: ll_ost00_001: service thread pid 9606 was inactive for 40.011 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [ 545.848294] Lustre: ll_ost00_002: service thread pid 9607 was inactive for 40.013 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [ 545.336395] Lustre: mdt00_004: service thread pid 11144 was inactive for 40.045 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [ 617.881737] Lustre: ll_ost00_002: service thread pid 9607 completed after 112.046s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources). [ 617.858600] Lustre: ll_ost00_001: service thread pid 9606 completed after 112.022s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources). [ 617.856459] Lustre: ll_ost00_005: service thread pid 19974 completed after 106.210s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources). [ 617.456299] Lustre: mdt00_004: service thread pid 11144 completed after 112.165s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources). ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b43aa000.lru_max_age=600000 ldlm.namespaces.lustre-MDT0001-mdc-ffff8800b43aa000.lru_max_age=600000 console_ratelimit=1