== recovery-small test 10a: finish request on server after client eviction (bug 1521) ========================================================== 23:09:13 (1717556953)
ldlm.namespaces.MGC192.168.204.138@tcp.early_lock_cancel=0
ldlm.namespaces.lustre-MDT0000-mdc-ffff8801376cb000.early_lock_cancel=0
ldlm.namespaces.lustre-MDT0001-mdc-ffff8801376cb000.early_lock_cancel=0
ldlm.namespaces.lustre-OST0000-osc-ffff8801376cb000.early_lock_cancel=0
ldlm.namespaces.lustre-OST0001-osc-ffff8801376cb000.early_lock_cancel=0
fail_loc=0x305
fail_loc=0
fail_val=0
ldlm.namespaces.MGC192.168.204.138@tcp.early_lock_cancel=1
ldlm.namespaces.lustre-MDT0000-mdc-ffff8801376cb000.early_lock_cancel=1
ldlm.namespaces.lustre-MDT0001-mdc-ffff8801376cb000.early_lock_cancel=1
ldlm.namespaces.lustre-OST0000-osc-ffff8801376cb000.early_lock_cancel=1
ldlm.namespaces.lustre-OST0001-osc-ffff8801376cb000.early_lock_cancel=1
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4019: /mnt/lustre/recon: Input/output error
Connected clients: oleg438-client.virtnet
/mnt/lustre has perms 0777 OK
[  410.358077] Lustre: ll_ost00_000: service thread pid 9452 was inactive for 40.110 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[  410.357718] Lustre: ll_ost00_002: service thread pid 9454 was inactive for 40.110 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[  410.357710] Lustre: ll_ost00_001: service thread pid 9453 was inactive for 40.110 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
[  406.783408] Lustre: mdt00_004: service thread pid 14379 was inactive for 40.097 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
 recovery-small test_10a: @@@@@@ FAIL: no service thread completed  message for test 10a 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7066:error()
  = /home/green/git/lustre-release/lustre/tests/recovery-small.sh:164:test_10a()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7411:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7474:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7297:run_test()
  = /home/green/git/lustre-release/lustre/tests/recovery-small.sh:166:main()
Dumping lctl log to /tmp/testlogs//recovery-small.test_10a.*.1717557067.log
oleg438-client: error: couldn't open trace file
oleg438-client: error: couldn't open trace file
oleg438-server: error: couldn't open trace file
oleg438-server: error: couldn't open trace file
rsync: chown "/tmp/testlogs/.recovery-small.test_10a.debug_log.oleg438-server.1717557067.log.z7wBvv" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.recovery-small.test_10a.dmesg.oleg438-server.1717557067.log.LRskOU" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]